AWS Data Engineer

₹75000-150000 INR

Imefungwa

Imechapishwa

about 1 year ago

₹75000-150000 INR

Kulipwa wakati wa kufikishwa

AWS Data Engineer with min of 6 to 9 years of experience (JD1) · Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. · Connect with stakeholders daily to discuss project progress and updates. · Work within an Agile process to deliver projects in a timely and efficient manner. · Design and develop Airflow DAGs to schedule and manage ETL workflows. · Transform SQL queries into Spark SQL code for ETL pipelines. · custom Python functions to handle data quality and validation. · Write PySpark scripts to process data and perform transformations. · Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. · Run Spark jobs on AWS EMR cluster using Airflow DAGs. · Monitor and troubleshoot ETL pipelines to ensure smooth operation. · Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. · Collaborate with other members of the data engineering team to improve processes and implement new technologies. · Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness. AWS Data Engineer with min of 5 to 7 years of experience (JD 2) · Experience with AWS ( Glue, Lambda, Appflow, DyanmoDB,Athena, Step function,S3) · Experience with relational SQL and NoSQL databases like Mysql, Postgres, Mongodb and Cassandra. · Experience with data pipeline tools like Airflow, etc. · Experience with AWS cloud services like: EC2, S3, EMR, RDS, Redshift, BigQuery · Experience with stream-processing systems like: Storm, Spark-Streaming, Flink etc. · Experience with object-oriented/object function scripting languages: Python, PySpark, Scala, etc.

Kitambulisho cha mradi: 36327639

Kuhusu mradi

18 mapendekezo

Mradi wa mbali

Inatumika 1 yr ago

Unatafuta kupata pesa?

Barua pepe

Faida za kutoa zabuni kwenye Freelancer

Weka bajeti yako na muda uliopangwa

Pata malipo kwa kazi yako

Eleza pendekezo lako

Ni bure kujiandikisha na kutoa zabuni kwa kazi

18 wafanyakazi huru wana zabuni kwa wastani ₹121,389 INR kwa kazi hii

@bindmission

Hello I am a Linux system administrator with 9 years of experience in AWS server management. I will handle this project. We can discuss more in chat. Thanks VishnuLal*

₹100,000 INR ndani ya siku 1

5.0

(142 hakiki)

6.4

@Zied130

Hello, I will work on this project until I get good results and complete all the tasks. I am prepared to handle projects requiring Python skills. Please come over chat and discuss your requirement in a detailed way. Zied B.

₹150,000 INR ndani ya siku 7

4.5

(63 hakiki)

5.4

@AppDuniya

Hi there, Greetings!! I am writing to propose my services as an AWS Data Engineer with a minimum of 6 to 9 years of experience. I have carefully reviewed the job descriptions (JD1 & JD2) and believe that my skills and experience match the requirements listed. I have experience collaborating with business analysts to understand and gather requirements for ETL pipelines, designing and developing Airflow DAGs, transforming SQL queries into Spark SQL code, and writing PySpark scripts to process data and perform transformations. I am also skilled in creating custom Python functions to handle data quality and validation and implementing data validation processes. In addition, I have experience with various AWS cloud services such as Glue, Lambda, Appflow, DynamoDB, Athena, Step function, S3, and stream-processing systems like Storm, Spark-Streaming, and Flink. I have worked with relational SQL and NoSQL databases like MySQL, Postgres, MongoDB, and Cassandra, and I am proficient in object-oriented/object function scripting languages such as Python, PySpark, and Scala. I believe that my skills and experience make me an excellent candidate for this position, and I look forward to discussing how I can contribute to your team. Thanks & Regards, Sachin T

₹275,000 INR ndani ya siku 30

5.0

(1 hakiki)

4.6

@robartint

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

₹75,000 INR ndani ya siku 7

4.9

(8 hakiki)

4.0

@nitin6312offcie4

? Experience in AWS Security: Created and Managed IAM roles, users, groups, policies, generated credential report for analysis ? Creation of Auto Scaling groups (ASGs) from custom or pre available AMIs, by creating launch templates for provisioning elastic applications. ? Knowledge in DNS management in Route53, creation of private and publichosted zones and records for public and intranet applications. ? Knowledge of serverless computing AWS LAMBDA and Azure functions ? Knowledge of DevOps practices and toolset along with CI/CD delivery model and capable of engineering and architecting client-server virtual systems with a focus on security and high availability. ? Delivering infrastructure services (IaaS, PaaS, SaaS), robust and reliable systems through rapid adaptation of technology capabilities, team motivation, and collaborative work with business partners(Amazon. ? Experienced in AWS Management tool (Cloud Formation, CloudWatch, CloudTrail, Config, OpsWorks, Service Catalog, Trusted Advisor) ? Lead the preparation activities ofrelease, change, incident, service request and problem management. ? Exposure in disaster recovery, asset, configuration and availability management, promising enhanced performance.

₹112,500 INR ndani ya siku 7

5.0

(6 hakiki)

2.7

@samudram1712

I understand that you are looking for a very simple website with information about your job in selling and buying cars. I have 4+ years of experience in PHP web development, specifically with WordPress and other frameworks such as CodeIgniter, Html/CSS/Bootstrap, and Javascript/Jquery. My portfolio showcases my work which speaks for itself. I am confident that I can create the perfect website for you. My expertise includes graphic design, HTML, website design, and WordPress which makes me ideally suited to deliver what you are looking for. I have an excellent understanding of SEO techniques that can be used to improve the search engine ranking of your website. I also have experience in project management which can be used to ensure that the project is completed on time and within budget. If you would like to discuss further how my skills can be used to create the website of your dreams please feel free to reach out to me directly.

₹112,500 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@abdf2010

Hello There, I checked your project (AWS Data Engineer), I can develop it with fair charges, I have 7 years of development experience, Come to chat about details; Thanks

₹75,000 INR ndani ya siku 4

0.0

(0 hakiki)

0.0

@ImtiyazAliJafri1

Hello, I am a skilled software developer with expertise in Python, Machine Learning, and Artificial Intelligence. I have extensive experience in developing AI-based programs for various industries, including environmental applications. I am confident that I have the necessary skills and experience to help you develop an AI segmentation program to detect trees in a forest environment and a 3D forest mapping tool. I can help you develop and test the AI segmentation function, as well as maintain and organize a forest inventory database. Additionally, I have experience in developing and implementing algorithms that work with 3D models, which would be beneficial for developing the forest mapping tool. I have great communication skills and will work closely with you throughout the project to ensure that your requirements are met. I will provide regular updates on the project progress and will be available to answer any questions you may have. I am committed to delivering high-quality work that meets your expectations within the given timeline of 4-6 weeks. Please let me know if you have any questions or if you would like to discuss this project further. Best regards Imtiyaz

₹112,500 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@vinaykumar5477

Hi, I am having 13+ years of experience in multiple technologies which includes following: AWS Microsoft Azure Azure Devops PowerShell Kubernetes Docker CI/CD pipeline Azure Boards Virtualization IBM MQ Terraform TIBCO EMS/RV TIBCO BW WebSphere application server github/gitlab python scripting shell scriping sql database. Please let me know your availability to complete this . Regards

₹150,000 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@prateekhighskyit

My name is Prateek, I am a Certified AWS DevOps Engineer with over 11+ years of hands on experience in architecting /automating and optimizing the mission critical application and deployments over large scale infrastructures. Proficient with Configuration Management tools and in developing. Managing Devops CI CD using GitLab, GitLab script, pipeline building, GitLab runner, Building Devops structure for different stages. • Experience with infrastructure monitor, service monitor, container monitor, centralized log management, app logging, container logging with different tools like ELK, Cloudwatch, Nagios, grafana etc. • Build deployable War/Ear files using Jenkins CI/CD Rich experience in Project/Scrum Team Management, Environment management and People/Vendor management, Asset Management. Understanding of Software Development Lifecycle (SDLC), Agile, and Waterfall. Proficient in Java IDE Tools such as NetBeans and IntelliJ IDEA. Knowledge of developing and updating webpages using HTML, Bootstrap, CSS, and Angular, for achieving cross-browser compatibility. Capable of developing and explaining concepts using Java/J2EE technologies Hibernate, Servlets, JSP, JSF, AJAX, JDBC, JSON, JavaBeans, JSTL, XML. Capable of Java libraries to access AWS facilities such as Amazon Simple Storage Service (Amazon S3) Simple queue, and Simple DB. I am available for further discussion. Regards

₹112,500 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@AltitudeInfotech

Hello, Greetings for the day! With over 15 years of experience in the information technology industry, we specialize in providing expert AWS cloud consultation services. At Altitude Infotech, we are AWS-certified Professional Solution Architects with extensive experience designing and implementing serverless and container applications using AWS Native services. Our team has handled projects of varying sizes and complexities, allowing us to provide live examples of where to use AWS services. We believe in clear communication and collaboration with our clients. Let us help you unlock the full potential of AWS services to grow your business. Connect with us today to discuss how we can help you achieve your goals. Thank you for considering Altitude Infotech.

₹122,500 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@rohitimentus62

Hi - I have 12 years or experience in industry working with ETL. Started with ETL projects which extracts the data from a file location using Perl scripts and load the data into SQL Server database and later on moved to SSIS. I have experience in working with Python, Spark-SQL, Azure, AWS, Snowflake and Airflow. I’m currently learning Flink for stream processing. I would be very happy to discuss data related work with you. Thanks and looking forward to work with you

₹112,500 INR ndani ya siku 7

0.0

(0 hakiki)

0.0

@uniwishtech01

Hi, Uniwish Technology is submitting a proposal for the AWS Data Engineer position. Our team of skilled and experienced data engineers possesses the necessary expertise in Python, SQL, AWS, Big Data Sales, and ETL to help you achieve your data engineering goals. We are experienced in implementing best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture, and have extensive experience working with AWS services such as Glue, Lambda, Appflow, DynamoDB, Athena, Step Function, S3, EC2, EMR, RDS, Redshift, and BigQuery. We have a proven track record of collaborating with stakeholders daily to discuss project progress and updates, monitoring and troubleshooting ETL pipelines to ensure smooth operation, and performing data validation and ensuring data accuracy and completeness. We are committed to delivering high-quality results within a timely and efficient manner. Please feel free to reach out to us if you have any questions or if you would like to discuss our qualifications further. Thanks, Consultant ( Uniwish Technology )

₹112,500 INR ndani ya siku 7