Hadoop Jobs

I'm working on a Hadoop / Native (Distributed File System vs Native File System) comparison / benchmarking project. There are a few conjugates of scripts to be made such as creating copy, paste, duplicate, move, delete mass files on both file systems; simulate a video broadcast environment (both client and server side, not a detailed thing). Those should be able to run with more than one inst...

Hello, I am looking for an Hadoop and devops expert who worked on Java,Map-reduce,Spark streaming,kafka,HBase with devops tools like jenkins and cloud technology AWS. I need someone who can explain 5 real time projects with some documentation and code.

Hi All, I am looking out for Azure DevOps expert who can write automation to perform ETL on data. The pipeline should be able to take data from different sources and perform data cleaning and loading actions which generally Data Engineers perform. You are free to use any Azure services to make it best. Preferred automation language Python but not restricted to it.

I would need training/assistance in Big Data queries

I'm working on a Hadoop / Native (Distributed File System vs Native File System) comparison / benchmarking project. There are a few conjugates of scripts to be made such as creating copy, paste, duplicate, move, delete mass files on both file systems; simulate a video broadcast environment (both client and server side, not a detailed thing). Those should be able to run with more than one inst...

I would like to be trained on Streamsets Timeframe- 1 to 2 months

Details will be shared with winning bidder. please bid if you have the experience only.

We offer online courses on a variety of IT topics like Big Data, Data Science/ Machine Learning, Cyber Security, Blockchain, Language Processing etc. We're currently hiring Teaching Assistants for our next courses. Immediate Work (start this week): We have immediate needs for several people, and will have ongoing work for those who want to continue with us: We are looking for at least 30-4...

Need a application that can read all avro messages in Kafka Topics

1. Develop/Propose various ETL pipelines for the combination of hadoop eco-system with/NOT spark using AWS cluster; 2. Implement the multi-purpose ELT pipeline (like kappa or lambda architecture) that ingress data from various sources (NOT limited to mySQL, Oracle, NoSQL, Flat files like PDF, Excel, CSV, .docx, Live/streaming) to hadoop/hdfs by using wide range of bigdata tools; 3. Ensure the data...

Need to create server part and client part for a web service like Uber, but Uber for goods delivery. Description: There is a big city, several routes depart from the big city in different directions. There are a lot of small towns along the track where people often order goods from the big city. In the big city, on the outskirts there are special stocks in the directions of each track. People ca...

i need someone to create 1 test case for selenium for a url and sending some keys with loop, once we talk i can show and explain what i mean

I need to transfer the large amount of data from HDFS to AWS and want a support for the same..

Big data developer Project is a business intelligence type of solution dealing with data from different sources: logs, site visitors, CRM lists or purchase history data, etc. An EMR based solution is used to analyze and develop person-based marketing campaigns that can be deployed to any of the media platforms. Tech stack: AWS: S3, EC2, Elastic Beanstalk, Aurora RDS, EMR DB: MySQL (using Aurora D...

Project Description The project is about capturing the data generated by a device in a realtime and processing the data to derive some device metrics like device status and peripheral count. The project defines a part of real time requirement from the client on capturing and processing telemetry data from devices The data should be captured using the push model from 'REST' services by a ...

Need a guy who is pro in both Cloudera, Horton works and AWS to help in proxy