Hadoop Jobs

The project consists of migrating from a PostgreSQL database into a NoSQL database. We're looking for a NoSQL expert (MongoDB, Cassandra, CouchDB, etc) who can help us to determine the project's viability, time and cost estimates. The main goals for this project are: - Stability - Scalability - Reasonable complexity The goal is to identify which technology suits our technical needs better and study its cost. Please include in your answer details about the approach you would follow to study the viability of this project and any relevant question you have. To make sure you read the post, please include the result of this operation in your answer: 2*21=? Thanks.

Roles And Responsibilities: Hadoop development and implementation. Loading from disparate data sets. Pre-processing using Hive and Pig. Designing, building, installing, configuring and supporting Hadoop. Translate complex functional and technical requirements into detailed design. Perform analysis of vast data stores and uncover insights. Maintain security and data privacy. Create scalable and high-performance web services for data tracking. High-speed querying. Managing and deploying HBase. Being a part of a POC effort to help build new Hadoop clusters. Test prototypes and oversee handover to operational teams. Propose best practices/standards. Skills Required: Good knowledge in back-end programming, specifically java, JS, Node.js and OOAD Good knowledge of database structures, theori...

I am looking someone who has good experience in Python, spark, shell scripting , Hadoop, hive , sql, git, sqoop, oracle to develop the data pipeline. Also, any cloud experience- GCP/AWS

Looking for a two resources for my project. One is a java person another is Kafka person. This is a full time support job. Looking for someone that can work long term. Please be sure to work on Eastern time. Please don't waste my time and your time. Here are the following skill sets which i am looking for. Kafka developer Skills; -Java -Kafka -SQL -Postman Senior Java Developer -Java with spring boot -Hadoop -Hive

Expert level knowledge in AWS services like EMR, S3. Extensive experience in python, pyspark, Hadoop, hue, presto, bash shell script Expert in Apache airflow, creating and troubleshooting DAGs Good troubleshooting skills Good experience with Talend Experience with Vertica

Hello, My requirement is described below 1) Read two flat files(.dat files with ^ delimiter) on Hadoop Edge Node into Spark data frames 2) Drop unwanted columns from those data frames 3) Generate a md5 hash key for each record in the data frames after dropping columns 4) Join two data frames on hash key and identify mismatched records and write those records to a file on Hadoop Edge node 5) This code should be in Java and Apache Spark

It is a project for Big Data, using AWS, MySql, NoSql, Hadoop, Cloud storage, Cloud database and social media analytics tools. Includes writing research and reports. Thank you