Find Jobs
Hire Freelancers

Need a scala spark job to read csv from S3 and load into cassandra

$30-250 USD

Imefungwa
Imechapishwa over 4 years ago

$30-250 USD

Kulipwa wakati wa kufikishwa
scala object main def should have 6 arguments as below. val awsAccessKeyId: String = args(0) val awsSecretAccessKey: String = args(1) val csvFilePath: String = args(2) val host: String = args(3) val username: String = args(4) val password: String = args(5) *based on the args, the job should read csv file from s3 and load into cassandra. *you can use any csv file say 2 fields, and cassandra table has 3 columns.. * need complete project codes, dependency jars, tools used and all versions etc.
Kitambulisho cha mradi: 20426564

Kuhusu mradi

17 mapendekezo
Mradi wa mbali
Inatumika 5 yrs ago

Unatafuta kupata pesa?

Faida za kutoa zabuni kwenye Freelancer

Weka bajeti yako na muda uliopangwa
Pata malipo kwa kazi yako
Eleza pendekezo lako
Ni bure kujiandikisha na kutoa zabuni kwa kazi
17 wafanyakazi huru wana zabuni kwa wastani $185 USD kwa kazi hii
Picha ya Mtumiaji
Hi i am a Data Scientist working in machine learning from past 3 years. i have done many projects like recommendation system, anomaly detection, fraud detection etc. i can do your task in Python very efficiently.
$140 USD ndani ya siku 7
5.0 (8 hakiki)
4.3
4.3
Picha ya Mtumiaji
Hi, I have more than 5+ years of experience in hadoop ecosystems like HDFS, MapReduce, Hive, Spark etc. I can complete your project. Please contact me for more details.
$200 USD ndani ya siku 2
4.8 (14 hakiki)
4.6
4.6
Picha ya Mtumiaji
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$277 USD ndani ya siku 3
5.0 (8 hakiki)
4.1
4.1
Picha ya Mtumiaji
Hi, I worked with same set before(Scala,s3 and cassandra) and can easily deliver solution within next day.
$200 USD ndani ya siku 2
5.0 (3 hakiki)
2.5
2.5
Picha ya Mtumiaji
Hi, I have over 5 years of experinece in scala java spark strom hdfs. I have written may live streaming and batch mode projects. I can complete this work in 5 days. Thanks Devesh Kumar
$120 USD ndani ya siku 7
5.0 (1 hakiki)
2.3
2.3
Picha ya Mtumiaji
Hi, I am a bigdata developer and a module lead in reputed MNC.i an into the IT industry for more then 12 years. I have tonnes of experience in developing projects using Java,Apache Spark,Hive,Kafka,Scoop,Pig,Scala,aws,jsp,html,css,jquery and managing cluster on aws cloud. I have my youtube channel to on AWS . I have delivered multiple projects and lectures on setting up apache Spark on AWS EMR... I can be the best suitable person for your requirements I have also created multiple freelance project on AWS EMR,S3,REKOGNITION, RDS, and many more services Let me know your view Regards,
$200 USD ndani ya siku 7
5.0 (1 hakiki)
1.6
1.6
Picha ya Mtumiaji
Hi, I am interested in this project. I've more than 5 yrs of experience in big data related tools and technologies. I've already implemented the spark scala related pipelines on aws for my company.
$180 USD ndani ya siku 7
5.0 (1 hakiki)
0.7
0.7
Picha ya Mtumiaji
"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on similar requirement in past. We have right skills to work on this assignment. . We will complete the work as per requirement Also my team working on same project" We have read out every thing about your project kindly confirm"
$140 USD ndani ya siku 7
0.0 (3 hakiki)
0.0
0.0
Picha ya Mtumiaji
Hi, I can help you in this project as I have good expertise in Spark jobs to read CSV and export data to NoSQL dbs. Thanks
$250 USD ndani ya siku 7
0.0 (0 hakiki)
1.0
1.0
Picha ya Mtumiaji
I have been working for more than 3 years in Hadoop/Big Data stack. It will be my pleasure if you give me an opportunity to work on your project. Please connect me for further details to start working on this.
$175 USD ndani ya siku 7
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
I have read your project requirements and i understood it clearly. I am Scala Spark developer with 3 year of experience. I have worked on lot of Machine learning and Data Sciences projects. Some of them are listed below. Implementation of island model for BAT algorithm in Scala and Spark Number Plate Recognition Fault Detection in a Network Credit card fraud detection Recommendation engine for courses If you award this project to me, I will provide you higher level of your satisfaction.
$200 USD ndani ya siku 7
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
I have been doing the data processing using the spark and Scala for last 4 yrs - so this is suiting me very much. Deliverable: Application code and packaged jar along with a tutorial about how to maintain the code in IntelliJ or other IDE of your choice. we can use public git to deliver the artifacts if you wish so Infrastructure: If you provide the Cassandra server and S3 I can make use of that. Else I can demo the code using my own Cassandra server and AWS Free Usage Tier's S3
$60 USD ndani ya siku 4
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
Hi It is straight forward requirement and would like to take up the project. Please reach out to me for further discussion. Thanks.
$261 USD ndani ya siku 15
0.0 (1 hakiki)
0.0
0.0
Picha ya Mtumiaji
I have more than 4 years of experience writing spark code with scala and python. I have also been working with AWS projects since 1 year. There are two ways to go about solving this problem: 1. Using spark dataframe's write function to write the data to Cassandra DB. 2. Using RDD to use the saveToCassandra method while passing in the schema.
$120 USD ndani ya siku 4
0.0 (0 hakiki)
0.0
0.0

Kuhusu mteja

Bedera ya UNITED STATES
United States
0.0
0
Mwanachama tangu Sep 26, 2015

Uthibitishaji wa Mteja

Asante! Tumekutumia kiungo cha kudai mkopo wako bila malipo kwa barua pepe.
Hitilafu fulani imetokea wakati wa kutuma barua pepe yako. Tafadhali jaribu tena.
Watumiaji Waliosajiliwa Jumla ya Kazi Zilizochapishwa
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Onyesho la kukagua linapakia
Ruhusa imetolewa kwa Uwekaji wa Kijiografia.
Muda wako wa kuingia umeisha na umetoka nje. Tafadhali ingia tena.