Find Jobs
Hire Freelancers

Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL

₹37500-75000 INR

Imefungwa
Imechapishwa over 5 years ago

₹37500-75000 INR

Kulipwa wakati wa kufikishwa
We are a startup focussing on blockchain products. One of our project details are as below for which we are looking for a team of freelancers with various skill set who can together build the product. Phase 1 (Duration: 7 days): IT solution to collect, load and process data from various websites. Data will be available : 1. Standard APIs of those websites (json format) 2. Websites crawls (by Automation to collect tabular data) Need to build batch automated processes to collect these data and load in Postgresql/MS-SQL on defined interval of time. This would require setting of PostgresqlMS-SQL server on Ubuntu latest version and further processing to consolidate collected data in desired tables' format. Which requires processing via stored procedures. Parameters, like, frequency of batch run and hyperlink of the API/Website to crawl should be read from a database table. Solution should be generalised, such that, similar pattern websites are read similarly. Ex: 1. Standard APIs (samples): [login to view URL] [login to view URL] [login to view URL] 2. Websites Data Crawl (samples): [login to view URL] [login to view URL] [login to view URL] Once data is collected directly from these websites, it needs to be processed and collated in target summary tables based upon few business logics. Phase 2 (duration: 4 weeks) & 3 (duration: 3 weeks): To be discussed once approaching finish of phase 1. Skills needed for phase 1: JSON processing, API processing, Automation to crawl websites and collect data, Postgresql/MS-SQL scripting, database knowledge etc.
Kitambulisho cha mradi: 17387188

Kuhusu mradi

11 mapendekezo
Mradi wa mbali
Inatumika 6 yrs ago

Unatafuta kupata pesa?

Faida za kutoa zabuni kwenye Freelancer

Weka bajeti yako na muda uliopangwa
Pata malipo kwa kazi yako
Eleza pendekezo lako
Ni bure kujiandikisha na kutoa zabuni kwa kazi
11 wafanyakazi huru wana zabuni kwa wastani ₹69,924 INR kwa kazi hii
Picha ya Mtumiaji
Dear ukrblockchains, I have experience with these skills. I do have similar experience doing something similar to yours "Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL" therefore I am looking forward to discuss and move ahead. Relevant Skills and Experience I have 10+ years of experience in API, JSON, Microsoft SQL Server, Selenium Webdriver, Website Design I can do this within your budget too ₹37500 - ₹75000 INR please check more from here https://www.freelancer.com/u/mmadi.html?page=portfolio I am ready to work with you,kindly waiting for your response. Thanks & Regards, Mmadi
₹52,500 INR ndani ya siku 24
5.0 (16 hakiki)
6.3
6.3
Picha ya Mtumiaji
Looking for Mobile App Solutions, we've got you covered. Contact us today, our developers are eager to solve your problems.. We specialize in Hybrid and Native Mobile Apps. Our prices are affordable. Contact us today.
₹62,500 INR ndani ya siku 20
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
I can do your job.
₹66,666 INR ndani ya siku 20
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
Hello! This appears to be similar to work I did to build data marts hence loading data and writing stored procedures is not an issue
₹62,500 INR ndani ya siku 20
0.0 (0 hakiki)
0.0
0.0
Picha ya Mtumiaji
Hi, I have work experience related to Web Crawling, Data Extraction. Currently Working as Data Science. Have knowledge of Postgress, Distributed System.
₹62,500 INR ndani ya siku 24
0.0 (0 hakiki)
0.0
0.0

Kuhusu mteja

Bedera ya INDIA
India
0.0
0
Mwanachama tangu Jul 18, 2018

Uthibitishaji wa Mteja

Asante! Tumekutumia kiungo cha kudai mkopo wako bila malipo kwa barua pepe.
Hitilafu fulani imetokea wakati wa kutuma barua pepe yako. Tafadhali jaribu tena.
Watumiaji Waliosajiliwa Jumla ya Kazi Zilizochapishwa
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Onyesho la kukagua linapakia
Ruhusa imetolewa kwa Uwekaji wa Kijiografia.
Muda wako wa kuingia umeisha na umetoka nje. Tafadhali ingia tena.