Parsing of 5GB dump of clean data (estimated 1 day of work)

Imefungwa Ilichapishwa Dec 17, 2015 Kulipwa wakati wa kujifungua
Imefungwa Kulipwa wakati wa kujifungua

1. I have a 5GB dump of crawled data that needs to be parsed.

2. It's contact data: name, workplace, phone number, fax, etc etc.. 250k contacts in total.

3. The data is very clean, all from ONE source, but it is pretty complex.

4. Each contact has many attributes, like 1 workplace, n skills, n references to other contacts in the database (colleagues, co-workers in the same workplace, co-worker in the same department etc.)

I need this data parsed. It is currently dumped into MongoDB and we have already written a shell script parsing much of the contact information, but not all. If you want you can continue with this script, or you can start over and create your own.

This should not take longer than a day of work if you know what you are doing.

This is a fair estimate from a developler who has crawled it and started parsing, but now doesn't have the time to complete the job.

There is no rush, so you can work on this over the next 3 weeks.

NoSQL Couch & Mongo Perl PHP Skripti ya Shell SQL

Kitambulisho cha Mradi: #9141316

Kuhusu mradi

38 mapendekezo Mradi wa mbali Ipo mtandaoni %project.latestActivity_relativeTime|badilisha%

38 wafanyakazi huru wanazabuni wastani wa $238 kwa kazi hii

gangabass

I'm expert in data parsing / processing with many years of experience that's why I'm sure you'll be impressed with my work. I can process all of your information fast and I can offer you best price here. Please show Zaidi

$166 USD kwa siku 2
(Maoni 708)
8.0
srinichal

I am an expert in delivering customized scripts and look forward to discuss further about the project needs.

$315 USD kwa siku 3
(Maoni 152)
7.5
freelance4hire80

hi, please attach sample crawled data and list out all the fields to parse out I can write a Perl script to extract the crawled data into MySQL database/CSV file

$388 USD kwa siku 14
(Maoni 68)
6.9
amcorreia

Have a sample of input data? And what is the output you need? .

$444 USD kwa siku 21
(Maoni 72)
6.0
ngay

Hello Sir. I have read your requirement totally. Yes, i have worked on this type of work. Lets see my website http://wwhotnews.com. Im parsing data from target page. getting titles, articles, images, except. Please che Zaidi

$200 USD kwa siku 7
(Maoni 61)
5.8
kostiapl

A proposal has not yet been provided

$110 USD kwa siku 10
(Maoni 43)
5.1
khannanav

We have a team of UNIX experts with more than 10 years of rich industry experience & would be more than happy to work on the project. We have written our own crawler in JAVA and would be the best fit for the projec Zaidi

$309 USD kwa siku 3
(Maoni 12)
5.5
amitnindroda

-> I am Interested and would love to work on your project. -> I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. -> I am 4+ years experienced Web Develo Zaidi

$444 USD kwa siku 3
(Maoni 42)
5.1
privatecaptain

Hey i have a couple of questions can we talk?

$444 USD kwa siku 3
(Maoni 20)
5.4
Beacon09

A proposal has not yet been provided

$260 USD kwa siku 21
(Maoni 28)
4.8
cugamelover

I'm a computer science professional with a PhD degree and I have extensive experience in databases, Perl, PHP, and several other programming languages. Please see reviews on my profile. It would be my pleasure to do th Zaidi

$120 USD kwa siku 5
(Maoni 22)
5.1
zkutch

Hello More 20 years programming experience. I would like suggest perl for parsing, or, if productivity is important, then pure C, but I need more details to set real price and time. Regards. ----------------------- Zaidi

$100 USD kwa siku 5
(Maoni 37)
5.4
ashupathania

I have exoperienced in creating sql queries,Dynamic sql queries,SSIS Packages and ,Store procedures and SSRSreports

$222 USD kwa siku 3
(Maoni 23)
4.8
ilirjant

Hi, if possible that you export you data to a csv or text file it will be more easy to parse the data correctly. I will download the file and parse the data using perl scripts. Best regards, Ilirjan

$166 USD kwa siku 5
(Maoni 16)
4.5
ilmarsparols

Years of experience in telecom. As a QA specialist one of my tasks was data verification, this included regular data dump parsing, etc.

$388 USD kwa siku 3
(Maoni 9)
4.4
ebin123456

Hi i have worked with many big files in low memory. i am al so experienced in map reduce in mongodb and counchdb. so this will be a easy task for me. i am ready to start work now. you need to pay only if you 100% sati Zaidi

$100 USD kwa siku 3
(Maoni 12)
4.2
cracken

Hi, I, based on my 5 years experience as a software engineer knowledgeable with unix and linux administration expert on commandline application, can handle this task pretty well. Let me know the best of your time so w Zaidi

$100 USD kwa siku 0
(Maoni 12)
4.4
prithvi2223

Hi, I can do this with simple regex -> output to text file -> shell script to db import Regards, Prithvi

$222 USD kwa siku 1
(Maoni 1)
3.6
MrTux

A proposal has not yet been provided

$277 USD kwa siku 3
(Maoni 2)
2.7
sinogermany

Hallo! Das kann ich ja sicherlich machen :) I've been working with MongoDB since 3 years ago and I have lots of experiences with stream based data migration, i.e. migrating millions of rows of data from one data source Zaidi

$100 USD kwa siku 2
(Maoni 5)
1.9