Python Developer Needed -- 4

Imebatilisha Ilichapishwa Miaka 2 iliyopita Kulipwa wakati wa kujifungua
Imebatilisha Kulipwa wakati wa kujifungua

I have a python tool that allows me to create mass landing pages from a spreadsheet.

I want to be able to create 200k+ pages from a spreadsheet with 200k+ rows within an hour or a few hours. And I want to be able repeat the process without slowing down the server or database. I have more than 1,000 spreadsheets and each has more than 200k rows in them.

However, it takes more than 24 hours to create 50k pages.

The problem is that once I upload a spreadsheet in the frontend of the tool, it takes about an hour to create the first 10k pages. After that, the next hour will be around 2k pages, next hour will be around 200 pages, and so on. I even tried a spreadsheet with just 6k rows, but that didn't work either. It took more than an hour to create the first 500 pages and the next hour was like 100 pages.

The tool is hosted on DigitalOcean using droplet. I've tried several droplet upgrades and even switched to using AWS RDS [login to view URL], nothing worked.

Python Mdhibiti wa Mtandao Software Architecture Usimamizi wa Uhifadhi Data

Kitambulisho cha Mradi: #30988757

Kuhusu mradi

4 mapendekezo Mradi wa mbali Ipo mtandaoni %project.latestActivity_relativeTime|badilisha%

4 wafanyakazi huru wanazabuni wastani wa $28 kwa kazi hii

freelancerelec

Hey there, I am interested in your project. Let's discuss more over chat. "I can start work right away" Thanks for looking forward to my proposal.

$30 USD kwa siku 1
(Maoni 10)
3.4