Web Scraping Jobs

I will not respond to generic responses. I have a Wordpress website that I need information added to. I also want all the information moved into a new shopify website as well. I have a scrape with information and part numbers that will cross over to some of my existing listings. I need all this information added to my Wordpress website and then the left over listings from the scrape also added to my Wordpress and shopify websites without a price. I also need some minor adjustments made to the descriptions on the Wordpress website for seo purposes. I currently have approximately 3000 lines on my Wordpress site and the scrape has 20000 lines.

I'm seeking a detail-oriented professional to manually transfer valuable data from Internet sources to an Excel spreadsheet. The ideal candidate for this job should have: - Proven experience in data entry and Excel - Excellent attention to detail and accuracy - Flexibility in terms of formatting as you will have to determine the most effective and efficient structure for the data The challenge of this task lies in manually extracting data from the web, an eye for detail is, therefore, paramount. Your responsibility is to ensure all the data is correctly entered and organized in a clear and comprehensible manner. Your creativity and critical thinking are appreciated when deciding the layout and formatting of the data on Excel.

Looking for a skilled individual to undertake data scraping project. Key tasks will involve: - Focused on scraping 'Website 1' - Specific data requirement is 'price' - Data collection should be conducted periodically Ideal freelancers should be proficient in PHP, and have a track record in successful and ethical data scraping projects. Advise on suitable scraping schedule is appreciated. Efficiency and meticulous attention to detail are highly sought.

I need an expert in data capturing to mine specific information from websites and organize it efficiently into spreadsheets. The ideal candidate should be meticulous and comfortable with the following: - Data Capturing: The primary task involves extracting and compiling data from various websites. - Web Research: Ability to navigate and find required data efficiently. - Spreadsheet Proficiency: Experience with spreadsheets and data organization. Please bid if you have a strong eye for detail and a proven track record in data entry and web research.

We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Selenium, etc. Solid knowledge of HTML, CSS, and...

I require a professional with a high level of expertise in web scraping and API integration to assist with a critical project. Here are the specifics of the project: - I need you to scrape data from , a website where we dropship our designer clothing products. - Specifically, I need the following details scraped: Product names, Product Colour, Product Sizes In Stock & Not in Stock, Product Prices (Only Black & Grey Pricing, not red sale price), and Search Key. - The scraped data should be automatically updated on a daily basis. - The scrapped data should be integrated into our Shopify store through an API bot. The ideal candidate should have a proven track record of working with similar projects and should be able to tailor the solution to our specific needs. Please include in...

I need a python scraper that can copy ads from one classified ads website and post it to other website

I need to find a good supplier that can get me all of the buyers and planers from all customers in Asia, Africa, Europe, North America, Central America, South America, Australia. i am in the aircraft industry.

I need assistance in compiling a large, extensive database of more than 5,000 working professionals earning a salary under 3 lakhs per annum. The data profile will include: - Name and contact details - Education and qualifications - Current job title and company Interestingly, these professionals should spread across various industry sectors such as Technology and IT, Healthcare and Medicine, as well as Marketing and Advertising. Particular skills and experience that would set freelancers apart for this job include: - Proven experience in data mining and data scraping - Familiarity with the mentioned industry sectors - Ability to accurately cross-reference and verify data - Excellent attention to detail Freelancers with extensive experience in maintaining data integrity and confiden...

I'm on the lookout for a skilled freelancer who can expertly scrape old leads from multiple sources. These sources include social media platforms, business directories, and various websites. Unfortunately, the purpose of this project hasn't been specified, but the successful freelancer must be capable of performing high-quality data scrapings, potentially for lead generation, market research, or data analysis. As a dedicated data professional, you should have a strong background in web scraping, data extraction, and data analysis. Please be sure to include in your application: - Your previous experience and samples of past work - A detailed project proposal outlining your approach. Your proficiency in using software and tools for data scraping, knowledge of data protection laws...

I'm looking for an experienced data scraper. I need someone with excellent knowledge and expertise in web scraping. I will need the following with regards to mid sized collectible stores around the world: Company Name City Country URL Contact person Email address. Ongoing work for the right candidate/s

PLEASE CHECK THE DESCRIPTION BEFORE SUBMITTING A BID Let's skip a boring description generated by AI. Actually, we are looking for a hero who helps us get all things about gambling in Spain, especially iGaming. We are not interested in bettings side of this market, only online casino games are in focus and all things around it, including main operators, target audience, regulative organisations, etc. Please don't use a complicated diagrams with numbers and dry copy paste, cause we have already done it on our side :) As result of this project we are waiting for simple and well structured document no matter pdf, page in Notion or Google docs. That will be a starting point to do things. We are going to understand how people spin in Spain and who is in charge of it. We are not gonn...

Generic replied will be rejected. You must have experience in Radix, Scraping Data and be able to create a script that will import directly into woocommerce. We need an experienced radix developer to perform data scraping tasks for our client. The fundamental requirements include: - Scraping data from a suppliers website - Data to be scraped includes textual content , pricing and metadata - Skilled in managing and maintaining the scraped data's quality and relevance This data then needs to be imported into a woocommerce site as a variable product. The ideal candidate should have: - Expertise in working with WooCommerce platform - Proficiency in radix software - Experience in data scraping and storing large volumes of data The scraped data should be imported to my WooCommerce s...

I need a Python expert to create a robust parser for extracting data from large JSON files, each exceeding 10 MB. Key Requirements: - Comprehensive knowledge of Python - Strong grasp of JSON data structures - Experience in handling and processing large data files - Familiarity with data extraction techniques The parser should be highly efficient and capable of managing substantial JSON files seamlessly, without compromising on the speed of execution. I value your expert advice on the most suitable Python libraries to use for optimal results.

Project Budget: $125 Project Level: Standard Project Overview: Simple Python script with a HTML front end to allow a user to upload a CSV list of “prompts” and have each one sent as a request to the OpenAI API. There will be multiple prompts on each row. The script will need to move through each column, retrieve the output from OpenAI API, before moving onto the next row. The script should insert the result/text output from each column/prompt/request into a prompt output column of the CSV, then over onto the next row & then automatically download the updated CSV file for the user. Technical Requirements - Server Type: Ubuntu 22.04 - Script Type: Python - Front End Type: HTML - Front End Functionality: - Input API Key into a text field - Upload CSV File - CSV file temp...

I'm quietly on the hunt for a skilled professional to design an Instagram bot that can perform a series of tasks on my behalf. The main functionalities I'm interested in include: - Auto-liking posts - Auto-following users - Auto-commenting on posts I'm not in search of basic or hyper-detailed, but I'm aiming for moderate customization. While I don't want a merely plug-and-play tool, I do want one which allows me to adjust some settings to suit my preferences. The bot should focus its engagement on two types of accounts: - The ones I manually specify - Accounts within particular niches I'm interested in Having knowledge in Instagram bot programming, web scraping and understanding of Instagram API will play a vital role in this project. A sense of culture a...

I'm seeking a professional who can develop a web scraping tool with the following specifications: - The tool should be able to scrape text content from a specific website. - It will need to log in to the website in order to access the data. - The data should be extracted in real-time, meaning that the scraping should be continuous and up-to-date. Ideal candidates should have: - Proficiency in web scraping tools and techniques - Experience in developing real-time data extraction tools - Familiarity with log-in processes in web scrapers - Ability to work efficiently and deliver on time If you have the skills and experience required for this project, please get in touch. Thank you.

write a headless chrome python script which will visit given list of URLs/websites aftear each config delay in seconds. script will use different ip in each iteration of list urls visit. it will keep running untill ip list end .

Hello, I need a complete professional in scrap, java, python flask, composer. more details in private

I am in need of an individual with strong data collection skills, particularly in the area of web scraping. The job entails extracting text data from a certain selection of websites for me. My key focus is the content of various articles present on these sites. Ideal candidates should: - Have experience in web scraping for article content - Be meticulous in collecting data to ensure no valuable information is missed - Have a strong attention to detail to maintain the quality of collected data - Be capable of maintaining the confidentiality and integrity of the information collected To jumpstart, please provide your experience with similar projects and your available start date.

I am in search of a skilled Python developer to deliver a solution capable of scraping specific data from websites like and Makemytrip. The chief aim is to collate the room type and rates, along with rates applicable for specific dates. Ideal Skills and Experience: - Extensive Python programming skills, particularly in web scraping - Prior experience with data extraction from travel or hotel booking websites - Familiarity with various data extraction techniques and handling dynamic web content Your role will involve programming a robust and efficient scraper that can collect and deliver the desired data in a structured format. Familiarity with and adherence to legal and ethical aspects of data scraping is necessary. Efficiency in output delivery and importantly, minimal error in scra...

This project is open only to individuals. Agencies need not apply. Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to...

I'm in need of an experienced email marketing and web scraping professional to help me generate quality leads through email campaigns. - The primary goal of this project is to generate leads for my business. - The ideal candidate should have a track record of successful lead generation through email campaigns. - Additionally, I need someone who can scrape the web to find relevant email addresses of potential leads. You must have Good English and most importantly manage the whole process from start to finish outside of us reply to leads generated. This will mean you need to be able to scrape websites in Ireland like directories/maps etc and Linkedln. Generate marketing lists of each niche and setup emails to contact relevant niche. You must have or recommend bulk sending platform...

I need a proficient data miner to help me extract student leads from the following websites - , college , , , mbauniverse.com. Key Information to Extract: - Student contact numbers As I require this data urgently, a prompt turnaround time is essential. Freelancers should possess the following skills and experience: - Expertise in web scraping - Familiarity with the aforementioned websites - Can deliver a high level of accuracy - Can ensure data is categorized correctly. Applications from freelancers who can demonstrate past experience in similar projects will be looked upon favorably. Immediate availability is preferred due to the urgent nature of this project.

I am looking for a proficient freelancer with a strong background in data scraping from LinkedIn, various social media platforms, and websites. The objective of this project involves harvesting old leads interested in job-oriented training courses in areas such as programming, digital marketing, business, and finance. The skillset and experience required include: - Excellent knowledge of data scraping techniques - Familiarity with LinkedIn, and other social media platforms for data extraction - A good understanding of programming courses, digital marketing, business, and finance topics The targeted audience for these training courses are students, working professionals, and entrepreneurs. I am expecting high-quality leads, so experience in targeted scraping is a must. To be successful in...

I need a skilled python developer to create a JSON to Excel converter. Key Requirements: - You'll be working with Flat JSON data - How to handle missing data is up to you - Mapping of JSON fields to Excel columns is flexible Ideal Skills: - Proficient in Python - Experience with JSON parsing - Excel manipulation skills I'm open to suggestions on the best way to map the data, so please include your ideas in your bid. Let me know if you have any questions.

I am looking to create a sports news aggregation website. The website will be primarily focused on sports news and will be used as the basis for a radio broadcast. Key Features: - The primary function of this site is to aggregate sports news from a range of different sources. These sources may include major sports news websites, blogs, newspapers and more. This content will form the basis of our daily radio show. - The site should also have a feature where the latest sports news can be read out loud. This is a key feature as the site will be used for our radio broadcasts. - The website should include a section that is dedicated to sports video highlights. This section will be a key engagement tool for our audience. Ideal Skills and Experience: - Experience in creating news aggregation we...

Hi, The task is to scrape a pdf that is downloaded on website. Steps: 1. Go to website 2. Enter code in search and click search. (We provide list code) 3. On the results page Click on pdf document and open or download it 4. Extract 14 pieces of data from the PDF and export into excel sheet. There are about 150.000. Some codes do not have any data then skip. I have attached a word document with pictures and flow for you to review. Thanks!

I'm looking for a skilled developer to build me a web scraper for the Kumon UK website. The scraping needs to be able to: - Extract the names of tutors - Retrieve their addresses - Fetch contact information like phone numbers or email addresses The scraping process should be set to run just once, and must be accurate and reliable. The data should be presented in a structured format, ideally a XLSX file. Please provide an overview of your experience with web scraping and any similar projects you've worked on.

Hey everyone, i search someone who can do a task for my existing Wordpress Website. Actually i scrap every morning the data from soccer results from a website with WINHTTRACK and upload this to my website. Now i need automation. - Data Scraping from other website to my website - Data Refresh every Day 7 o'clock - 1:1 Copy with Design and my login - Only 3 Site ! I provide wordpress test access. On This access u can build a scraping automation. I can migrate myself. THANKS :)

I am seeking a skilled freelancer to aid me with the data entry of image data. The primary purpose of this task is to create a digital archive of the images provided in the form of digital photos. Key Responsibilities: - Accurately enter image data into a digital archive - Ensure high attention to detail to maintain data integrity - Meet deadlines without compromising quality Ideal Skills and Experience: - Proven experience in data entry, particularly with image data - Proficiency in utilizing data entry software and tools - Strong attention to detail to ensure data accuracy - Ability to work independently and meet deadlines The successful candidate will play a crucial role in the creation of this digital archive and will have the opportunity to contribute to a meaningful project.

Provide old leads interested in doing online courses, Scrap data from LinkedIn or any social media or any educational websites, but interested in doing Job oriented courses

I'm looking for a tool or app to scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong understanding of car rental market dynamics is a plus.

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intelligent data mining and competitive market analyses.

I am seeking an experienced programmer to automate the transfer of TikTok users' video data into a Google Spreadsheet immediately upon posting a new video. Key Focus Areas: - Integration: The automation has to be seamless, with video data transferred automatically into the spreadsheet after a new video is posted by the user. - Data Extraction: The data to be fetched includes: Username, Likes, Views, Date Posted, Total videos to date and whether the weekly goal has been met. - Visualization: Data should be visually represented with Bar Graphs. Ideal Candidate: - Should have experience with automation software. - Should have proficiency in coding, preferably with a background in data extraction. - Should have good understanding of TikTok's API. - Should have experience in workin...

I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical for this role.

This project is open only to individuals. Agencies need not apply. Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to...

I am in need of a skilled Python expert to transform a raw excel report into a final template version of excel. The project requires two main tasks: Formatting and re-arranging of columns along with calculation updates for one column. Key Points; - Need 3 open reports to pull the information and split the reports at the end. - Formatting Changes: The report needs specific columns to have pre-defined blank values for certain columns: Col B, E, J, R, W, AB, AE, AJ, AV, BG, BI, BJ, BQ, BU, BV, BW, BX, BY, BZ. - Calculation Updates: The calculation layer within the excel report needs to be updated and finalized. The ideal freelancer for this project should have a profound understanding of Python and extensive experience in manipulating and formatting excel reports. I am looking for someone ...

I require a serious freelancer who can reach out to aged leads who might be interested in online courses. Although I skipped the question on target age group, expertise in reaching a variety of age groups would be beneficial. Ideal Skills: * Understanding of the online courses market * Experience in lead generation * Proficient in communication and persuasion Application Requirements: While I purposely skipped the question about what successful freelancers should include in their application, it would be preferable if you provide: * Past work related to lead generation * Your experience in the field * A detailed project proposal on how you plan to execute the task Preferred Contact Method: Even though I've skipped the question on preferred contact methods, having proficiency in: ...

This script must be developed in Python 3 or higher and must take a PNG image as input and return 4 letters. It is desired to achieve 95 percent accuracy or higher (out of a total of 200 test images), not use paid libraries, and be efficient (less than 3 seconds processing time per image). Hardware where it will be tested: Architecture: x86_64 CPU operation mode(s): 32-bit, 64-bit CPU(s): 8 Memory: 15877 The images can be extracted from the following site (captcha image):

I need an Excel 365 PowerQuery script that can fetch daily market data and handle potential data source interruptions or changes. I will be providing a URL that contains the market data, and you'll need to replicate the Google Sheets function =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). This function provides real-time data from the specified URL. Please note that the data is structured using HTML tags. Key requirements: - The PowerQuery should be able to be refreshed with the google sheet. - It needs to include robust error handling. If the data source is unavailable or the structure changes, the PowerQuery should not break but continue to function, ideally providing a notification that an error occurred. Ideal sk...

I'm seeking a skilled Python freelancer to assist me with a specific automation project. The task involves training video frames for bee detection. Key Tasks: - Train video frames for bee detection: I have a series of video frames that I need to analyze for bee presence. You'll be responsible for training the Python code to recognize bees within these frames efficiently. Goal: The primary objective of this automation task is to enable the Python script to accurately recognize bees within the video frames. The end goal is to achieve optimal object recognition. Ideal Candidate: - Proficient in Python programming - Experience in object recognition - Familiar with training video frames - Background in automation and data analysis If you have the necessary skills and experience i...

I'm currently seeking an adept Python developer capable of crafting a bot designed to circumvent the Cloudflare protection of a specific website (details will be disclosed privately to the chosen freelancer). The bot should reliably bypass the protection consistently, as my attempts have yielded varied results, occasionally succeeding but often encountering 'Failure!' from Cloudflare. Efficiency in handling a large volume of attempts is crucial. If you possess the necessary skills and are up for the challenge, please get in touch. Ideal Candidate: - Proficient in Python, with experience in bot development - Familiar with CloudFlare's security measures and how to bypass them - Experienced in automated testing and website monitoring - Strong problem-solving skills to tac...

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.

It is an anime website in WordPress and I need to take the information from other anime websites and have it automatically posted on

As a provider of job-oriented online training, I'm seeking skilled professionals to help provide old leads looking to do Job oriented programs - IT courses - Data Science & Data Analytics - Law courses - Digital marketing courses - Online MBA courses - Many more

I need a script that can bypass security measures on my website which uses Cloudflare. This is not for any malicious intent, but for testing and troubleshooting purposes. Key Points: - The script should be specifically designed for websites - The main purpose is to bypass Cloudflare security measures - I didn't specify the customization level, as I'm open to options that might suit my needs better Ideal Skills: - Familiarity with Cloudflare security measures and how to bypass them - Ability to create a script that can seamlessly integrate with any website - Experience working with security testing tools or scripts Please provide a proposal that outlines your experience in this area and how you plan to approach this particular project.

I am in need of expert help to scrape text data from specified websites. After the data has been collected, the next step is to clean the data, ensuring that it is in the appropriate format for use. The final output should be managed and stored in a Database Management System. The ideal freelancer for this project should have: - Proven experience in web scraping, specifically text data from websites - Advanced skills in data cleaning to ensure the data is usable and well-structured - Capabilities to manage and store the cleaned data into a Database Management System Please provide any relevant examples of previous work in web scraping and data cleaning and provide details about how you plan to carry out this project.

I need a web scraping expert to help me get data from a third-party search site. The project is urgent and needs to be completed ASAP. Key Requirements: - Skilled in web scraping techniques - Proficient with tools for scraping - Able to work under tight deadlines - Excellent communication skills Please note that the specific search site is not mentioned, but the task involves scraping information from it. If you have the experience and can work quickly, please reach out.

I need an expert to set up an automation system in Google Sheets for specific data from the NSE India website. Key Requirements: - Data Source: The data source will be '' - Data to be Integrated: Only the column titled '%CHNG IN OI' should be extracted. - Update Frequency: The automation should update the Google Sheets column once every day. - Data Display Format: The data in the Google Sheets should be displayed in percentage values. - Historical Data: No historical data tracking is required. The focus is solely on current updates from the source website. Ideal Skills: - Proficiency in Google Sheets and automation tools. - Experience with web scraping and data extraction. - Knowledge of data presentation and formatting in Google Sheets. - Ability to create a seamles...