Python scrapy web scrapingKazi
explain me perl and python codes advanced skills needed
Zdravei Radoslav, Tursq si web developer na Python sus slednite sposobnosti: *Legacy Django (<1.2) project needing brushing up to 1.4/1.5. Deep knowledge of Django/Python best practices. Skills: - Python (4 years) - Django (2 years) - SQL & Django-South (2 years) Dobro zaplashtane. Svurji se ako si zainteresovan. Inna Amesheva
Radimo na ravoju Booking Engine-a za avio kompanije. Potrebna nam je pomoc da bi smo dovrsili projekat.
I'm seeking the expertise of a seasoned developer to create a customized chat functionality for a project I'm...will be a significant advantage. - Media Sharing: The chat interface should be modern and dynamic, capable of handling in-message media sharing. This means users should be able to share images, videos, and other rich media content within the chat conversation seamlessly. If you've designed such interfaces before, you're the person I'm looking for! Skills such as Java, Python, or PHP are desirable. Exceptional knowledge of web sockets is a must for real-time chat functionalities. An understanding of user experience is also essential, as the platform must be user-friendly. I'm open to suggestions on how to make this project a success, ...
I need a skilled developer to help me collect data from various websites to find a competitive edge. Key Requirements: - Prior experience in web data scraping - Ability to scrape data in real-time to ensure the information is up-to-date - Understanding of data analysis and how to interpret the results - Familiarity with competitive research The data collected will be used to inform my business strategies, so it's crucial that it is collected accurately and efficiently. Although not the immediate priority, I'm also interested in exploring the possibility of creating a discord bot and potentially web design in the future. A developer with experience in these areas would be preferred, though not essential. The developer must be located in Australia ideally...
VeriCO2 is looking for a talented developer to assist in populating our global scope 1, 2, and 3 emissions database through web scraping and data moderation. The selected developer will be responsible for scraping emissions data from global listed companies, implementing a moderation system, and enhancing our current offering by providing a database of published emissions data for ASX companies. Responsibilities: 1. Web Scraping - Web scrape scope 1, 2, and 3 data points from global listed companies to populate the VeriCO2 emissions database initially. - Develop scripts or tools to automate the web scraping process and ensure efficient data collection. 2. Data Moderation - Implement a moderation check to review and update data point...
...free database. 3. User Interface and Login - Create a user interface and login system on the webpage for users to access and contribute to the database. - Implement email verification and annual update requirements for users. Requirements: - Strong experience with database design and management. - Proficiency in web development languages such as HTML, CSS, and JavaScript. - Experience with server-side programming languages such as Python, PHP, or Node.js. - Knowledge of data security best practices and user authentication methods. - Ability to create user-friendly interfaces and intuitive user experiences. - Strong problem-solving and debugging skills. - Excellent communication and collaboration abilities. Deliverables: - A fully functional and secure g...
I'm in need of a professional who can build a tool that scrapes product data from Walmart and exports it into an Excel spreadsheet. Key Requirements: - Develop a web scraping tool specifically for Walmart website - Extract essentials (price, upc, title) Skills and Experience: - Proficiency in web scraping using Python, Scrapy, or similar tools Please let me know your availability and estimated time for completion. This is an urgent project, so a quick turnaround would be highly appreciated.
...within the 15 scope 3 categories under the GHG protocol are correct. 2. Emissions Factor Database Integration - Finish coding the scraping mechanism to extract emissions factors from the Intergovernmental Panel on Climate Change's (IPCC) emissions factors database (). - Integrate the scraping mechanism with the IPCC's lookup section to ensure the database is dynamically updated. Requirements: - Strong experience with the programming language used in the existing codebase (python, html, css, php, javascript). - Familiarity with the GHG protocol and its scope 3 categories. - Experience with web scraping and database integration. - Excellent problem-solving and debugging skills. - Ability to work independently and deliver high-quali...
Looking for a Python & Active Directory Expert to create a script and test data to capture all meta data linked to and which describes the confined parameters of an AD account, group policy etc. and export to a MS Excel File. More information attached.
I'm looking for a Telegram bot expert to help me with several tasks. Please see attached document for specific instructions of job. Do not send a quote you are not able to do the job...automated messages on my behalf - Resending Messages: You'll need to reword messages I receive and send them to my group While the project does not require any specific design or branding, it's crucial that you have a good understanding of how Telegram bots work and the ability to implement these features flawlessly. Ideal Skills: - Previous experience in creating Telegram bots - Proficient in Python and/or Node.js - Strong communication skills to ensure the bot functions as intended. - Must have great English skills and communication is mandatory. Please share your relevant exp...
Description: Seeking a freelancer to find and verify the contact information (email and mobile number) of specific job titles at a list of companies. We will provide the list of companies and if possible the name of the person we would like to speak with, just need for you to track down the email address a...address and phone number. Responsibilities: • Research and identify the correct person in each company based on the provided job titles. • Find and verify the email and mobile number of the identified person. Requirements: • Strong research skills and attention to detail. • Proficiency in using online tools and databases for contact information search. • Excellent communication skills. • Strong web scraping/crawling skills. Need to underst...
I'm in need of a skilled Python and C++ developer to create combinations of 2048 distinct objects, each with precisely 12 words. These combinations are intended for data analysis, so they need to meet specific statistical criteria. Key Requirements: - Create the combinations in Python and C++ - Ensure the combinations are statistically valid for data analysis Ideal Skillset: - Proficient in Python and C++ - Strong background in combinatorics - Experience with statistical analysis - Good understanding of data analysis techniques Once these combinations are generated, they will be utilized to conduct data analysis, so ensuring their accuracy and statistical relevance is crucial. Please only apply if you have the necessary skills and experience to handle this task...
I'm looking for a seasoned data analyst with over 10 years of experience in Python, PySpark, SQL, and other professional skills. The project will specifically revolve around data visualization. Key Requirements: - Strong background in Python, PySpark, and SQL is a must. - Experience with data visualization tools, particularly Python libraries like Matplotlib and Seaborn. - Proficiency in comparing data sets and presenting insights through visualization. Ideal Skills: - Data analysis and interpretation. - Data visualization. - Strong communication skills. - Problem-solving. - Attention to detail. Your role will be pivotal in helping me compare and contrast various data sets. This requires a deep understanding of the tools and techniques necessary to visually rep...
I have a list of URLs stored in Mongodb. The link connects to specific web pages and I need the underlying data from: 1. Line charts 2. Bar charts All the data that is required to be captured is in the webpage code. There are specific rules on data capture that have been specified and a prior scrap project has this already setup and the code (Python) could be re used. The data scraped needs to be stored in Collections on MongoDb. The scrap program needs to run on an Amazon Light sail Linux instance. Please only apply for the role if you have experience with this work and have successfully completed such project before. An advanced knowledge of scrapping and Mongdb is essential. A detailed specification has been developed and will be shared with genuine applicants. Than...
I am seeking a proficient programmer to build a program that helps identif...as access to this information is free. - Use UPC data to perform a search on eBay to see if the item is available on the platform. - Generate a profit prediction report based on eBay's item purchase history. The ideal freelancer for this job would have great scraping skills, experience with eBay's API, and be able to develop a friendly user interface. A background in eCommerce profitability analysis would also be advantageous. Key programming languages for this job include Python and JavaScript. Previous experience with web scraping libraries (BeautifulSoup, Selenium, etc.) is vital. End goal is to create a system that aids in making profitable product sourcing decisions, ...
I'm looking for a skilled developer to create an AI interview tool. The main f...tool would include: - Questions appearing in front of candidates - A microphone icon for answering - Real-time speech-to-text conversion, using Whisper or Google TTS API. - AI to verify the answers using AI . The primary focus of this tool's development is ensuring the accuracy of the AI in verifying answers. Skills and experiences that would be ideal for this project include: - Proficiency in Python - Front end - ReactJS - Experience in creating AI-powered applications - Familiarity with speech-to-text conversion processes - Knowledge of developing user-friendly interfaces. Please reach out if you're confident in your ability to deliver a high-quality AI interview tool with speech ...
...protocols and network flow sizes. Develop and validate mathematical expressions for cumulative distribution functions. Perform statistical analysis to evaluate the performance and reliability of electronic devices. Calculate and interpret Z-scores for normal distribution data. Assess the sensitivity and specificity of lie detector tests based on given data. Required Skills: Proficiency in R and/or Python for statistical computing and graphics. Strong understanding of discrete and continuous probability distributions. Experience with exponential distributions and their applications. Ability to interpret and use Z-tables for normal distribution analysis. Excellent problem-solving skills and attention to detail. Strong mathematical and statistical analysis skills. Effective communic...
I need an example of how to set up React with a Python backend executing locally inside of an Electron environment. We will be using it to parse local files from the file system and perform analysis. The method of interacting with Python should be the most simple, but is up to you. We will provide a Github repository for work upon selection. This should take 10 hours or less, it is a simple prototype.
I've got a small Python script that runs on my desktop and I need it to be translated into C# for better integration with the rest of my software. I need a skilled programmer with experience in both Python and C#. Unfortunately, I have not been able to make the script run successfully on Windows, but it works on Linux (WSL). For: Python script (I will provide full script): import grpc from chirpstack_api import api server = "" api_token = "eyJ0eXAiOiJKV1QiLCJ......................87k2i66CulW7Y" channel = grpc.insecure_channel(server) client = (channel) auth_token = [("authorization", "Bearer %s" % api_token)] req = (dev_eui="00000000aabbccdd") resp = (req
--- Do not bid Template--- I'm seeking a Python engineer with expertise in Django and Flask to assist in building a web application. Key Requirements: - Expertise in Python, Django and Flask - Proven experience in web application development - Strong understanding of web technologies - More then 2 years experience in Web Development Your role will be to: - Develop new features and functionalities - Improve and scale the web application - Ensure the web application is secure, stable, and performant This is an exciting project, and 2 members working now. Explain about your experience and attach the links that have done.
You must to be at least 16 years old and live in Latin America or Eastern Europe. ✻ NO EXPERIENCE REQUIRED ✻ You do not need any experience whatsoever, but you must be clever and eager to learn. No. I am *not* being charitable. I am being practical. ✻ PAYING YOU TO LEARN ✻ No. You aren't dreaming. I value intelligence and problem-solving ability over experience. I'd prefer to work with someone who is clever and learns quickly rather than someone experienced but is not very intelligent and/or does not solve problems scientifically. Would I hire an Isaac Newton or an Albert Einstein even if he had no programming experience? Of course I would. ✻ TESTS ✻ You must pass several difficult logic tests to work with me. The first logic test you complete for me will be an unpaid log...
...can be implemented on Raspberry Pi 4B. The main objective is to develop a system capable of accurately extracting text from natural scene images. Accuracy is essential, with the expected range standing between 88% and 95%. Key Requirements: - Understand the principles of text recognition, and possess the skills in developing a feasible and efficient solution. - Must be capable of programming in Python or similar languages – necessary for integrating the algorithm with Raspberry Pi 4B. - Familiarity with image processing and Raspberry Pi is highly beneficial, though not strictly compulsory. - The algorithm should be versatile enough to function accurately in varying lighting conditions, both indoors and outdoors. Hence, a deep understanding of image manipulation and light c...
For my project, I need a talented blockchain developer versed in: - Smart contract development - Token creation The potential freelancer should have solid experience in programming languages such as Solidity, JavaScript, and Python. This is crucial as these are our preferred languages for blockchain development. The project would require a deft handling of: - Wallet integration - Exchange integration - Payment gateway integration Therefore, prior experience and success in these aspects would be beneficial. This project demands someone with a deep understanding of ERC20 token fundamentals and the ability to deliver flawlessly on the incorporation of these elements.
I'm looking for a skilled individual who can help me scrape data from a dead mobile app (has both ios and android versions). The database of the app is of particu...both ios and android versions). The database of the app is of particular interest, however, I am not sure of the specifics such as the Database Management System (DBMS) it uses. Key Points: - Extracting data from the database of a defunct mobile app - Unspecified Database Management System (DBMS) - will require exploration and identification Ideal Skills and Experience: - Proficiency in data scraping and extraction - Strong background in database management and familiar with multiple DBMS - Resourcefulness and ability to work with minimal information Please get in touch if you're confident in your abilities ...
We are looking for several motivated freelancers interested in creating simple and user-friendly websites on Odoo (1-4p). Proficiency in Python and experience with Odoo are required. We have a large number of Odoo projects to be completed per week, and if you are serious, we will offer you multiple projects per week. Please contact us. Thank you.
YOUR BID PRICE IS FINAL. NO LATER CHANGE IS ALLOWED. I need an expert in CWP panel and in VPS who can install Python, NodeJS websites in my server as docker container. You don't need to do any coding. My VPS server is with Hetzner and it is more than one year old. Please see the screenshot. My VPS has 4GB RAM, 80 GB Harddisk, and CentOS 7 with Root access. it is long term project. I need to install 2 Python apps as of now. My budget is INR 600 per successful installation. I will prefer AnyDesk or TeamViewer. Might need to work with my developer during installation and after installation need to clean up junk files, depreacted, not used files to save space of my harddisk. Lowest Bidder will win.
Looking for scraping expert to write scraper script to download from a website that has captcha. The scraper script must be Windows executable .exe file that is very easy for non-technical user to just open and run.
I'm currently looking for a skilled and experienced developer for backend CMS development. Key responsibilities: - Develop a Content Management System using PHP, Laravel, MySQL, and Python. - Design, implement and maintain python-based backend application. Essential Skills: - Proficient in PHP, Laravel, MySQL, Python. - Extensive experience in backend development. - Knowledge in CMS development and implementation. - Strong understanding of data structures and algorithms. Your analysis skills will also be put to good use to solve complex problems in this role. As an experienced backend CMS developer, you can expect to work closely with me to deliver a robust, performant, and scalable system.
I need a developer versed in Flask Celery to help integrate background task processing into my ongoing project. Key requirements for this job include: - Significant experience with Flask Celery, Apache2, Python and understanding of its nuances - Ability to introduce background task processing in an existing project - Capability to be flexible regarding the nature of tasks being processed Regarding timeline, I am hoping for a swift turnaround due to the urgent nature of this project. Your understanding is appreciated.
...access and consume a wine knowledge library, proficiency in working with APIs to fetch and utilize external data sources is required. Strong Communication Skills: Effective communication skills are essential for understanding client requirements, providing progress updates, and collaborating with the client's team. Skillset: Programming Languages: Proficiency in programming languages such as Python, JavaScript, and possibly others depending on the technology stack chosen for implementation. Natural Language Processing (NLP): Experience with NLP libraries and frameworks like NLTK, spaCy, or Transformers for processing user queries and generating conversational responses. Machine Learning Frameworks: Knowledge of popular machine learning frameworks like TensorFlow or PyTo...
...residential properties only - Data to be collected from a well-known property portal - Compilation and delivery of data in a spreadsheet - Inclusion of property description, price, number of bedrooms, bathrooms, images, videos (if any), floorplans (if any), and location - Images to be put into separate folders named after the property they are from Ideal Skills and Experience: - Experience with web scraping and data extraction - Attention to detail to ensure accurate information retrieval - Proficiency in data organization and management - Understanding of the property market and relevant terminology - Strong communication skills to clarify any uncertainties and ensure the project's success Please note that the accuracy and completeness of the extracted data are of...
I require a professional Python script to scrape a website for data. Key Requirements: - The script should be designed for a one-time run - The website does not have JavaScript dynamic content, so the script does not need to handle dynamic content The ideal freelancer for this project should have prior experience in: - Python programming - Web scraping - Handling static web content
I'm in need of a professional who can build a tool that can extract data from LinkedIn. ...information (email address, phone number, etc.) - Profile information (name, job title, etc.) - Connection network (connections, mutual connections, etc.) I'd like the extracted data to be conveniently structured in a CSV (Excel spreadsheet) format. The primary use of the extracted LinkedIn data will be for lead generation. The ideal candidate for this project should have: - Expertise in web scraping and data mining, particularly with LinkedIn - Proficiency in data handling and structural organization - Proven experience with developing tools for lead generation - Strong communication skills and a good understanding of client needs. Please include examples of previous si...
I'm looking for a web scraping expert to carry out daily data extraction. The websites to be scraped will contain text content, along with images and video. I may need the scraping program to be written such that it can be conducted on a daily basis. to update new articles We are going to be scraping around 50 websites for the first project Key Requirements: - Profound experience in web scraping and automation tools. - Strong problem-solving skills to deal with any potential web structure changes. - Creating and maintaining a database of the scraped data would be a plus. Please provide your quote, along with the tools you intend to use for this process and your relevant experience. Looking forward to your bids. Ideally we want this...
...platform or framework of the user registration screen is unspecified. So, having significant experience in multiple frameworks like PHP, JavaScript/Node.js, Python/Django will be beneficial. - The registration screen currently has some security measures in place. Knowledge of secure coding practices is a must for this job. - The chosen developer will bestow full permissions to the admin. Therefore, the freelancer should understand well about user permissions and roles in a web application environment. The perfect freelancer for this job should demonstrate strong attention to detail, proficiency in multiple coding languages, and understanding of web security concepts. Providing examples of similar work where you've adjusted user permissions or made admin-only...
...should provide functionalities like data retrieval, data manipulation and data storage for text data. Key Points: - Create an API in a language of your expertise. - The API should be designed to handle text data exclusively. - The API should offer data retrieval, manipulation, and storage capabilities. Ideal Skills and Experience: - Proficient in API development and programming languages like Python, JavaScript, or PHP. - Strong background in handling text data. - Experience in providing data retrieval, manipulation, and storage functionalities via an API. Looking forward to working with a skilled professional to bring this project to life. ...................... Wir sind ein Unternehmen mit der Buchhaltungssoftware Phenix Cloud. Die Software ist eine Cloud-basierte Anwe...
I urgently require a proficient programmer who can create a program for me. This program should be capable of copying numbers from an updated in real-time website and then paste those numbers into a text file format. Key tasks...copying numbers from an updated in real-time website and then paste those numbers into a text file format. Key tasks include: - Scrape numbers from a certain site that updates in real time. - Paste and save these numbers strictly in a text file. - Ensure the application is user-friendly and effective. Since I didn't specify the operating system, all OS platforms are welcome. Familiarity with web scraping tools and an understanding of different file formats will ensure task success. Time efficiency is crucial; hence, I need this project complete...
I am looking for a freelancer who can extract specific data from a Swedish business directory using Python. Main URL: Key Objectives: - Extract company names, contact information (phone/email), and business numbers from the directory. Ideal Candidate: - Proficient in web scraping techniques - Strong command of Python - Previous experience with similar projects will be considered a plus. Please reach out if you have the necessary expertise.
I'm urgently in need of a skilled web scraper who can collect links from a company's website. Here is what you need to know: - The focus of this project is on the headlines of a website. You'll need to scrape these headlines as links. - The website has several sections, but you just need to scrape the headlines from the homepage. I need this done as soon as possible. If you have previous experience with web scraping and can start on this task immediately, I'd love to hear from you. Please share your experience in scraping data from websites and your availability to take on this task.
I'm looking for a skilled Python backend developer to enhance an existing backend system for my project. Key Responsibilities: - Enhancing the existing backend system: Your primary responsibility is to enhance the functionality of the current system and optimize its performance. - Integrating SQL/NoSQL Databases: Your expertise in SQL/NoSQL databases is crucial to ensure smooth integration and efficient data handling. - Experience with Python and Minio: If you're familiar with Minio that's a big plus, but Python is the key language you'll be working with on this project. Ideal Candidate: - Proven experience in enhancing existing backend systems. - Proficient in working with SQL/NoSQL Databases and designing queries. - Strong Python skills ...
I have a Python script that needs integration with a Telegram bot. The requirement is to connect the code with the Telegram bot to send questions from the Chegg website. Key tasks: - Integrating the existing Python code with a Telegram bot to send questions from the Chegg website - Automating the assignment of student IDs for each Chegg website task The ideal freelancer should have: - Proven experience in Python programming - Previous work with Telegram bot integration - Familiarity with Chegg website tasks and automation - Good understanding of API integrations Please share your relevant experience and any insights into how you plan to approach this integration.
I'm looking for a coder savvy in Python to help me scrape contact information from a specific business directory. The task involves enumerating a set of links on the site and scraping the following data: - Email addresses - Phone numbers - Physical addresses - Names Ideal Skills: - Proficiency in Python - Experience with web scraping - Familiarity with business directories The main goal is to have a comprehensive list of contact information, which I will use for a marketing campaign. The scraper should be able to handle a large volume of links and data. Your expertise in Python programming and web scraping is crucial for the success of this project. Your attention to detail and ability to deliver accurate and complete contact i...
As someone in need of a specific tool, I'm seeking a proficient Python programmer to create a desktop tool for auto cropping bulk TIFF scanned images. The key features I'm requiring are: - Auto Cropping: The tool should be capable of automatically cropping large amounts of TIFF images, simplifying the process and saving time. - Image Quality Adjustment: After auto cropping the images, I should be able to adjust their quality within the same tool. - Maintain TIFF Format: The cropped and quality-adjusted images should remain in TIFF format. A freelancer with great proficiency in Python and past experience in image processing software or similar would be ideal for this project. Understanding of image formats, specifically TIFF, and quality adjustment is essential.
I'm in search of a skilled machine learning developer with expertise in GPT (Generative Pre-trained Transformer). My goal is to have an AI model that can both correct and standardize postal addresses. The addresses will be provided in CSV files and the output of the model should be accessible via an API for integration into our system. Key requirements: - Proficiency in machine learning with a focus on GPT - Experience in addressing data correction and standardization - Transformers - Pytorch, TensorFlow, Keras, Pandas, Numpy, seaborn, Matplotlib The ideal candidate will have a proven track record of developing AI models, particularly in the realm of addressing data, and be able to provide a detailed timeline for the completion of the project.
...* Integrate with Google Sheets for seamless data import and export. * Website Meta Tag Optimization: * Develop a custom script on Vertex AI to: * Scrape content from web pages (titles, headings, body text). If scraping is not feasible, allow for manual input of content. * Utilize Gemini to generate SEO-optimized meta titles and descriptions based on the scraped/input content. * Ensure the script can handle both automated scraping and manual content input scenarios. Requirements: * Proficiency: Strong experience with Google Cloud Platform, Vertex AI, Python (or similar language), and web scraping techniques. * Google Sheets Integration: Experience with Google Sheets API for seamless data flow. Deliverables: * Two Function...
We are developing an innovative software application designed to transform the car rental market. Our app specializes in web scraping to gather and compare rental prices from leading car rental websites like DiscoverCars, AutoEurope, DoYouSpain, and others. The name of the app is PriceBook Key Features: Real-time Data Collection: Our software continuously scrapes data from various car rental websites, ensuring that users have access to the most up-to-date pricing information. Price Comparison: The app automatically compares rental prices from multiple providers, highlighting the best deals and most favorable rental conditions. Customization: Users can tailor their search based on specific criteria such as location, rental period, and vehicle type, providing a personalized ...
I am looking for a freelancer who can help me with Web Scraping. We have a list of websites that we would like to scrape specific data from, and have them put into a set of MySQL Databases (or maybe something else). The website that we would like to scrape data from each contain thousands of articles, and we would also want other metadata, such as Author name, article date, number of views, or any other metadata that we can take from the pages. Please bid, and we can discuss the first website, you can tell us how long you think it'll take to write the scraper. There are maybe 50 websites to begin with that we would like to do this for, in this one project, and we also have another couple of similar projects. Ideally, the scraper will run form a program, so that we can...
