Simple php webpage scraper

Imekamilika Ilichapishwa Jul 21, 2015 Kulipwa wakati wa kujifungua
Imekamilika Kulipwa wakati wa kujifungua

I need a simple php web scraper, that will scrape a few pages, use some regex to pull out some data I need, then sort that data (I don’t want the data to be de-duped or remove duplicates), and display it as a webpage, as well as save to a text file on the server. Shouldn’t take you long at all. Here’s what it needs to do:

1. Go to [url removed, login to view]

2. Under ‘Free Sports Picks’, you’ll see a drop-down box pre-populated with ‘Overall’. That drop-down box has the various sports. If you look at the html code, the div class name is leaderboard-filter-item. It has the direct links to the various html pages for each sport. The script will navigate to each sports html page to scrape data that I want. For example, [url removed, login to view] The script will go through each available sport and scrape the required data and save it all to the same webpage/text file.

3. I want the script to scrape the game time, sport, teams playing and the free pick. Using the [url removed, login to view] page as an example, the div class names of the data I want scraped are:

free-pick-green

free-pick-sport

free-pick-game

free-pick-time

4. I want the data displayed in the same order as I listed the div classes above, with a pipe (|) in between each piece of data. So using an example from the [url removed, login to view], here’s some of the html that the scraper would look at:

<div class="free-pick-game-info-head">Game Details</div>

<div class="free-pick-time">Jul 21 '15, 7:10 PM in 7h</div>

<div class="free-pick-game">

<span class="free-pick-sport">MLB</span> |

Los Angeles Dodgers vs Atlanta Braves</div>

<div class="alert alert-success free-pick-green"><div class="fa fa-check-circle free-picks-check-icon"></div> Play on: <b>Los Angeles Dodgers -145 at 5Dimes</b></div>

</div>

5. Using the above data, the script would scrape and display this data:

Play on:Los Angeles Dodgers -145 at 5Dimes | MLB | Los Angeles Dodgers vs Atlanta Braves | Jul 21 '15, 7:10 PM in 7h

6. It would do the same thing for every single free pick on all the individual sports pages available. When finished scraping, it will sort the list by the free picks themselves (the div class free-pick-green), so that any duplicate picks are displayed next to each other. It will not remove any duplicates, just sorting them. The end result will be both saved to a text file on the server as well as displayed in the browser, along with a count of the number of picks that it scraped.

PHP

Kitambulisho cha Mradi: #8117248

Kuhusu mradi

15 mapendekezo Mradi wa mbali Ipo mtandaoni %project.latestActivity_relativeTime|badilisha%

Imetuzwa kwa:

basrimy

Hi, Here is the demo: [login to view URL] Only thing now i just ned to save it text if you are agree with me. Basri

$55 USD kwa siku 1
(Maoni 26)
4.5

15 wafanyakazi huru wanazabuni wastani wa $139 kwa kazi hii

khush1984

Hi, I am ready to help you in this project. I have 9 years of experience in web development using php and mysql. I have checked the page and there are only 3 options in the dropdown and nfl have no games. so you Zaidi

$157 USD kwa siku 3
(Maoni 131)
7.8
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$167 USD kwa siku 5
(Maoni 198)
7.0
l4logics

hiii.. Can we more discuss this project? I will do this project I have 5 year experience in php,mysql, ajax, javascripts,jquery etc THANK IN ADVANCE REGARDS: Vikash

$100 USD kwa siku 3
(Maoni 102)
6.1
ITRACK

Hello, I'm interested in doing this project. I can create a scrapper in PHP to scrap the required information as described. I can complete this task in 24 hours. Thanks Habeeb

$55 USD kwa siku 1
(Maoni 133)
6.1
bhaskarmandal

Hi, I am 5 years experienced web developer . I understand your points . I have previous experience this type of work . I can start this project now and will completed in time . Please check my profile for my work qual Zaidi

$100 USD kwa siku 2
(Maoni 71)
6.0
AnilTejwani73

Hi, I am confident to deliver more than your expectation, if given a chance. Kindly have a look into my profile, and if it interests you, lets discuss more of the project. Thanks and Cheers.

$99 USD kwa siku 5
(Maoni 27)
5.4
longthanh

A proposal has not yet been provided

$333 USD kwa siku 3
(Maoni 10)
4.1
dpcSystem

PHP5, HTML5, CSS3 ,JAVASCRIPT, JQUERY, MYSQL, LINUX Laravel 5 & 4, Bootstrap. I'm a web developer with 6 yrs experience. If you award me this project, I can start to work right now.

$111 USD kwa siku 0
(Maoni 12)
3.9
melodev

A proposal has not yet been provided

$90 USD kwa siku 4
(Maoni 3)
2.8
mota77

A proposal has not yet been provided

$55 USD kwa siku 2
(Maoni 2)
1.1
ArrayCreator

I have experience in scraping website , i have made a couple of scraping php programs , and i have scraped multiple websites before for personal use

$222 USD kwa siku 2
(Maoni 0)
0.0