I will build a Java application to scrape members info from website. Below is the brief description of the application.
1) Application will navigate to the website and scrape data.
2) I will design the database schema and save the members data in a database.
3) If you are interested, I will set up a Linux/UNIX virtual server to run the application.
4) If the application terminates for any reason, I will set up script files to automatically restart the application from the terminated point.
5) Use Proxy servers to navigate to the website.
6) I will set up cron jobs to automatically trigger the application.
7) I will suggest you the best technologies and tools to increase productivity.
Contact me to discuss more about my proposal.
Java, Selenium, Jsoup, Hibernate. Chrome, Headless Browsers, HTML, AJAX, JavaScript, Windows, UNIX/Linux, Excel