Webscraping

Goal of the project To monitor the prices of all parties active on the target website. The prices may vary from region to region and differ by house type. Input A static list of 200 houses and 50 utilities. Houses - Postal code (postcode) - Housenumber (huisnr) - House type (type woning) Utilities - Postal code (postcode) - Housenumber (huisnr) Output The output must be - postcode (postal code) - Hhuisnr (housenumber) - Type woning (House type) (if address is a utility the house type is "utility") - Datum (date of scraping) - Bedrijf (company name) - Beoordeling (number of stars) - Beoordeling aantal (number of reviews) - Levertijd (days) - Prijs (price in euro) Some companies do not list a price. If so the price field remains empty. Data All results are stored in a single table on our Azure SQL database. The script will only add data to this table, never delete or change data. Frequency All 250 addresses must be scraped once a week on Monday between 10:00 and 14:00 hours (Amsterdam time). The code All code is shared via [login to view URL] Hosting The code runs on a VPS server hosted by DigitalOcean or similar. Proxies We will use proxies to ensure the scraper is not blocked. For instance - [login to view URL] - [login to view URL] - [login to view URL] All proxies will be Dutch IPs.