Web Crawling Jobs

I need a VERY simple OTD file that combines three (3) things I have already created. Steps: 1) Goes to a list of Hashtag URLS on a social media site 2) Loops clicks images from Hashtag URL page 3) Clicks on the open images to the User Profile and gets data I have step three (3) ready, and the first two (2) are easy to add but I keep getting glitches. I need it to be easy to add time delays and different data (which is standard). It will take just 10-15 minutes to complete. You need to use your own social media cookie, and then delete it and I will test with mine.

I am looking for a detailed web crawl of any website. I am aiming to crawl each page of a website and pick only certain information to finally store in a database (suitable, to be suggested by you). So, input will be the domain and you need to find a way to compile all the URLs and then collect info as in the excel sheet. - Tab “Crawled URLs” will list out all the URLs of the sites - Tab “Internal Links Raw Data” will list out all the specifics of the internal links Now, for each crawl, you may need to record them under a unique crawl ID. This is the 1st phase of the project. We will expand the scope once we get the data correctly and reliably for large websites. I can explain the details of the required information in the attached sheet. To qualify for serious co...