Hello I need a crawler to grab content in mulitple urls.
to see the url follow this link :
[login to view URL]
the format is [login to view URL]
I need it grabbed from the begining to the end of the XXXXX
You can use all existing crawler or create your own (but I ll need the crawler at the end with this config)
What to grab :
- title
- main title pictures
- questions
- options
- solutions
- solutions pictures
Delivery :
1 - Title list : a list of all the title (csv or txt file)
2 - Folder + content : each url grabbed should be put into a folder, the name of the folder will be the number of the URL "XXXXX", the folder will contain, the exported data (text)in a .sql file (I ll provide sql specifications upon project acceptation) and the pictures.
3 - you will provide the first set of data to prove the crawler.