am looking for a web scraping software which has options to
1. to scrape website url from database websites like criaglist, yellow pages. Software should be able to scrape url in the form of [login to view URL] not in the form [login to view URL]
2. should also be able to scrape email address, ph, address,state, city, zip
3. should be able to eliminate the bad urls, duplicates
4. should be able to scrap emails from facebook, twitter, forums as well
5. user friendly even for software noob.
6. should be able to scrape 1k to 20k .
need tutorials and training for the same.