Website crawl and capture data to database & Basic query page - MINI Project

Scope - A code that can execute some URL query and capture the display data to a SQL database. And then provide a simple interface to display data with one field search option. High Level Detail - Need to have a code that can open a URL, do necessary selection to navigate and then execute the search. From the Result page.. the data which is displayed in tabular formatted form ..needs to have various Fields extracted and values inserted into a table in a DB.. Each record with timestamps. The same would be done for various URLs. AI would be needed instead of hard coded method as result page may fluctuate now and then. This process to be invoked manually and maybe added to system schedule. I know there are tools out there including some open source and have used some.. but just doesn't seem to work easily out of box. I am looking for coding to be done in java, or perl or shell scripting. Preferred platform is Linux(Java/perl on windows maybe ok). DB has to be a open source SQL db like mySQL etc. Coding should be done with comments etc. Source code along with rights to be transferred to buyer at time of delivery. Let me know what u can do and other details u may need