Scrapping project for Magento -- 2

Previous developper failed to import more than a few item at once: mass importing did not work. you must be able to import and sync about 50k item, of course without flooding mysql engine. You need to complete and fix that project, or remove everything from live shop and do it from scratch. From what I can see, scrapping from heo is working, figoodies is not done at all. magento extension is done for the most part. You will develop a MAGENTO extension - You scrap all data, including cloths, from [login to view URL] (about 30k items) and [login to view URL] (about 3k items) into a mysql database. Once you scrapped everything, you will update that database with new items, out of stock items, delays or price update… those are just examples, the database must exactly reflect the source. - From Magento, I will choose my own delays, price, categories, which items import, of course I need mass updating, not one by one, I will also choose cron or “run now”, and magento database must not be flooded: you should pause importation when needed, in order to not index 40k items at once. Of course all those parameters must be saved in templates I will use when I need them. Once I imported in Magento the items I need, they must be automatically updated (delay, price, out of stock…) from our other database created by the scrapping engine. No hard coding: every parameter I need (including user name and password) must be put in Magento extension, meaning if I use that extension on a different shop, with a different url, it will run smoothly. For example my price could be source cost plus 30%. Same thing for source delay: I need to be able to customize it. - I also want bug fix, if needed, for at least six month after you are fully paid. Since it’s an assisted project, you would take full responsibility if you did not want to fix bugs after the project is completed. if we are happy we have many other tasks‏. Please consider the full scope of work before you place your final bid. Thanks