Creating a web crawler

Estado: Closed
Premio: $731
Propuestas recibidas: 19
Ganador: hwanghendra

Winner

Resumen del concurso

I will give three different websites and I want you to create a crawler that goes to two websites and retrieve three different items: Product's name, price and picture from each product in these three websites. The program has to store these items in a database.

Also, the program will be run automatically in a daily basis.
http://www.jarir.com/
http://www.extrastores.com/en-sa/

Habilidades recomendadas

Winner

Publica un concurso similar

Comentarios del empleador

“we will work together soon.”

edeeeeede, Saudi Arabia.

Tablero de aclaración pública

njose
- 7 años atrás
Please see entry #26 - I made it possible to interact with the crawler so that your sure it's retrieving products from the actual source websites you gave us. The entire process will be automated, I want you to be certain of it's functionality #26
- 7 años atrás
ankurs13
- 7 años atrás
Hello Sir, I have been able to retrieve all products from the two websites from all categories and the output list is present in my submission as a google sheet link. Please go through it and contact me. My submission is #21
- 7 años atrás
Organizador del concurso
- 7 años atrás
Guys, anyone who is able to retrieve all the products from the two website. He/she has to contact me.
- 7 años atrás
1. yourSalesPitch
  - 7 años atrás
  hello Sir
  - 7 años atrás
2. yourSalesPitch
  - 7 años atrás
  Please Award !!!
  - 7 años atrás
yourSalesPitch
- 7 años atrás
Please check #11 . I am ready to code it for you. Thanks
- 7 años atrás
1. Organizador del concurso
  - 7 años atrás
  sure, will be checked
  - 7 años atrás
busygayan
- 7 años atrás
Hi,
Do you require all the products to be extracted or selected categories and pages ?
- 7 años atrás
1. busygayan
  - 7 años atrás
  Please extend the time, i can write an efficient bot in python, which will go through all the products in the site and collect data.
  - 7 años atrás
2. Organizador del concurso
  - 7 años atrás
  Yes, all the products should be extracted from all categories
  - 7 años atrás
Organizador del concurso
- 7 años atrás
sure, I will check all your proposal and get back to you guys
- 7 años atrás
njose
- 7 años atrás
Please see entry #26 for working demo. It features a well structured, and organised code base. It's highly scalable and easy to maintain. In addition, all actions can be executed from the command line without the interface which simplifies scheduling tasks and is way faster.
- 7 años atrás
1. njose
  - 7 años atrás
  If you have any question, please let me know. I will be happy to answer any of them. Best, Njose
  - 7 años atrás
Lauris79
- 7 años atrás
Just added entry #22 . Will send You live demo URL in chat message.
- 7 años atrás
ankurs13
- 7 años atrás
Please check my entry #21 and provide feedback please :)
- 7 años atrás
njose
- 7 años atrás
Hi.. I have started working on a fully functional script with an intuitive interface. I will submit my entry before the due date for you to demo. Best, Njose
- 7 años atrás
yourSalesPitch
- 7 años atrás
#16 Please
- 7 años atrás
yourSalesPitch
- 7 años atrás
#11 Please message me through chat window. I have a demo for you
- 7 años atrás
yourSalesPitch
- 7 años atrás
Please message me through chat window. I have a demo for you
- 7 años atrás
Organizador del concurso
- 7 años atrás
I have extended the contest and also increased the amount to 731. NOTE: I am not going to extend the project any more.
- 7 años atrás
1. Lauris79
  - 7 años atrás
  Thanks! Next entries and the demo coming soon!
  - 7 años atrás
Organizador del concurso
- 7 años atrás
I will try to extend the due date
- 7 años atrás
1. yourSalesPitch
  - 7 años atrás
  Hi, please pm me. I'll do it for you
  - 7 años atrás
ankurs13
- 7 años atrás
#extended please, working on it
- 7 años atrás
Lauris79
- 7 años atrás
#extended
- 7 años atrás
1. Lauris79
  - 7 años atrás
  If You're interested in live demo code and complete dataset, extend the contest at least 2-3 days
  - 7 años atrás