Automatically scrap data from our suppliers portals and load into our AWS server

Completado Publicado hace 7 años Pagado a la entrega
Completado Pagado a la entrega

We're a firearms accessories online retailer and we sell a huge range (10,000+) of products. To get our quantities and prices up to date we have to scrape data from our suppliers online portals as APIs aren't available.

To date we've been using executable files based on java to scrape the data we need, but going forward, we want this to happen automatically from our AWS instance.

This project is to transition one of our scrapers to AWS. If successful, we will continue the work for our other suppliers (4 in total).

Notes

- I have attached the current executable we use as well as the output that it produces.

- The scraper should automatically run at a pre-determined frequency (daily) and append time stamped data to a table which can be queried in SQL

- If the scraper fails there needs to be an alert

- The scraper needs to be well documented so that it can be troubleshot

- An example of the type of fields that we required scraped is attached. This does not include images.

Amazon Web Services SQL Extracción de datos web

Nº del proyecto: #11957025

Sobre el proyecto

19 propuestas Proyecto remoto Activo hace 7 años

Adjudicado a:

SuiGenSolutions

Hello Sir, I have gone through your requirements. Basically you would like to place your one scraper on AWS instance and run it automatically by any scheduler. I have one question - currently your scraper requires Más

$147 AUD en 1 día
(33 comentarios)
6.2

19 freelancers están ofertando un promedio de $232 por este trabajo

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, Más

$262 AUD en 6 días
(430 comentarios)
8.2
mmadi

Dear Client, Greetings from Flowgica technologies, I have experience with these skills. We do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. please ch Más

$150 AUD en 4 días
(11 comentarios)
6.4
masud0012

I am ready to start right now.I am a full time dedicated freelancer. Dear Hiring Manager, I have read your job description carefully and I’m very considering your job such as these capabilities. I have fantastic expe Más

$155 AUD en 3 días
(52 comentarios)
5.6
contactvidura

Hi, Ready for the task. Please see my reviews and previous projects. Can we discuss the details further? Waiting for your reply!

$200 AUD en 3 días
(116 comentarios)
5.4
Iamtuheedakram

Hey i can do this job since i am expert in scrapping and automation with more than 3 years of work experience. I have scrapped and automated many sites already such as Instagram, kajiji, fsbo, forsalybyowner and many Más

$250 AUD en 3 días
(18 comentarios)
4.9
SkyDevelopers

Hello there! i am a web developer and a designer with over 5 years of solid industrial experience. i have excellent experience working with PHP, javascript, jquery, mysql, ajax, ect... I have very good experiance w Más

$250 AUD en 14 días
(9 comentarios)
4.9
markandrewsvw

Hi, I can do this for you. I excel where other web scrapers can't. My recent reviews demonstrate this. If it is visible or clickable on the web then I can scrape it. My primary language is Python - I use the scra Más

$175 AUD en 3 días
(13 comentarios)
5.0
csanadfarkas90

Hi! I done a lot of data extraction from websites, with JAVA selenium. I can make a demo with demo data if you want (FREE), before you award me and if you like it we can keep working together Just contact me and i Más

$160 AUD en 3 días
(7 comentarios)
3.8
danut1

hello, I am one of the best scrapers developer you will find here. just finished a scraper that downloaded more than 10 milions rows from a website into a database. feedback will appear soon. contact me for more detai Más

$250 AUD en 5 días
(7 comentarios)
2.9
rrgindore

Dear Sir i am please to offer you web scrapping solution which can automatically scrap the desired data Please initiate further conversation for better understanding Regards AMit

$155 AUD en 3 días
(5 comentarios)
2.9
MohsanEijaz

Hello there It is my great honor to apply for this vacant job. I am very hardworking and can work effectively as fast as I can. I have excellent skills in JAVA, C++, C#, OPPs, HTML5, CSS3, JS, AJAX, JQYERY, React.js, Más

$222 AUD en 3 días
(1 comentario)
1.9
Dilipjaipur

Hello, I have ranking in top 3500 on freelancer.com and I hope it will give you an idea about my work quality and dedication to work. You will be safe while working with me. I have dedicated in house team for Wo Más

$277 AUD en 10 días
(3 comentarios)
1.6
covernal

Hi, I am glad I have a chance to show you my professional skill. I have completed all projects as successful on the Freelancer.com I will provide you my professional skills for your project. Please check my work his Más

$444 AUD en 5 días
(0 comentarios)
0.0