En curso

Rebuild web-scraper using SCRAPY + Data transformation - Long term project w/ monthly support

I am looking for developers with significant experience in web scraping to help:

1. Rebuild my phython/php scraper in SCRAPY - compatible with [login to view URL]

2. Manipulate data and prices

3. Export to new CSV/XLS templates - Data transformation

This is a long-term project which will include building and refining the scraper (you are expected to utilize the existing PHP/python code to fast-track the development).

My requirements are extremely clear and detailed, the project will be divided into fixed price tasks and milestones.

This is the entire project with 5 stages: https://h0rfrh.axshare.com/#g=1&p=sailfish_alpha - GREEN/AMBER features are developed and available in the source code

Source code: [login to view URL]

You are expected to quote a fixed price for two tasks (please provide a technical approach and breakdown of efforts/costs/timelines)

1. Building the scraper for CWH - https://h0rfrh.axshare.com/#g=1&p=cwh_scraper - Code for reference is available in the link

2. Transform the CSV to Shopify Excelify - [login to view URL]

All products are simple products with no variations and up to 10 images. The Shopify format requires two things from a data transformation perspective:

a) creation of slugs - simple regex or python-slugify

b) if a product has multiple images, it will have multiple rows (n-images, n-rows)

As you can see from the overall roadmap - this is a long-term project with several scrapers that need to be added to this solution.

I prefer someone who is available to start work right away.

Habilidades: Extracción de datos, PHP, Python, Arquitectura de software, Extracción de datos web

Ver más: Data entry long term project, long term project, long term project in academic work, how to use scrapy, data crawling tools, python web crawler, web scraping, python web scraping library, web scraping api, how to scrap a website, scrapinghub, php, python, scrapy, data entry long term, python web scraper using keywords, using scrapy data mining, web scraper using mozenda, short term long term project, seo expert long term project

Información del empleador:
( 14 comentarios ) Parramatta, Australia

Nº del proyecto: #17202341

Adjudicado a:


Hello, I have vast experiences in web scraping with Python Scrapy and BeautifulSoup. So I was so interested in this project description and submitting a proposal with the confident that I can bring the project comp Más

$155 AUD en 3 días
(2 comentarios)

13 freelancers están ofertando el promedio de $148 para este trabajo


hi I am really interested in your project I have full experience of web scraping with python and c# I could modify your scrape code as you want I could satisfy you Everything will be done well if you work with me Más

$155 AUD en 3 días
(97 comentarios)

Hi there. Nice to meet you. I'm a Web scrap expert and FULL Time Developer. I have checked your requirements carefully. I have rich experience in Python, PHP, Micro, Web scrap, etc. I can start work immediately n Más

$155 AUD en 3 días
(116 comentarios)
$177 AUD en 3 días
(24 comentarios)

Hi!. I am available right now, how are you? I am interested in your project and would like to discuss the project with you. I always deliver on time and on budget feel free to check my feedbacks and portfolio. I unde Más

$190 AUD en 5 días
(36 comentarios)
$155 AUD en 3 días
(41 comentarios)

Dear I am an expert in web scraping. In before, I developed many spiders using scrapy. For example, I scraped data for CEOs(ebay, welivv, [login to view URL], [login to view URL] and so on). Thanks.

$122 AUD en 3 días
(40 comentarios)

Ready to start the work to work for stopping scrapper to rebuild the python scrapper ,please check my recent similar work ,we can discuss more over chat,thanks regards Arjun S.

$111 AUD en 3 días
(10 comentarios)

I can give support for development in python these are my skill related to web scraping and web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python. Have done testing and automation with selenium Más

$155 AUD en 3 días
(13 comentarios)

Hi, I hope you are doing good. I am Skilled in Web Development, App, IOS, iPhone, IPAD Development for past 7 years. I am skilled includes in HTML5, CSS, CSS3 & LESS, JS ( AngularJS, React JS, node.js, express JS Más

$190 AUD en 3 días
(1 comentario)

Hi !! Nice to E-meet you We have a team of experienced python, django developers. We have developed a sophisticated trading platform ([login to view URL]) using python, django, postgresql. Our python/django de Más

$150 AUD en 3 días
(6 comentarios)

Dear Project Owner, This is Priyanka able to do your job, As we have number of software engineers at our development center on all the developement platforms for more about us please visit [login to view URL] or f Más

$56 AUD en 3 días
(3 comentarios)

I can help you! I am computer engineer graduate and do a lots of programming like java, html, phython and etc.

$155 AUD en 3 días
(0 comentarios)