Maintain and run crawling infrastructure

$25-50 USD / hour

Cerrado

Publicado

hace más de 2 años

$25-50 USD / hour

We've built out a well-tested, docker swarm + typescript + timescale + bull-queue based infrastructure for crawling a variety of food ratings sites. It has full CI/CD to production servers and is ready for crawling the USA. It was fully working a few months ago on runs in SF, so now the job is just fixing up the tests that are breaking in the last couple months, getting proxy rotation working nicely, and scaling it up to run continuous crawling on the US.

SQL

Database Administration

Docker

Web Crawling

Typescript

ID del proyecto: 32225600

Información sobre el proyecto

14 propuestas

Proyecto remoto

Activo hace 2 años

¿Buscas ganar dinero?

Dirección de email

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto

Cobra por tu trabajo

Describe tu propuesta

Es gratis registrarse y presentar ofertas en los trabajos

14 freelancers están ofertando un promedio de $29 USD /hora por este trabajo

@PandADevelopment

Hello, How are you? I'm a senior software egineer who has over 10 years of experience in Web and Mobile Development. So I'm very proficient in Web Scrappoing using Node.js, Python, BeautirfulSoup, Pupeeter, etc... And I'm good at CI/CD Dev Ops using Docker, Jenins, Circle CI, etc... So I'm very confident I can bring your project on time with high standards. Looking forward to hearing from you. Best Regards. Alexios

$45 USD en 40 días

5,0

(1 comentario)

5,5

@tangramua

Hello Nate W., We have 20 years of strong experience in SQL, Database Administration, Typescript, Docker, Web Crawling, as a result, we can successfully complete this project. Please, review our profile here: https://www.freelancer.com/u/tangramua Here detailed information about our company, our portfolio, and the client's recent reviews. Also, we wanted to personally discuss questions about your project, which helps us to give you the right estimation. Best regards, Tangram Canada Inc.

$25 USD en 5 días

5,0

(12 comentarios)

5,1

@romanvaraksin

Hello, dear! I am very interested in your project. I have over 10 years of experience with web scraping and crawling. I can use Python andTypeScript for crawling. I can scrape any sites. Please contact me. Best wishes.

$20 USD en 40 días

4,5

(2 comentarios)

4,8

@NEHABHAT92

Hello, I have read the job details very carefully, and i become very interested in working with you. I'm an expert in this field. I have done several projects like this before. I will provide my best effort to complete your project and build a long-term relationship with you. I am a hard worker, productive, and worthy of your attention. I hope I would be the right candidate for this post. I am awaiting an affirmative response from you. Please message me for further discussion.

$25 USD en 40 días

5,0

(1 comentario)

0,3

@RomanKor1012

Hello I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I am a senior developer and I have 15+ years in this field. Now I am very interesting your job and I want to take part in your job. So please send me a message. I want to discuss more detail via chat. I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. Best Regards

$45 USD en 40 días