Find Jobs
Hire Freelancers

Datascrape and Search Program

$250-750 AUD

Cerrado
Publicado hace casi 10 años

$250-750 AUD

Pagado a la entrega
Project requires: Datascrape pre-defined URLs, custom search of stored pages, google translate results 1) For a predefined list of URLs (obtain from database, by reference to specific fields in each record); 2) Scrape and store the entire website (text only) ("Level 0 Copy") - avoid duplication/recursion of pages generated from URL-local content databases - time and depth limits to be admin editable and flagged if reached; 3) Search stored Level 0 Copy of each page for certain keywords, keep only those pages for which there is a positive result on search ("Level 1 Copy"); 4) Search remaining Level 1 Copy pages for a separate set of keywords, keep only those pages for which there is a positive result ("Level 2 Copy"); Up to 5 iterations of search and keep only positive results - the structure is of multiple filters, applied sequentially, to produce a small number of remaining pages that match all keyword sets; 5) Final step if keyword searches conducted in non-english languages (defined at beginning of process), send resulting pages (after all 5 filters) to google translate to english; 6) Output - Excel spreadsheet report on search meta-data and results (template will be provided); and pdf of all remaining pages at end of process with translated copy if applicable. This is stage 1 of a larger project and must be completed quickly. Clean coding required due to long-term nature of project. Immediate follow on to next stage. You must advise on any external processing (e.g. cloud) requirements. All testing and development to be on your own account. Final large scale test only to be conducted on my accounts. Your bid must have at least a price estimate, subject to confirmation following discussion and provision of more detailed description of sources and process.
ID del proyecto: 5929261

Información sobre el proyecto

16 propuestas
Proyecto remoto
Activo hace 10 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
16 freelancers están ofertando un promedio de $988 AUD por este trabajo
Avatar del usuario
Dear Sir, We are FreeSkyTeam from Hanoi, Vietnam. To meet your requirement, we propose following solutions: 1- We develop a JVM based application using Scala programming language. 2- The app will read list of URL from database you provided and gradually crawl to each web site to parse purely plain text and filter unnecessary HTML tags, CSS, Javascript. 3- We develop several level processing to filter text by keyword and keyword combinations. 4- We write result to CSV that can be imported by Excel. Kind Regards, Cuong,
$1.263 AUD en 50 días
4,9 (5 comentarios)
7,2
7,2
Avatar del usuario
Hi I can provide a desktop application in C# that will fulfilled the requirements. Ready to provide demo if you are interested. Thanks
$1.157 AUD en 8 días
5,0 (123 comentarios)
6,7
6,7
Avatar del usuario
Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. you can see my experience here: https://www.freelancer.com/u/uumairkhalid.html looking for your reply. Thanks
$526 AUD en 10 días
5,0 (58 comentarios)
6,0
6,0
Avatar del usuario
Hi, I would like to work on this project. I have done a lot of similar project of this. So willing to response to discuss before awarding this project. Hopefully you will me chance to work on this project. Thanks.
$631 AUD en 10 días
4,8 (83 comentarios)
6,0
6,0
Avatar del usuario
Hello Sir, We are a well built set up with excellent skilled operator with lot of experience in this segment/skill,have complete more than 200 similar job in freelancer in last 4 years, i have gone through your project description, its really a simple task, we can make a well formatted,error free list. Sir, we are waiting for your reply for communicate also like to make a sample if you allow by a single reply. Thanks DG
$526 AUD en 10 días
4,8 (62 comentarios)
6,0
6,0
Avatar del usuario
Hi Ashton, I have updated my bid to reflect the new info provided. This will be a very complex scraping process and will involve a lot of trial and error. Personally i think 95% accuracy is not doable , perhaps a 80% would be realistic. In any case i think this is a more realistic budget considering the work involved. What i can promise if my bid is accepted : 1) i'll be your most reliable tested as well as programmer 2) 3 months of support is included (considering the complexity of this project that will probably involve several fixes as certain problems might not be seen until full scrapes are done and analyzed properly over several months. 3) if you look at my reviews i have not let down anyone in the past. With a project like this the biggest concern should be that programmers would simply give up realizing it's beyond their level. Low quality programming at this stage would crush the entire project. What i can promise is that you need someone with my level of commitment to quality. Warm regards, George
$3.000 AUD en 40 días
5,0 (51 comentarios)
5,9
5,9
Avatar del usuario
Hi, I am an experienced software and Web developer, and I am highly expert at Web scraping. I understand that this is the first stage of a larger project, and I will keep this in mind during development. First things first, what is the primary purpose of this entire project that this first stage is part of? Secondly, are you looking into running this as a Web-based or a desktop application? Respectfully yours, Mark
$560 AUD en 14 días
4,9 (61 comentarios)
5,3
5,3
Avatar del usuario
I have done 50+ scraping projects with 5 star feedback and should be able to do this one fairly quickly. Please specify the following: - Rough number of URLs you will need to scrap - Rough number of Level 5 documents you expect to get - If you are going to use the paid API of google translate - If you can specify a list of proxies when running the code - If the code can be in python or java
$526 AUD en 10 días
4,9 (20 comentarios)
5,0
5,0
Avatar del usuario
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$789 AUD en 20 días
5,0 (12 comentarios)
4,9
4,9
Avatar del usuario
Good at data scraping and processing.##########################################################################################################################################
$1.052 AUD en 10 días
5,0 (15 comentarios)
4,3
4,3
Avatar del usuario
Hello, We have excellent team of programmers and designers to work on your project efficiently and complete job in time. We have read your deepest requirement at our best and will surely give better results. thanks
$833 AUD en 20 días
5,0 (11 comentarios)
4,2
4,2
Avatar del usuario
Hello AshtonRS we can do any type of scarping,hacking and cracking of software contact me......................................................................................................................
$789 AUD en 10 días
5,0 (1 comentario)
3,0
3,0
Avatar del usuario
I would like to work on your this project. I'm new in freelancer.com but not know in this sector. I have more than 4 years experience in this sector. So willing to response to discuss about the project. Thanks and god bless you. Sincerely, Saminatinny.
$611 AUD en 10 días
5,0 (1 comentario)
0,0
0,0
Avatar del usuario
Hello Sir, Greetings of the day!!! It'll be pleasure to work with you. Allow me to do this task for you. Thanks Bhadresh Skype- bd_orbit
$700 AUD en 20 días
5,0 (2 comentarios)
0,0
0,0
Avatar del usuario
Hello Sir, We have gone through the details you have provided and we have already worked on a similar project before and can deliver as u have mentioned and would be pleased to work on this with you to deliver the results that you have expected and we have already worked on a similar project before and can deliver as u have mentioned We are sure you will not be disappointed if you give us this opportunity. Our team is experienced, creative & efficient enough to get your job done well. We have an impeccable record and all our clients enjoy working with us, we are sure that you will too, our prices are cheapest in market. can u provide your email or sky-pe etc for further discussion about the project I am ready to discuss with you with best Regards
$555 AUD en 10 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I have extensive experience in web-scraping and developing in Java and Python. Most of my projects have been deployed in Amazon Web Services (AWS), but am comfortable with the Microsoft Azure platform as well. I have actually completed a project similar to this several months ago in Java: My project scraped financial articles-- extracting the plain-text, and cataloging them. Since late 2013, the script has run on an Amazon Web Services EC2 instance continuously, cataloging ~1,000,000 articles. If you want, I can provide you with more details about this project. For your project, I would use a similar approach. Using either Java/Python to scrape the page, extract the plain-text, scan for keywords, translate, store, and report. I would deploy via AWS, using an EC2 instance (cost ~$18 USD/month, or, the first whole year is free if you are a new user) + a NoSQL database. Depending on your needs, AWS can be quite inexpensive! I can determine which specific solutions are the best fit after we discuss your project further. Feel free to message me to discuss the project or my experience/capabilities. Regards, William
$875 AUD en 10 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de AUSTRALIA
Bolwarra Heights, Australia
5,0
3
Forma de pago verificada
Miembro desde nov 19, 2012

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.