Web Scrap Medical Website

  • Estado: Closed
  • Premio: $110
  • Propuestas recibidas: 3
  • Ganador: Verz1Lka

Resumen del concurso

I need to scrap a website that contains professional information.

The final product is a .csv (or excel) file with all information along with the python script that you used to scrap the website.

The website is in portguese (brazilian)

url: http://portal.cfm.org.br/index.php?option=com_medicos&Itemid=59

You will find a form to search for healthcare professionals.

First line: leave it blank

Second line: The first box should be left blank. The second box is a list of states (loop through all states).

Third line: List of cities. Once you have selected a State, it will show the list of all cities of that state. (loop through all cities)

Fourth line: choose 'ativo'

Fifth line: choose 'todos'

Sixth line: (CIRURGIA DO APARELHO DIGESTIVO) and (CIRURGIA GERAL)


The database should contain all information for every name:

State (UF)
City (município)
Specialty (especialidade)
Name (Nome do Médico)
Situation (situação)
CRM
Tipo de inscrição
Especialidade/Area de atuação (1)
RQE (1)
Especialidade/Area de atuação (2)
RQE (2)
Especialidade/Area de atuação (n)
RQE (n)

p.s.: 'Todos' means 'All'

The website breaks the results in pages, please be aware of that.

I have attached an example of the result I need

Habilidades recomendadas

Comentarios del empleador

“Great job! Other people took days to scrap the website, while he took only hours.”

Imagen del perfil victorarakawa, Brazil.

Principales propuestas de este concurso

Ver más participaciones

Tablero de aclaración pública

  • knowledgeexcavat
    knowledgeexcavat
    • 6 años atrás

    wow... just attached 3 files and it is closed :(

    • 6 años atrás
    1. knowledgeexcavat
      knowledgeexcavat
      • 6 años atrás

      and there are 18499 entries...

      • 6 años atrás
  • knowledgeexcavat
    knowledgeexcavat
    • 6 años atrás

    What about AREA_ATUACAO_3 RQE_3 ? Some persons have 3.

    • 6 años atrás
    1. victorarakawa
      Organizador del concurso
      • 6 años atrás

      Yes, you should create AREA_ATUACAO_n for n=1,2,3...

      • 6 años atrás
  • hwanghendra
    hwanghendra
    • 6 años atrás

    Hi are you open to using other language, eg php ?

    • 6 años atrás
  • thenamescarlos
    thenamescarlos
    • 6 años atrás

    Is there a known issue or specific reason with having "Todos" being the option selected for the box in the second line?

    • 6 años atrás
    1. victorarakawa
      Organizador del concurso
      • 6 años atrás

      Because I want all options. You can do it by each option, but I dont need that.

      • 6 años atrás
  • clackkensmith
    clackkensmith
    • 6 años atrás

    Hi !
    i am a scraper, bellow is project of my last customer :
    demo file : https://mega.co.nz/#!91YXDTzJ!hQOtqZzptKMJhcfKJSu5q120intcp9_0qgUD-xNLpoM or attach file
    Link get : http://www.gassaferegister.co.uk/registersearch/checkbusiness.aspx
    You can check by accountNumber at that page and check information.
    Bid me or message with me for detail about job.
    thank you !

    • 6 años atrás
  • knowledgeexcavat
    knowledgeexcavat
    • 6 años atrás

    Could you #increaseprize if work be done in 1 day?

    • 6 años atrás
  • talhamunir2002
    talhamunir2002
    • 6 años atrás

    hi cane we made script in c#

    • 6 años atrás
    1. talhamunir2002
      talhamunir2002
      • 6 años atrás

      okz....i can provide you data if needed and script in c#,if needed,ping me

      • 6 años atrás
    2. MEDIAPRONET
      MEDIAPRONET
      • 6 años atrás

      scrape price:20$ per 1000 records,also,if you want a bot,i can make it for 200$(without code)

      • 6 años atrás
  • TECHRONYX
    TECHRONYX
    • 6 años atrás

    # sealed plz

    • 6 años atrás
  • braedon213
    braedon213
    • 6 años atrás

    is the search working right now? it was working for me earlier but now anytime i search i get "Não existe nenhum resultado para essa busca"...

    • 6 años atrás
    1. victorarakawa
      Organizador del concurso
      • 6 años atrás

      Maybe you are trying a combination that has no results to show. E.g., there is no professional in the city with that specialty.

      • 6 años atrás
  • braedon213
    braedon213
    • 6 años atrás

    i don't see "CIRURGIA DO SISTEMA DIGESTIVO" under Especialidade.

    • 6 años atrás
    1. victorarakawa
      Organizador del concurso
      • 6 años atrás

      OK, I have just fixed that, you are right

      • 6 años atrás
    2. victorarakawa
      Organizador del concurso
      • 6 años atrás

      CIRURGIA DO APARELHO DIGESTIVO is the right option

      • 6 años atrás
  • braedon213
    braedon213
    • 6 años atrás

    I see "CIRURGIA DO APARELHO DIGESTIVO" and "CIRURGIA GERAL" however. Is SISTEMA the same as APARELHO?

    • 6 años atrás

Mostrar más comentarios

Cómo comenzar con los concursos

  • Publica tu concurso

    Publica tu concurso Fácil y rápido

  • Recibe montones de propuestas

    Consigue toneladas de propuestas De todo el mundo

  • Elige la mejor propuesta

    Elige la mejor propuesta ¡Descarga fácilmente los archivos!

Publica un concurso ahora o únete a nosotros hoy