BeautifulSoup Jobs

Please pull the entire public Mortgage Broker database (URL will be shared as soon as we start) and give me a clean CSV file. For each record I only need 4 fields: the licensee’s full name, their and their cell-phone number and city. If the site paginates or hides the phone behind an extra click, the script still has to collect it. I’m happy with a one-off delivery right now, yet I’d like the code kept tidy so we can run it every month without rewriting anything. Feel free to use Python with Scrapy, BeautifulSoup, Selenium—or any stack you trust—as long as: • The final CSV opens without errors in Excel. • Every live record on the site is captured once, no duplicates. • The script, a short README, and any environment notes are included. ...

I need a Python-savvy content creator to produce a short course called “Introduction to Python Business Automation.” Scope • 5 tutorial videos, each 5–10 minutes. • Screen-recorded walkthroughs with clear voice-over narration (no on-camera shots or animation needed). Topics to cover 1. Data processing and analysis – simple CSV/Excel manipulation with pandas. 2. Web scraping – gathering data with requests and BeautifulSoup or similar. 3. Automating emails – generating and sending messages with smtplib. 4. Quick project that combines the above skills. 5. Recap and next steps for learners. What I expect • Well-structured scripts and live coding so beginners can follow line-by-line. • Clean, readable code and comme...

We are seeking a Junior Python Developer to assist with tasks for a data analysis project. You must have practical knowledge of Django, Flask, and BeautifulSoup, as well as experience implementing social auth and writing automated tests. This role requires a commitment of approximately 4 hours per day. We are looking for a reliable freelancer who writes clean code and can start immediately. Please place your bid with examples of your relevant work.

I need a compact desktop program written in Python that can automatically scrape data from a predefined set of web pages, clean or transform that information, and store it in a tidy format (CSV or SQLite—whichever you feel is more robust for the job). A simple GUI is required so I can paste in or update target URLs, press a single button, and watch the progress log inside the window while the app does the heavy lifting. Core workflow • Fetch the pages I specify, even if they sit behind basic HTTP auth or require a user-agent header. • Parse the relevant tables, lists, or JSON responses and strip out anything I don’t need. • Save the cleaned dataset locally, overwriting or versioning based on a toggle in the settings pane. I’m comfortable with widely...

I need a small script that will visit a specific site (I will share the URL and login details after award), locate every file that meets my criteria, and download those files to a local folder. The job is a single run only; once the files are saved, the task is complete. A lightweight Python solution is ideal; standard libraries such as requests, BeautifulSoup, or Selenium are all fine as long as the finished script: • Logs in or navigates past any simple gating the site uses • Crawls the relevant pages and identifies the target files (PDFs and ZIPs in my case) • Saves each file locally, keeping the original filename intact • Produces a short README so I can rerun the scraper later if needed Please keep the code clean, commented, and fully self-contained—...

I’m putting together a system that will regularly scrape multiple online sources for car-parts information and push the results into my product-testing database. The scraper has to collect every key data point I rely on—price, full specifications, product name, category, and any product codes—so I can run internal tests without manual look-ups. Here’s how I picture the workflow: the script (Python with Scrapy, BeautifulSoup or a similarly reliable stack) runs on a weekly schedule, reaches the target sites, extracts the fields above, cleans obvious duplicates, and stores everything in a structured format that my current database can ingest. If an API is available for a site, feel free to use it; otherwise, a robust HTML scraper is fine as long as it respects and ke...

I need a small service that watches pre-match moneyline odds on Coral around the clock and instantly lets me know—via Telegram—whenever those odds shift in ways I define. The bot must: pull the latest numbers in real time, compare them against a rolling baseline, decide whether the movement meets my rule set (percentage swings, fixed thresholds, or other logic we will finalise together), and then push a neatly formatted alert to my Telegram channel the moment it happens. Reliability is essential because the process will live 24/7 on my VPS. The code therefore has to handle network hiccups, bookmaker site changes, and the usual rate-limit surprises without falling over. Every quote the bot reads also needs to be written to a database so I can review historical price action late...

I’m looking for a well-structured Python solution, built around BeautifulSoup (BS4) and any supportive libraries you deem essential, that reliably pulls both product details and customer reviews from Lazada on a daily schedule. The data will fuel ongoing competitor research, so consistency and clarity of the output are critical. I looking specifically to get data using bs4 by bypassing the captcha Here’s how I picture the flow: • Input: category URL(s) or product list I supply in a CSV/JSON. • Scrape: title, price, promos, specs, images, ratings, full review texts, review dates, and reviewer scores. • Output: clean CSV or JSON dropped into a dated folder after each run. Make the script easy to tweak if Lazada changes its markup. Acceptance criteria 1. S...

I run several production-grade Python scripts on AWS EC2 that pull market-price data from up to five different websites and store the results in a SQL database. The scrapers are already built and live; what I need now is reliable, ongoing management and quick-turn updates whenever a source site changes its layout or blocking rules. The work centres on data-scraping updates, so you should feel comfortable tracing XPath/CSS changes, adjusting anti-bot measures, and ensuring the cron-driven jobs keep delivering fresh data. When an update is pushed, the pipeline must still land clean, well-typed rows in the existing database schema without breaking downstream queries. Typical tasks • Diagnose and fix failed scrape runs • Modify or extend selectors when sites update HTML or add ...

I’m looking for a reliable freelancer or data researcher to collect jewellery product listings from multiple e-commerce websites (the website links will be shared after the project starts) and deliver the data in a clean, well-structured CSV file. No scripts, tools, or code are required to be delivered — only the final data. Accuracy, consistency, and completeness are essential. Scope of Work Collect and compile a minimum of 200 jewellery products from the provided websites, capturing the following details for each product: Product name Full product description Price (with currency) Availability / stock status Product category (if mentioned on the website) Product image URLs (main image and additional images, where available) Product page URL All information must be...

I need a reliable script that pulls vendor contact phone numbers from popular e-commerce sites. The target data set is strictly phone numbers—no emails or physical addresses this time—paired with whatever identifying information is publicly displayed for each seller (store name, listing URL, etc.). Here’s what success looks like for me: • A repeatable Python solution (Scrapy, BeautifulSoup, or an equivalent you prefer) that navigates the chosen marketplaces, bypasses basic anti-bot measures, and extracts the phone numbers accurately. • A clean CSV or JSON file containing the scraped records, organized by seller name, phone number, and source page. • Brief usage notes so I can rerun or tweak the crawler later. If you already have proxy rotation or CA...

I want to scrape all legal text from EUR LEX (url here: ). The count is about a million documents. For every document please: • Download the official PDF in its original layout. • Pull the full plain text in BOTH English (EN) and German (DE). • Generate a companion JSON file per document containing: – document_id (as it appears in the URL), – year, – raw_text_en, – raw_text_de, – pdf_file_name set exactly to “<document_id>.pdf”. Folder structure can be simple—one directory that holds each PDF and its matching JSON with identical IDs. Accuracy matters because the data feeds directly into a research pipeline, so please handle character encoding and long parliamentary tables correctly. A lightweigh...

I want to scrape all legal text from EUR LEX (url here: ). The count is about a million documents. For every document please: • Download the official PDF in its original layout. • Pull the full plain text in BOTH English (EN) and German (DE). • Generate a companion JSON file per document containing: – document_id (as it appears in the URL), – year, – raw_text_en, – raw_text_de, – pdf_file_name set exactly to “<document_id>.pdf”. Folder structure can be simple—one directory that holds each PDF and its matching JSON with identical IDs. Accuracy matters because the data feeds directly into a research pipeline, so please handle character encoding and long parliamentary tables correctly. A lightweigh...

I need a reliable script that can visit the Truemed website, crawl every product page, and pull out two key pieces of information for each item: • the product name (with its full description) • the current price shown on the page The result should be delivered as a clean, well-structured CSV or JSON file, along with the runnable code so I can repeat the scrape whenever their catalogue changes. A Python solution using requests, BeautifulSoup, Scrapy, or a similar library will work best for me, but I’m open to other approaches if you explain the advantages. Please build in reasonable error handling, respect Truemed’s rules, and keep the run time efficient. If pagination, lazy-loaded content, or anti-bot measures appear, the script should be able to navigate o...