Build a Web Application in Django

We are building a website for monitoring the use and mentions of brands and trademarks on the internet. The platform will perform the following functions: 1. scrape pre-specified websites, dynamic URLs, PDF files, etc. on the internet 2. detect if specified phrases or words occur on the scraped pages 3. if specified phrases are found, parse the metadata on the pages in a pre-defined way, and save the structured data to a database 4. run a machine learning “classifier” on the structured data 5. perform additional actions depending on the machine learning output and account settings, for example send an email 6. display a dashboard to view tickets, display charts and statistics, and manage account settings, subscription etc Technical Architecture: 1. The dashboard will be connected to the backend using REST API. 2. It will be a microservices based infrastructure with every scraper module running independently. For the purpose of this project we will build two scraper modules but architecture should support more modules. 3. Classifier will be provided to you as an API endpoint. 4. We will use cloud infrastructure like AWS / Oracle Cloud. Possible Technologies & Integrations: ● Python / Django (& django-rest-framework) ● PostgreSQL / MongoDB ● Redis / RabbitMQ / Celery ● Angular / React ● D3 / Chart / Moris JS ● Scrapy ● Docker ● Stripe payment gateway Initial MVP Project Duration: 2 months 1. Create dashboard using an available template, and backend with API. Backend admin should allow manual entries of infringement events, brands etc which are shown on the dashboard via API. Stripe integration, user onboarding flow, PDF reports and email notifications should be built. Duration: 1 month 2. Build two scraper modules (‘video’ and ‘ecommerce’), Integrate ML (Amazon ML), build task queuing and define the architecture for scalability. Duration: 1 month.