• This project leverages Python, Selenium, and Django to automate web scraping, focusing on Product Scraping on scheduled interval. Data is then parsed using Beautiful Soup and stored in a Django database for ongoing analysis and tracking.
• The project utilizes Celery for task scheduling, enabling asynchronous scraping operations. By combining Selenium's browser automation with Django’s ORM capabilities, it efficiently collects and manages data, tracking trends over time. The integration of Redis for task queue management ensures smooth execution, while dynamic data handling techniques allow the scraper to adapt to changing website structures and content.