- The application was supposed to scrape data from thousands of sources (webpages, PDFs, XMLs etc.)
- Created the application from scratch. Designed, and co
- The application was supposed to scrape data from thousands of sources (webpages, PDFs, XMLs etc.)
- Created the application from scratch. Designed, and completed the project single handedly. Worked with the client to understand their needs.
- Wrote web crawlers / scrapers for collecting data from thousands of webpages / documents from the internet.
- Captured the data in the structured format, and stored in various sources (Excel and MySQL database) for later analysis.
- Technologies: Python3 (BeautifulSoup, Scrapy, OpenPyXL, PyMySQL, LXML), MySQL, Git
Comments