A web scrapper that scrapes data from amazon using bright data. Have also utilized firebase cloud functions by calling them through bright data webhooks to make all the integration seamless. The brightdata Web Scraper IDE lets us easily scrape websites at scale. And extract data in the format you need
This project consist of:
- A frontend build in nextjs which is powered by realtime firestore db to fetch results.
- The backend consists of a firebase cloud function which is attached to brightdata webhook and is used to store results to the firestore database.
- Interaction scripts in js added to bright data workers to scrape results from amazon.
Tech Stack: ( Nextjs / Typescript / Tailwindcss / Firebase / Brightdata )