Architected and developed AtoZDebug Hub, a full-stack web application for automating website data scraping, analysis, and management, while providing a public interface for designers to explore and filter site UIs. The platform combines real-time workflows, AI-generated content, and queue-based processing to streamline both internal administration and public browsing.
Key Highlights:
- End-to-End Development: Built frontend, backend, database, and infrastructure entirely independently.
- Admin Panel:
- Upload site URLs via CSV/Excel or manually; tasks are queued and processed asynchronously with Redis queues.
- Extract homepage and page metadata, screenshots, AI-generated descriptions, and site links.
- Queue individual page scrapes, trigger events on completion, and store results in MongoDB.
- Admins can review screenshots, validate content, and publish selected pages or designs.
- Real-time task progress updates provided via Server-Sent Events (SSE).
- Public-Facing Route:
- Allows designers to browse and filter site UIs and designs based on their preferences.
- Supports interactive search and exploration without exposing backend data or sensitive admin workflows.