Consistently being to be consistent

devto

kolli gobardan durga Reddy  • Peerlist

Instagram Scraper — Built with Puppeteer + Stealth + Proxy RotationI’ve been hacking on an Instagram Scraper that can fetch profile analytics and post details without requiring login.<h3>What it does</h3><ul><li>Scrapes public profile data: username, name, profile picture, followers, following, post count.</li><li>Collects post details: captions, thumbnails, full-size images, likes, comments, timestamps.</li><li>Computes engagement metrics (avg likes/comments, engagement rate).</li><li>Supports configurable sample size (default: 5 posts, but adjustable via API query).</li></ul><h3> Tech stack</h3><ul><li>Node.js + Express backend API</li><li>Puppeteer-core with puppeteer-extra + stealth plugin to evade detection</li><li>Proxy rotation (via puppeteer-page-proxy) to avoid IP bans &amp; distribute requests</li><li>Concurrency optimizations → profile page is fetched once, then posts are scraped in parallel</li><li>Optional CORS-enabled API so it can integrate with a frontend dashboard</li></ul>