Open-source Instagram scraping tool for extracting public profiles, posts, comments, hashtags, and media metadata, made by using Python and Playwright.
We have made an open-source tool based on Playwright browser automation, it is a system that takes a list of usernames or a string of hashtags or profile links, then it searched across public data on Instagram and scrapes business emails, phone numbers, bio links, follower counts, account verified badges along with full comment trees and media CDNs. It can also search by location label or hashtags to find latest posts that matches user requirements. All it needs is input in the form of a CSV file or an API call.
- Instagram Profile Scraping It can scrape multiple types of data from Instagram public profiles like Username, Display name, Business emails, Phone Numbers, Biography, Followers, Following, Post count, Verification status and Profile URL whatever the user wants.
- Instagram Post Scraping It can search and find multiple posts on instagram and scrape Post URL, Caption, Timestamp, Like count, Comment count, Media type and Media metadata
- Instagram Comment Tree Scraping It can extract full comment trees in which we can clearly find top comments and we can analyze frequent comment sentiment of any post, also it is fully capable of extracting Comment text and Username, along with Timestamps, Like count, Replies
- Instagram Hashtag Scraping and Location Feeds It can extract Hashtags, related public posts with Post metadata too, and it can also find recent posts by searching by hashtags and location labels. It paginates across latest posts matching the input target hashtags or geotags.
- Media Metadata Extraction It is also capable of extracting medis CDNs, including Media type, Media URL, Metadata and Captions
- Import/Export Functionalities You can either upload a CSV file containing target input data to scrape, or we also provide API calls feature for developers ease of use and integration. More over scraped/extracted data can be exported in JSON or CSV format. We also allows PostrgerSQL export format. No login is required to use this tool.
- Structured Data Export This setup is capable of formatting or saving any kind of data extracted in Normalized form in relational tables or multiple flat files. It can write directly to PostgreSQL tables or can export data in UTF-8 CSV format and JSNOL files.
- Configurable Rate Limiting It performs fingerprint masking through custom Chromium Flags, applies Canvas, WebGL and Audio context noise with automated residential proxy rotation (by Playwright) along with doing automated session jitter to bypass challenge checkpoints. Thats how it does rate limiting by rotation of proxies, handling DOM Paginations, and generating randomized delays to mimic human behaviour.
- Playwright (Main stack for doing browser automation by API)
- Python (Language used)
- PostgreSQL Database
- If you are a marketing agency and you want to get aggregated verified business contact lists, or you belong to a market intelligence teams who need to monitor the competitors campaign frequency, comment sentiments for any post for doing PR, or you want good promotional hashtags or you want any public data from Instagram and want to automate data collection, this is for you.
It can extract publicly accessible information such as usernames, profile details, follower counts, post captions, timestamps, likes, comment counts, comments, hashtags, and media metadata, which ever you want.
It supports structured data export in formats,
- JSON
- JSONL
- CSV
No. The project is designed for publicly accessible Instagram data only. It skips private accounts.