Skip to content

Instagram posts scraper broken by latest insta update #144

Description

@alukan

Scraper
Instagram posts scraper

Describe the bug
scrape_post returns null data when querying https://www.instagram.com/graphql/query with doc_id=8845758582119845. The response body is {"errors":[{"message":"execution
error","severity":"CRITICAL"}],"data":null,"status":"ok"}.

Received Output
{
"errors": [
{
"message": "execution error",
"severity": "CRITICAL"
}
],
"data": null,
"status": "ok"
}

Expected Output
{
"data": {
"xdt_shortcode_media": {
"shortcode": "DAE-iFct739",
"edge_media_preview_like": { "count": ... },
"edge_media_to_parent_comment": { "count": ... },
"video_view_count": ...
}
}
}

Additional context

  • Script: scrapfly-insta.py from scrapfly.io/blog/how-to-scrape-instagram
  • Config: asp=True, country="CA"
  • Endpoint: POST https://www.instagram.com/graphql/query
  • doc_id: 8845758582119845 (taken directly from the blog article)
  • Test shortcode: DAE-iFct739
  • The same doc_id also fails when tested directly via Node.js with a residential proxy, suggesting the doc_id itself may be stale/rotated by Instagram

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions