~matthj thanks for the ideas.

This may be a misunderstanding of how Scribe gets its data. It uses an undocumented GraphQL api that does not expect any user agent strings or have JS enabled. I tried adding the user agent idea anyway and it actually blocked my requests 🙃

If you have any other ideas let me know.

The only 2 things I can think of is to:

-change user-agent to a web crawler (e.g. Googlebot, or Bing's web crawler user agent)

-disable javascript when fetching for content