# The Adnyeus Archive — https://theadnyeusarchive.app # # The human-facing pages are meant to be indexed. The raw JSON the app fetches # is not: it is an implementation detail, it changes shape between builds, and # a search engine indexing it produces results that dump data at a visitor # instead of showing them the page that explains it. # # Worth being clear about the limits of this file. robots.txt is a REQUEST, # honoured by well-behaved crawlers and ignored by everything else, and it only # governs this origin — the same JSON is also served from the public jsDelivr # CDN in front of the public BSRData repo, where these rules do not apply and # cannot. Nothing here should be mistaken for access control. User-agent: * # Structural data — the per-record files and the manifests that point at them. Disallow: /Characters/ Disallow: /Banners/ Disallow: /Teams/ Disallow: /Data/ Disallow: /Contributors/*.json # Build plumbing, not content. Disallow: /version.json Allow: /