bridgy-fed/static/robots.txt

kopia lustrzana https://github.com/snarfed/bridgy-fed
User-agent: *
Disallow: /*?*
Disallow: /ap/
Disallow: /atp/
Disallow: /bluesky/
Disallow: /convert/
Disallow: /nostr/
Disallow: /recent
Disallow: /r/
Disallow: /user/
Disallow: /web/
start on home page html, style, and assets 2017-08-18 14:31:31 +00:00			`User-agent: *`
			`Disallow: /?`
robots.txt bug fix hopefully this fixes /r/ pages showing up in google search 2023-11-02 21:07:08 +00:00			`Disallow: /ap/`
			`Disallow: /atp/`
			`Disallow: /bluesky/`
			`Disallow: /convert/`
			`Disallow: /nostr/`
			`Disallow: /recent`
			`Disallow: /r/`
			`Disallow: /user/`
			`Disallow: /web/`