bridgy-fed/static/robots.txt

kopia lustrzana https://github.com/snarfed/bridgy-fed
User-agent: *
Disallow: /*?*
Disallow: /user/*
Disallow: /recent*
Disallow: /r/*
start on home page html, style, and assets 2017-08-18 14:31:31 +00:00			`User-agent: *`
			`Disallow: /?`
add /user/* to robots.txt, style tweak 2022-11-12 16:33:42 +00:00			`Disallow: /user/*`
add /recent to robots.txt 2022-11-18 14:54:57 +00:00			`Disallow: /recent*`
add /r/* redirects to robots.txt 2023-01-11 16:55:31 +00:00			`Disallow: /r/*`