invidious/assets/robots.txt

kopia lustrzana https://github.com/iv-org/invidious
User-agent: *
Disallow: /search
Disallow: /login
Disallow: /watch
Add robots.txt 2018-02-06 00:11:59 +00:00			`User-agent: *`
Ignore login in robots.txt 2018-03-25 04:15:03 +00:00			`Disallow: /search`
Disallow /watch path for bots again 2021-06-14 08:40:59 +00:00			`Disallow: /login`
			`Disallow: /watch`