6 Commity (c0b10f2e7ae62a347bde4686052c85672f510ba1)

Autor	SHA1	Wiadomość	Data
Štěpán Škorpil	c0b10f2e7a	It respects noindex option in mastodon	2022-11-22 17:35:34 +01:00
Štěpán Škorpil	4113d78a17	It respects noindex option in mastodon	2022-11-22 17:01:25 +01:00
Štěpán Škorpil	704c7c066e	Added robots.txt handling	2022-11-22 16:37:11 +01:00
Štěpán Škorpil	29acce3906	Properly applied code quality tools	2022-09-18 13:32:25 +02:00
Štěpán Škorpil	f6f9d758a1	Replaced postgresql by elastic search	2022-09-14 21:16:04 +02:00
Štěpán Škorpil	74e7dca8bd	Initial crawler commit	2021-12-23 15:14:06 +01:00