16 Commity (4113d78a17eb1e11a0884018be525a5f9401f67e)

Autor	SHA1	Wiadomość	Data
Štěpán Škorpil	4113d78a17	It respects noindex option in mastodon	2022-11-22 17:01:25 +01:00
Štěpán Škorpil	704c7c066e	Added robots.txt handling	2022-11-22 16:37:11 +01:00
Štěpán Škorpil	45cafbe94b	Set mastodon page limit to 40	2022-11-22 10:57:34 +01:00
Štěpán Škorpil	29acce3906	Properly applied code quality tools	2022-09-18 13:32:25 +02:00
Štěpán Škorpil	f6f9d758a1	Replaced postgresql by elastic search	2022-09-14 21:16:04 +02:00
Štěpán Škorpil	7eb28e5d84	Enabled support for friendica	2022-05-29 15:55:53 +02:00
Štěpán Škorpil	b2725e5acf	Added nodeinfo content length limit (5k) solving issues with global redirects to endless streams	2022-04-18 22:18:43 +02:00
Štěpán Škorpil	cc42eebe0e	Added nodeinfo content length limit (5k) solving issues with global redirects to endless streams	2022-04-18 22:09:24 +02:00
Štěpán Škorpil	3ed37c04ce	Not existing feeds are deleted from databse	2022-04-17 14:03:53 +02:00
Štěpán Škorpil	cefbd76066	Added support for ecko and hometown	2022-03-04 20:17:53 +01:00
Štěpán Škorpil	b2eab401ec	Fixed Misskey nullable user properties	2022-01-08 19:25:44 +01:00
Štěpán Škorpil	32ad01a849	Added misskey	2022-01-08 19:13:56 +01:00
Štěpán Škorpil	945c9495f5	Added pleroma	2022-01-08 02:16:16 +01:00
Štěpán Škorpil	45bb0569c0	Improved peertube description parsing	2022-01-03 14:05:00 +01:00
Štěpán Škorpil	0c2ade0b52	Added more env configs	2022-01-03 13:26:17 +01:00
Štěpán Škorpil	74e7dca8bd	Initial crawler commit	2021-12-23 15:14:06 +01:00