mirror
/
fedicrawl
kopia lustrzana https://github.com/Stopka/fedicrawl
1
0
Forkuj 0
Kod Zgłoszenia Projekty Wydania Wiki Aktywność

Wykres commitów

  • 4fbfce7f12 Added support for popular Pleroma and Misskey forks main Štěpán Škorpil 2023-01-07 21:03:17 +0100
  • 87f5ddc8b1 If nodeinfo refresh is failed, software name and version is unset Štěpán Škorpil 2022-12-27 22:40:15 +0100
  • a8e6dbdb9d Fixed old feed deleting Štěpán Škorpil 2022-12-27 22:11:19 +0100
  • 425abd5af0 Added domain validation Štěpán Škorpil 2022-12-10 15:11:56 +0100
  • 1cbd5df5ae Added config for seed domain timeout Štěpán Škorpil 2022-11-29 14:11:27 +0100
  • 6a11d19781 Added crawling depth limit Štěpán Škorpil 2022-11-24 00:39:17 +0100
  • 0723c2508d Fixed robots.txt fetching Štěpán Škorpil 2022-11-23 23:34:05 +0100
  • 4064db521f Added promise batching Štěpán Škorpil 2022-11-23 23:19:28 +0100
  • 8f42791ee2 Added timeout to robots.txt fetching Štěpán Škorpil 2022-11-22 18:52:24 +0100
  • 59f49ce29d Changed tag from noindex to nobot Štěpán Škorpil 2022-11-22 18:39:05 +0100
  • c0b10f2e7a It respects noindex option in mastodon Štěpán Škorpil 2022-11-22 17:35:34 +0100
  • 4113d78a17 It respects noindex option in mastodon Štěpán Škorpil 2022-11-22 17:01:25 +0100
  • 704c7c066e Added robots.txt handling Štěpán Škorpil 2022-11-22 16:37:11 +0100
  • 8d0452d16b Set mastodon page limit to 40 Štěpán Škorpil 2022-11-22 11:00:24 +0100
  • 45cafbe94b Set mastodon page limit to 40 Štěpán Škorpil 2022-11-22 10:57:34 +0100
  • 29acce3906 Properly applied code quality tools Štěpán Škorpil 2022-09-18 13:32:25 +0200
  • 405cf2f181 Dockerfile: Fixed node version mismatch Štěpán Škorpil 2022-09-14 22:05:07 +0200
  • 4415c27b1b Deploy fixes Štěpán Škorpil 2022-09-14 21:47:11 +0200
  • f6f9d758a1 Replaced postgresql by elastic search Štěpán Škorpil 2022-09-14 21:16:04 +0200
  • 7eb28e5d84 Enabled support for friendica Štěpán Škorpil 2022-05-29 15:55:53 +0200
  • b2725e5acf Added nodeinfo content length limit (5k) solving issues with global redirects to endless streams Štěpán Škorpil 2022-04-18 22:18:43 +0200
  • cc42eebe0e Added nodeinfo content length limit (5k) solving issues with global redirects to endless streams Štěpán Škorpil 2022-04-18 22:09:24 +0200
  • 3ed37c04ce Not existing feeds are deleted from databse Štěpán Škorpil 2022-04-17 14:03:53 +0200
  • cefbd76066 Added support for ecko and hometown Štěpán Škorpil 2022-03-04 20:17:53 +0100
  • 5c0a032ed7 Software name forced to lower case Štěpán Škorpil 2022-01-15 01:48:45 +0100
  • ac27cdd03a Updated software support info Štěpán Škorpil 2022-01-08 22:24:18 +0100
  • b2eab401ec Fixed Misskey nullable user properties Štěpán Škorpil 2022-01-08 19:25:44 +0100
  • 32ad01a849 Added misskey Štěpán Škorpil 2022-01-08 19:13:56 +0100
  • 945c9495f5 Added pleroma Štěpán Škorpil 2022-01-08 02:16:16 +0100
  • de5e989bbb Fixed refactoring mess Štěpán Škorpil 2022-01-07 23:56:40 +0100
  • 45bb0569c0 Improved peertube description parsing Štěpán Škorpil 2022-01-03 14:05:00 +0100
  • 0c2ade0b52 Added more env configs Štěpán Škorpil 2022-01-03 13:26:17 +0100
  • a83039e9ab Fixed prod deploy Štěpán Škorpil 2022-01-01 20:33:19 +0100
  • 8330ed53c4 Fixed README.md Štěpán Škorpil 2022-01-01 17:33:03 +0100
  • b5df2b986a Added addresses to fulltext Štěpán Škorpil 2022-01-01 12:21:43 +0100
  • d2ab8bfb2f Add display name to fulltext field, fixed waiting when all feeds are processed Štěpán Škorpil 2021-12-28 00:20:19 +0100
  • 3acd0ec72f Added fulltext feed column Štěpán Škorpil 2021-12-23 18:46:43 +0100
  • 74e7dca8bd Initial crawler commit Štěpán Škorpil 2021-12-23 15:14:06 +0100