Tao Bojlén
|
1ccb2a84a1
|
Revert "remove elasticsearch"
This reverts commit b7cb7fa685 .
|
2023-06-10 11:40:16 +01:00 |
Tao Bojlén
|
4d4193ff49
|
fix crawls of well-connected instances
|
2023-06-10 09:36:03 +01:00 |
Tao Bojlén
|
b7cb7fa685
|
remove elasticsearch
|
2023-06-08 23:27:13 +01:00 |
Tao Bojlén
|
9078c0315d
|
sanitize HTML in backend
|
2020-05-27 14:38:52 +01:00 |
Tao Bror Bojlén
|
637278ad74
|
fix some unsuccesful crawls being saved without error
|
2019-10-01 16:05:09 +01:00 |
Tao Bror Bojlén
|
f134941eb2
|
display federation restrictions
|
2019-08-29 17:54:34 +01:00 |
Tao Bojlén
|
693cf2b2d9
|
improved edges
|
2019-08-27 13:50:16 +00:00 |
Tao Bror Bojlén
|
1bf600b1ac
|
fix domain cleaning
|
2019-08-22 11:50:49 +02:00 |
Tao Bror Bojlén
|
c2124468a7
|
fail if some peers are invalid
|
2019-08-21 22:29:15 +02:00 |
Tao Bojlén
|
3360f4c28e
|
Lint backend
|
2019-08-21 12:30:47 +00:00 |
Tao Bror Bojlén
|
f033b1eec0
|
add friendica crawler
|
2019-08-18 15:27:50 +02:00 |
Tao Bror Bojlén
|
2c035892d4
|
add most recent crawl table
|
2019-08-10 16:21:22 +03:00 |
Tao Bojlén
|
3320e050c8
|
Revert "add metadata endpoint"
This reverts commit 82153b283b3be8e7a48da92a6d02d05ef28e98c5.
|
2019-08-09 16:59:51 +00:00 |
Tao Bror Bojlén
|
30c5bbe2b9
|
only save successful crawls in db
|
2019-08-07 22:41:19 +03:00 |
Tao Bojlén
|
f0f3f76f6c
|
handle crawl timestamps in db
|
2019-08-07 16:53:34 +00:00 |
Tao Bojlén
|
75e66affe3
|
Add misskey crawler
|
2019-08-06 18:04:30 +00:00 |
Tao Bror Bojlén
|
76ebf50c40
|
never display opted-out instances anywhere
|
2019-08-03 00:09:09 +03:00 |
Tao Bror Bojlén
|
287c7b5624
|
normalize instance names
|
2019-08-02 22:46:40 +03:00 |
Tao Bror Bojlén
|
09708e74ab
|
update ES index on crawl
|
2019-08-02 19:03:21 +03:00 |
Tao Bror Bojlén
|
ea0fae2152
|
don't add domains to the queue twice
|
2019-07-27 16:22:39 +03:00 |
Tao Bror Bojlén
|
74fc30e8a5
|
don't log crawl times with appsignal
|
2019-07-27 13:57:07 +03:00 |
Tao Bojlén
|
79257f1cbe
|
Setup appsignal
|
2019-07-27 10:13:42 +00:00 |
Tao Bojlén
|
490b518587
|
Save base domain
|
2019-07-25 15:56:03 +00:00 |
Tao Bojlén
|
3b515c3a36
|
Color code graph
|
2019-07-24 15:51:44 +00:00 |
Tao Bojlén
|
2cae5dccbf
|
check robots.txt for permission to crawl
|
2019-07-19 20:00:28 +00:00 |
Tao Bojlén
|
5fafffc404
|
frontend/cytoscape feature parity
|
2019-07-19 18:19:53 +00:00 |
Tao Bror Bojlén
|
9478017eb0
|
fix edge generation, serve graph in cytoscape format
|
2019-07-18 13:21:12 +03:00 |
Tao Bojlén
|
a37452f138
|
refactor/elixir backend
|
2019-07-14 11:47:06 +00:00 |