Wykres commitów

23 Commity (0c17d0a40e83fdec308c9f50e9145336b6d59d2c)

Autor SHA1 Wiadomość Data
Ryan Barrett 0c17d0a40e
remove /memcache_command and /python_eval
too scary to have in the codebase even with auth around them
2025-01-14 12:48:45 -08:00
Ryan Barrett 9eaab23bcc
hook up python eval endpoint up in router, hub 2025-01-10 10:21:40 -08:00
Ryan Barrett a5371582b1
add temporary python eval debugging endpoint to all three services 2025-01-10 09:33:39 -08:00
Ryan Barrett 91b268fa4f
unify ndb_client.context() kwargs into common.NDB_CONTEXT_KWARGS 2024-12-18 15:44:35 -08:00
Ryan Barrett 80d510f9bb
stop logging "Task ..." in atproto-commit, atproto-poll-chat tasks
goes with snarfed/webutil@c1b5685166

for #1149
2024-12-02 18:19:52 -08:00
Ryan Barrett 4c4a862a1b
atproto-hub: add 67.213.161.32/29 IP block for Bluesky
https://github.com/bluesky-social/atproto/discussions/3036#discussioncomment-11431550
2024-12-01 19:13:16 -08:00
Ryan Barrett 17ca06b60e
/admin/atproto: add zip.zayo as bluesky host
maybe? https://github.com/bluesky-social/atproto/discussions/3036#discussioncomment-11399854
2024-11-28 10:27:01 -08:00
Ryan Barrett fcfc0474b4
atproto_hub: drop handle threads down from 100 to 10
for #1315, maybe
2024-10-01 12:30:26 -07:00
Ryan Barrett 0e5e2a5a1e
drop memory for router, atproto-hub 2024-09-22 07:53:07 -07:00
Ryan Barrett 3dc3330603
code doc and docstring tweaks 2024-09-12 13:05:41 -07:00
Ryan Barrett e169ef0ebc
atproto-hub to 100 handle threads and 4G memory, router to 8 cores
we're now caught up back to realtime on the ATProto firehose

for #1295
2024-09-07 13:59:39 -07:00
Ryan Barrett 9496957819
atproto_firehose: move CPU-bound filtering back onto main subscribe thread
effectively reverts 5b280dc235 and e7c6ced26a

for #1295
2024-09-06 18:45:40 -07:00
Ryan Barrett 133859e7c5
atproto_firehose: drop handle threads down to 1
fixes https://console.cloud.google.com/errors/detail/CJrBqKnRzPfNRA;time=PT1H;refresh=true;locations=global?project=bridgy-federated
2024-09-05 13:22:58 -07:00
Ryan Barrett e7c6ced26a
atproto_firehose: parallelize CBOR parsing
switch to putting raw websocket frame bytes onto queue, then threads parse it. for #1266
2024-09-03 12:15:25 -07:00
Ryan Barrett 19430a2777
atproto_firehose: run multiple handle threads. start with 10
for #1266
2024-08-30 13:34:07 -07:00
Ryan Barrett e9dc38c75c
actually turn on ndb global cache with global_cache_policy
🤦
2024-08-01 12:42:13 -07:00
Ryan Barrett d59e662129
atproto_hub fix for 4097fe7 2024-08-01 12:16:45 -07:00
Ryan Barrett 4097fe71fb
use ndb in-memory context cache for DID doc Objects
for #1149
2024-08-01 12:09:37 -07:00
Ryan Barrett 6d1c641d7e
atproto_hub /admin/atproto: convert subscriber timestamps to PT 2024-07-15 15:11:05 -07:00
Ryan Barrett 56b9509663
atproto_hub /admin/atproto: highlight bluesky team servers 2024-07-14 09:24:49 -07:00
Ryan Barrett 732f2d2a60
add /admin/atproto for rendering current subscribeRepos clients 2024-07-14 09:08:11 -07:00
Ryan Barrett 2386e92416
atproto_hub: send requestCrawl to bsky.network every 5m
recommended by Jaz, the relay is usually good about reconnecting, but not perfect, and doesn't retry forever. https://discord.com/channels/1097580399187738645/1097580399187738648/1261023248079126529
2024-07-12 07:50:54 -07:00
Ryan Barrett 616073f788
merge hub and atproto_firehose services into a single service, atproto_hub
atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together.
2024-06-13 12:02:54 -07:00