Wykres commitów

30 Commity (0484570fbe8be4462dd99a2a746409cc2bf4cd44)

Autor SHA1 Wiadomość Data
Ryan Barrett ffd2be6c4b
turn google.cloud logging propagate on; fixes ndb logs!
google.cloud logging propagate is why I haven't been able to get ndb logs to
show up! phew, finally found it.

8c2c5a798a/google/cloud/logging_v2/handlers/handlers.py (L302-L314)
2025-01-13 12:43:02 -08:00
Ryan Barrett 2a4ac246a4
temporarily enable ndb logging 2025-01-11 15:24:05 -08:00
Ryan Barrett 545877f154
atproto-hub: drop back down to 1 core 2025-01-01 19:48:03 -08:00
Ryan Barrett 6dcd355bf5
run router and atproto-hub in default VPC
https://cloud.google.com/appengine/docs/flexible/using-shared-vpc
https://cloud.google.com/appengine/docs/flexible/reference/app-yaml#network_settings
https://cloud.google.com/vpc/docs/serverless-vpc-access#supported_services

for #1149
2024-12-20 12:49:01 -08:00
Ryan Barrett 77bb1c8ef5
disable ndb logging 2024-12-19 13:24:46 -08:00
Ryan Barrett 305f23f013
bump atproto-hub up to 2 cores
for snarfed/arroba#39
2024-12-19 12:50:48 -08:00
Ryan Barrett b4270a5d4e
temporarily turn on ndb logging for cache and lookups
for #1149
2024-12-19 12:28:51 -08:00
Ryan Barrett ca6e37bfe0
atproto-hub: drop subscribeRepos rollback window back down to 50k seqs
roughly 12-18h. for snarfed/arroba#30, snarfed/arroba#39
2024-12-19 11:36:18 -08:00
Ryan Barrett d3490cab82
set up, but don't enable, ndb debug logging
for #1149
2024-12-18 16:00:20 -08:00
Ryan Barrett 9af6238827
temporarily enable debug level ndb logging
for #1149

c55ec62b51/google/cloud/ndb/utils.py (L78-L81)
2024-12-18 15:16:17 -08:00
Ryan Barrett 5d6d68b5e7
cache models.get_original_user/object_key queries in memcache
adds new generic common.memcache_memoize decorator for caching any function's output in memcache. for #1149
2024-12-11 20:17:36 -08:00
Ryan Barrett cead24a5b4
atproto-hub: bump rollback window up to 200k seqs 2024-11-22 19:41:03 -08:00
Ryan Barrett 5127a6406a
router back up to 10 cores, atproto-hub to 6G memory 2024-11-21 15:55:10 -08:00
Ryan Barrett ae4c758d44
service configs: drop router to max 6 instances, hub rollback window to 50k 2024-11-20 16:28:39 -08:00
Ryan Barrett ec556e9bc1
hub: bump memory up to 4G, subscribeRepos rollback window to 100k seqs
for #1266
2024-11-18 14:39:13 -08:00
Ryan Barrett 60dcaee014
atproto-hub: set 10s subscribeRepos batch delay
see https://github.com/snarfed/arroba/issues/36
2024-11-05 10:46:10 -08:00
Ryan Barrett 0e5e2a5a1e
drop memory for router, atproto-hub 2024-09-22 07:53:07 -07:00
Ryan Barrett 60c92e1465
upgrade App Engine app runtime to python 3.12
https://cloud.google.com/appengine/docs/standard/reference/app-yaml?tab=python#runtime

https://cloud.google.com/appengine/docs/flexible/python/runtime#recommended_gunicorn_configuration
2024-09-09 21:58:52 -07:00
Ryan Barrett 9112c519b4
drop atproto-hub down to 1 core
for #1295
2024-09-07 21:07:37 -07:00
Ryan Barrett e169ef0ebc
atproto-hub to 100 handle threads and 4G memory, router to 8 cores
we're now caught up back to realtime on the ATProto firehose

for #1295
2024-09-07 13:59:39 -07:00
Ryan Barrett 909213488f
drop atproto-hub back down to 2 cores, 13G memory 2024-09-03 12:15:25 -07:00
Ryan Barrett e7c6ced26a
atproto_firehose: parallelize CBOR parsing
switch to putting raw websocket frame bytes onto queue, then threads parse it. for #1266
2024-09-03 12:15:25 -07:00
Ryan Barrett 8ad8565295
atproto_firehose: don't log #account, #identity, #handle events 2024-08-30 09:17:58 -07:00
Ryan Barrett c0c801de58
drop bluesky sandbox env vars, it's dead now
https://docs.bsky.app/blog/federation-sandbox
2024-07-22 20:44:18 -07:00
Ryan Barrett 2176223038
app configs: leaning into cargo-culting liveness_check.initial_delay_sec
https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#liveness_checks
2024-07-15 08:46:35 -07:00
Ryan Barrett 1a23d8eba3
Protocol.targets: when adding in-reply-to, check from user's enabled protocols
fixes https://console.cloud.google.com/errors/detail/CMHloZaRmPXQZQ;time=P7D?project=bridgy-federated
2024-07-14 13:42:38 -07:00
Ryan Barrett 732f2d2a60
add /admin/atproto for rendering current subscribeRepos clients 2024-07-14 09:08:11 -07:00
Ryan Barrett 47de59e31c
drop atproto-hub service down to one core, 2G memory
had it higher for a while when we tried serving getRepo from it, but that didn't last. it's currently at ~40-50% CPU on one core, ~600M memory.
2024-07-09 12:38:39 -07:00
Ryan Barrett 850d681f83
add Protocol.SUPPORTED_AS1_TYPES 2024-07-04 16:58:06 -07:00
Ryan Barrett 616073f788
merge hub and atproto_firehose services into a single service, atproto_hub
atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together.
2024-06-13 12:02:54 -07:00