Ryan Barrett
|
ffd2be6c4b
|
turn google.cloud logging propagate on; fixes ndb logs!
google.cloud logging propagate is why I haven't been able to get ndb logs to
show up! phew, finally found it.
8c2c5a798a/google/cloud/logging_v2/handlers/handlers.py (L302-L314)
|
2025-01-13 12:43:02 -08:00 |
Ryan Barrett
|
2a4ac246a4
|
temporarily enable ndb logging
|
2025-01-11 15:24:05 -08:00 |
Ryan Barrett
|
545877f154
|
atproto-hub: drop back down to 1 core
|
2025-01-01 19:48:03 -08:00 |
Ryan Barrett
|
6dcd355bf5
|
run router and atproto-hub in default VPC
https://cloud.google.com/appengine/docs/flexible/using-shared-vpc
https://cloud.google.com/appengine/docs/flexible/reference/app-yaml#network_settings
https://cloud.google.com/vpc/docs/serverless-vpc-access#supported_services
for #1149
|
2024-12-20 12:49:01 -08:00 |
Ryan Barrett
|
77bb1c8ef5
|
disable ndb logging
|
2024-12-19 13:24:46 -08:00 |
Ryan Barrett
|
305f23f013
|
bump atproto-hub up to 2 cores
for snarfed/arroba#39
|
2024-12-19 12:50:48 -08:00 |
Ryan Barrett
|
b4270a5d4e
|
temporarily turn on ndb logging for cache and lookups
for #1149
|
2024-12-19 12:28:51 -08:00 |
Ryan Barrett
|
ca6e37bfe0
|
atproto-hub: drop subscribeRepos rollback window back down to 50k seqs
roughly 12-18h. for snarfed/arroba#30, snarfed/arroba#39
|
2024-12-19 11:36:18 -08:00 |
Ryan Barrett
|
d3490cab82
|
set up, but don't enable, ndb debug logging
for #1149
|
2024-12-18 16:00:20 -08:00 |
Ryan Barrett
|
9af6238827
|
temporarily enable debug level ndb logging
for #1149
c55ec62b51/google/cloud/ndb/utils.py (L78-L81)
|
2024-12-18 15:16:17 -08:00 |
Ryan Barrett
|
5d6d68b5e7
|
cache models.get_original_user/object_key queries in memcache
adds new generic common.memcache_memoize decorator for caching any function's output in memcache. for #1149
|
2024-12-11 20:17:36 -08:00 |
Ryan Barrett
|
cead24a5b4
|
atproto-hub: bump rollback window up to 200k seqs
|
2024-11-22 19:41:03 -08:00 |
Ryan Barrett
|
5127a6406a
|
router back up to 10 cores, atproto-hub to 6G memory
|
2024-11-21 15:55:10 -08:00 |
Ryan Barrett
|
ae4c758d44
|
service configs: drop router to max 6 instances, hub rollback window to 50k
|
2024-11-20 16:28:39 -08:00 |
Ryan Barrett
|
ec556e9bc1
|
hub: bump memory up to 4G, subscribeRepos rollback window to 100k seqs
for #1266
|
2024-11-18 14:39:13 -08:00 |
Ryan Barrett
|
60dcaee014
|
atproto-hub: set 10s subscribeRepos batch delay
see https://github.com/snarfed/arroba/issues/36
|
2024-11-05 10:46:10 -08:00 |
Ryan Barrett
|
0e5e2a5a1e
|
drop memory for router, atproto-hub
|
2024-09-22 07:53:07 -07:00 |
Ryan Barrett
|
60c92e1465
|
upgrade App Engine app runtime to python 3.12
https://cloud.google.com/appengine/docs/standard/reference/app-yaml?tab=python#runtime
https://cloud.google.com/appengine/docs/flexible/python/runtime#recommended_gunicorn_configuration
|
2024-09-09 21:58:52 -07:00 |
Ryan Barrett
|
9112c519b4
|
drop atproto-hub down to 1 core
for #1295
|
2024-09-07 21:07:37 -07:00 |
Ryan Barrett
|
e169ef0ebc
|
atproto-hub to 100 handle threads and 4G memory, router to 8 cores
we're now caught up back to realtime on the ATProto firehose
for #1295
|
2024-09-07 13:59:39 -07:00 |
Ryan Barrett
|
909213488f
|
drop atproto-hub back down to 2 cores, 13G memory
|
2024-09-03 12:15:25 -07:00 |
Ryan Barrett
|
e7c6ced26a
|
atproto_firehose: parallelize CBOR parsing
switch to putting raw websocket frame bytes onto queue, then threads parse it. for #1266
|
2024-09-03 12:15:25 -07:00 |
Ryan Barrett
|
8ad8565295
|
atproto_firehose: don't log #account, #identity, #handle events
|
2024-08-30 09:17:58 -07:00 |
Ryan Barrett
|
c0c801de58
|
drop bluesky sandbox env vars, it's dead now
https://docs.bsky.app/blog/federation-sandbox
|
2024-07-22 20:44:18 -07:00 |
Ryan Barrett
|
2176223038
|
app configs: leaning into cargo-culting liveness_check.initial_delay_sec
https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#liveness_checks
|
2024-07-15 08:46:35 -07:00 |
Ryan Barrett
|
1a23d8eba3
|
Protocol.targets: when adding in-reply-to, check from user's enabled protocols
fixes https://console.cloud.google.com/errors/detail/CMHloZaRmPXQZQ;time=P7D?project=bridgy-federated
|
2024-07-14 13:42:38 -07:00 |
Ryan Barrett
|
732f2d2a60
|
add /admin/atproto for rendering current subscribeRepos clients
|
2024-07-14 09:08:11 -07:00 |
Ryan Barrett
|
47de59e31c
|
drop atproto-hub service down to one core, 2G memory
had it higher for a while when we tried serving getRepo from it, but that didn't last. it's currently at ~40-50% CPU on one core, ~600M memory.
|
2024-07-09 12:38:39 -07:00 |
Ryan Barrett
|
850d681f83
|
add Protocol.SUPPORTED_AS1_TYPES
|
2024-07-04 16:58:06 -07:00 |
Ryan Barrett
|
616073f788
|
merge hub and atproto_firehose services into a single service, atproto_hub
atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together.
|
2024-06-13 12:02:54 -07:00 |