bridgy-fed/atproto_hub.yaml

# https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python
#
# gcloud -q app deploy --project bridgy-federated hub.yaml

# application: bridgy-federated

service: atproto-hub
env: flex
runtime: python
runtime_config:
    operating_system: ubuntu22
    runtime_version: "3.11"

resources:
  cpu: 1
  memory_gb: 1.6

# can't be internal because Bluesky relay(s) need to be able to connect to us
# over websocket for subscribeRepos
network:
  instance_ip_mode: external

env_variables:
  PDS_HOST: atproto.brid.gy
  PLC_HOST: plc.directory
  APPVIEW_HOST: api.bsky.app
  BGS_HOST: bsky.network
  MOD_SERVICE_HOST: mod.bsky.app
  MOD_SERVICE_DID: did:plc:ar7c4by46qjdydhdevvrndac
  # ...or test against labeler.dholms.xyz / did:plc:vzxheqfwpbi3lxbgdh22js66

  ROLLBACK_WINDOW: 50000

# need only one instance so that new commits can be delivered to subscribeRepos
# subscribers in memory
manual_scaling:
  instances: 1

liveness_check:
  # default 300; does lowering this speed up deploy? seems like maybe, a bit?
  # https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#liveness_checks
  initial_delay_sec: 30

# https://cloud.google.com/appengine/docs/flexible/python/runtime#application_startup
# https://docs.gunicorn.org/en/latest/settings.html#timeout
# TODO: try asyncio w/eventlet workers
entrypoint: gunicorn --workers 1 --threads 25 -b :$PORT atproto_hub:app
start on new hub service for ATProto and eventually Nostr websockets 2023-09-05 19:06:07 +00:00			`# https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python`
			`#`
			`# gcloud -q app deploy --project bridgy-federated hub.yaml`

			`# application: bridgy-federated`

merge hub and atproto_firehose services into a single service, atproto_hub atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together. 2024-06-13 00:04:59 +00:00			`service: atproto-hub`
start on new hub service for ATProto and eventually Nostr websockets 2023-09-05 19:06:07 +00:00			`env: flex`
			`runtime: python`
			`runtime_config:`
			`operating_system: ubuntu22`
misc hub setup, testing live 2023-09-29 18:23:50 +00:00			`runtime_version: "3.11"`
hub.yaml: minor tweaks to get service running 2023-09-11 04:54:28 +00:00
infra: add new router flex service, switch tasks to run on it receive, send, webmention, and poll-feed 2024-05-24 03:40:54 +00:00			`resources:`
drop atproto-hub service down to one core, 2G memory had it higher for a while when we tried serving getRepo from it, but that didn't last. it's currently at ~40-50% CPU on one core, ~600M memory. 2024-07-09 19:38:39 +00:00			`cpu: 1`
			`memory_gb: 1.6`
bump up hub to 2G memory, explicitly GC during polls 2024-05-04 20:28:12 +00:00
merge hub and atproto_firehose services into a single service, atproto_hub atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together. 2024-06-13 00:04:59 +00:00			`# can't be internal because Bluesky relay(s) need to be able to connect to us`
hub: add dispatch.yaml for URL-based routing, update network ingress 2023-09-29 21:28:36 +00:00			`# over websocket for subscribeRepos`
			`network:`
			`instance_ip_mode: external`
start on new hub service for ATProto and eventually Nostr websockets 2023-09-05 19:06:07 +00:00
use prod Bluesky env vars in main app, sandbox in hub 2023-09-29 18:41:19 +00:00			`env_variables:`
atproto: switch PDS hostname to atproto.brid.gy matches the hostname that's currently whitelisted in the federation beta test 2024-03-11 22:30:28 +00:00			`PDS_HOST: atproto.brid.gy`
switch hub from Bluesky sandbox to prod! 2024-02-28 18:57:46 +00:00			`PLC_HOST: plc.directory`
			`APPVIEW_HOST: api.bsky.app`
			`BGS_HOST: bsky.network`
ATroto.send: for flag activities, send createReport to mod service for snarfed/granary#596. background: * https://docs.bsky.app/docs/advanced-guides/moderation#reporting * https://github.com/bluesky-social/atproto/discussions/2350#discussioncomment-8847613 * https://github.com/snarfed/granary/issues/596 2024-04-26 20:59:04 +00:00			`MOD_SERVICE_HOST: mod.bsky.app`
			`MOD_SERVICE_DID: did:plc:ar7c4by46qjdydhdevvrndac`
			`# ...or test against labeler.dholms.xyz / did:plc:vzxheqfwpbi3lxbgdh22js66`
merge hub and atproto_firehose services into a single service, atproto_hub atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together. 2024-06-13 00:04:59 +00:00
hub: bring back ROLLBACK_WINDOW, bumped up to 50k seqs 2024-06-07 23:47:48 +00:00			`ROLLBACK_WINDOW: 50000`
use prod Bluesky env vars in main app, sandbox in hub 2023-09-29 18:41:19 +00:00
start on new hub service for ATProto and eventually Nostr websockets 2023-09-05 19:06:07 +00:00			`# need only one instance so that new commits can be delivered to subscribeRepos`
			`# subscribers in memory`
			`manual_scaling:`
			`instances: 1`

add /admin/atproto for rendering current subscribeRepos clients 2024-07-14 15:04:47 +00:00			`liveness_check:`
app configs: leaning into cargo-culting liveness_check.initial_delay_sec https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#liveness_checks 2024-07-15 15:46:35 +00:00			`# default 300; does lowering this speed up deploy? seems like maybe, a bit?`
add /admin/atproto for rendering current subscribeRepos clients 2024-07-14 15:04:47 +00:00			`# https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#liveness_checks`
			`initial_delay_sec: 30`

start on new hub service for ATProto and eventually Nostr websockets 2023-09-05 19:06:07 +00:00			`# https://cloud.google.com/appengine/docs/flexible/python/runtime#application_startup`
			`# https://docs.gunicorn.org/en/latest/settings.html#timeout`
			`# TODO: try asyncio w/eventlet workers`
merge hub and atproto_firehose services into a single service, atproto_hub atproto_firehose is averaging 20-40% CPU right now, hub 5-10%, and both are 500-600M memory steady state, so they can easily fit together. 2024-06-13 00:04:59 +00:00			`entrypoint: gunicorn --workers 1 --threads 25 -b :$PORT atproto_hub:app`