Wykres commitów

319 Commity (b045262bb5399bb76e7c57a8391b678d99bd05a1)

Autor SHA1 Wiadomość Data
Ryan Barrett 700f5d6c26
don't serve subscribeRepos on default (fed.brid.gy)
only on atproto-hub (atproto.brid.gy)

cc @bnewbold
2025-04-29 17:33:35 -07:00
Ryan Barrett 4611551140
add common.CACHE_CONTROL_VARY_ACCEPT 2025-01-29 11:57:50 -08:00
Ryan Barrett 96819770df
ndb caching: drop users and profile objects back down to 2h 2025-01-28 20:26:06 -08:00
Ryan Barrett c930927ff9
noop: add constant for ndb memcache timeout 2025-01-25 09:37:42 -08:00
Ryan Barrett ce7ea9b6e8
standardize request param logging into common.log_request()
truncates values at 1k chars each
2025-01-22 21:35:19 -08:00
Ryan Barrett 4624529eb9
move rumble.com from web blocklist to common blocklist so that it applies to AP too 2025-01-19 10:02:01 -08:00
Ryan Barrett 2fe997d8b8
common.create_task: omit params with value None 2025-01-17 15:27:22 -08:00
Ryan Barrett 58a841e5ac
drop 2w account age req't to 1w
cc @anujahooja
2025-01-15 11:52:01 -08:00
Ryan Barrett 32a60c980c
updates for ndb context caching everything: Object.new/changed logic, tests
for #1149, 18aa302da
2025-01-13 16:19:32 -08:00
Ryan Barrett 18aa302dac
temporarily enable ndb context cache for everything
for #1149
2025-01-12 08:11:29 -08:00
Ryan Barrett 2437a16b1e
add youtube to domain blocklist 2025-01-12 07:57:18 -08:00
Ryan Barrett bf3f27dc54
bump up ndb cache timeouts: users and profiles indefinitely, everything else 2h
for #1149
2025-01-10 18:13:17 -08:00
Ryan Barrett e8b201dc33
extract memcache logic out into new memcache.py file 2025-01-09 17:10:05 -08:00
Ryan Barrett 56aca5bdba
common.create_task: don't crash if we're outside a request context
oops 😀

fixes https://console.cloud.google.com/errors/detail/CI37sYuA9Z6Q4gE;time=PT1H;locations=global?project=bridgy-federated&inv=1&invt=AbkfaA
2024-12-18 16:16:09 -08:00
Ryan Barrett 91b268fa4f
unify ndb_client.context() kwargs into common.NDB_CONTEXT_KWARGS 2024-12-18 15:44:35 -08:00
Ryan Barrett 4f5e868b05
common.memcache_memoize: add key callable kwarg 2024-12-13 15:25:03 -08:00
Ryan Barrett baf4bfcebe
Web.verify: for www domains, handle when root domain user is blocked
fixes https://console.cloud.google.com/errors/detail/CPWdpJyQ4I-GVg;locations=global;time=P30D?project=bridgy-federated
2024-12-11 21:29:48 -08:00
Ryan Barrett 5d6d68b5e7
cache models.get_original_user/object_key queries in memcache
adds new generic common.memcache_memoize decorator for caching any function's output in memcache. for #1149
2024-12-11 20:17:36 -08:00
Ryan Barrett 3c3dadb524
minor log tweaks, TODO 2024-12-04 14:38:35 -08:00
Ryan Barrett 2831ce1848
common.create_task: bug fix for 65feae0f9b 2024-12-03 12:09:09 -08:00
Ryan Barrett 65feae0f9b
more logging tweaks for tasks
only log task creations and runs if traceparent header isn't set

for #1149
2024-12-03 11:03:36 -08:00
Ryan Barrett ccdb77d743
common.create_task: connect trace by adding traceparent header
https://cloud.google.com/trace/docs/trace-context#http-requests
https://stackoverflow.com/a/71343735/186123
2024-12-02 18:22:36 -08:00
Ryan Barrett 4f03987f12
stop logging params when creating a new task
for #1149
2024-12-02 18:20:34 -08:00
Ryan Barrett 23e0323e60
tweak common.DOMAIN_RE to avoid exponential backtracking
hopefully fixes https://github.com/snarfed/bridgy-fed/security/code-scanning/53, https://github.com/snarfed/bridgy-fed/security/code-scanning/48
2024-12-02 11:54:38 -08:00
Ryan Barrett d9807658d0
common.create_task: prune down logging a bit 2024-11-22 09:23:20 -08:00
Ryan Barrett b77715fc3c
create_task: stop logging JSON parameter values
for #1149
2024-11-21 15:55:09 -08:00
Ryan Barrett bc4d139ba3
common.as2_request_type: log Accept if it's not AS2
for #1493
2024-11-16 14:42:02 -08:00
Ryan Barrett 9725099006
docs: make email address less prominent
getting too many email requests for support with questions that are already covered in the docs. 😕
2024-11-16 09:39:11 -08:00
Ryan Barrett 741ce52290
common.create_task: stop logging dict params
even truncated like they were. for #1149
2024-11-11 16:33:43 -08:00
Ryan Barrett 3ffe589e96
AP: put Accept activity id on same BF domain as actor
for #1093
2024-11-01 21:29:51 -07:00
Ryan Barrett fa04b2ea44
AP actor endpoint: check conneg, redirect to profile if not an AS2 request
hopefully fixes #1009
2024-10-31 18:09:30 -07:00
Ryan Barrett 54cf1bf5bf
incoming DMs: don't strip links that aren't @-mentions of the bot; handle empty text
fixes https://console.cloud.google.com/errors/detail/CJia3JTRqujKcA;locations=global;time=P30D?project=bridgy-federated
2024-10-31 16:57:16 -07:00
Ryan Barrett b4ac98c84e
move common.add, remove to webutil.util
in snarfed/webutil@46ef97e4fe
2024-10-31 09:41:28 -07:00
Ryan Barrett 5b75fa43d5
noop: tests: rename ExplicitEnableFake => ExplicitFake, eefake => efake 2024-10-08 15:03:43 -07:00
Ryan Barrett 41662e0b23
common.create_task: limit logged task body to 1000 chars 2024-10-02 12:18:32 -07:00
Ryan Barrett 788b37279a
pass Object data in receive task HTTP payload instead of through datastore
trying to cut down datastore load and costs. this switches receive tasks from storing and fetching Objects from the datastore to passing their properties - notably as2, our_as1, bsky, etc - in the HTTP request body, as serialized JSON inside form-encoded params.

for #1354, #1149
2024-10-01 21:44:12 -07:00
Ryan Barrett 64b3b09365
common.unwrap bug fix, handle integer ids
fixes https://console.cloud.google.com/errors/detail/CMyCsrj2u_-gHw;locations=global;time=P30D?project=bridgy-federated
2024-09-26 21:11:15 -07:00
Ryan Barrett a64316df74
Web.poll_feed_task: add last_polled param to detect and suppress dupes
re 0f805e0885, 6cdbefa6de
2024-09-21 08:22:21 -07:00
Ryan Barrett 6cdbefa6de
Web.poll_feed_task: don't return 304 because it incurs retries
0f805e0885 made us both return 304 and create a new task on errors, which led to a task explosion because we'd retry and create more tasks. oops.
2024-09-21 07:48:08 -07:00
Ryan Barrett 794a772619
switch ATProto chat polling from task to cron job 2024-09-10 16:46:37 -07:00
Ryan Barrett 36ac136ebf
common.report_error: log message and exception 2024-08-30 13:09:15 -07:00
Ryan Barrett 6ebe119e6e
common.report_error bug fix, error_reporting.Client.report_exception doesn't take msg 2024-08-29 21:03:22 -07:00
Ryan Barrett a896b5c869
Protocol.check_supported: allow DMs to/from protocol bot user copy ids
for #966
2024-08-29 12:56:07 -07:00
Ryan Barrett 6675d9805c
User.user_link: add name, handle, pictures, proto kwargs, remove maybe_internal_link 2024-08-21 07:55:09 -07:00
Ryan Barrett 70dd6d3ceb
minor logging optimizations
for https://github.com/snarfed/bridgy-fed/issues/1149
2024-08-02 08:03:44 -07:00
Ryan Barrett 5679d696a4
cache models.get_originals in memory
for #1149
2024-08-01 16:20:13 -07:00
Ryan Barrett e9dc38c75c
actually turn on ndb global cache with global_cache_policy
🤦
2024-08-01 12:42:13 -07:00
Ryan Barrett c193a4634b
common.cache_policy, global_cache_timeout_policy: handle both types of keys
google.cloud.datastore.key.Key or google.cloud.ndb.key.Key. see https://github.com/googleapis/python-ndb/issues/987
2024-08-01 12:32:28 -07:00
Ryan Barrett 4097fe71fb
use ndb in-memory context cache for DID doc Objects
for #1149
2024-08-01 12:09:37 -07:00
Ryan Barrett 3529216e5d
disable caching get_originals (88cbe3b) until bugs are fixed
for #1149
2024-07-31 09:14:31 -07:00