mirror
/
bridgy-fed
kopia lustrzana https://github.com/snarfed/bridgy-fed
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
3 291 Commity
57 Gałęzie
0 Tagi
27 MiB
Wykres commitów

309 Commity (2437a16b1ed65d3548bc06208f5f623b77b5c43c)

Autor SHA1 Wiadomość Data
Ryan Barrett 2437a16b1e
add youtube to domain blocklist 2025-01-12 07:57:18 -08:00
Ryan Barrett bf3f27dc54
bump up ndb cache timeouts: users and profiles indefinitely, everything else 2h 
for #1149
 2025-01-10 18:13:17 -08:00
Ryan Barrett e8b201dc33
extract memcache logic out into new memcache.py file 2025-01-09 17:10:05 -08:00
Ryan Barrett 56aca5bdba
common.create_task: don't crash if we're outside a request context 
oops 😀

fixes https://console.cloud.google.com/errors/detail/CI37sYuA9Z6Q4gE;time=PT1H;locations=global?project=bridgy-federated&inv=1&invt=AbkfaA
 2024-12-18 16:16:09 -08:00
Ryan Barrett 91b268fa4f
unify ndb_client.context() kwargs into common.NDB_CONTEXT_KWARGS 2024-12-18 15:44:35 -08:00
Ryan Barrett 4f5e868b05
common.memcache_memoize: add key callable kwarg 2024-12-13 15:25:03 -08:00
Ryan Barrett baf4bfcebe
Web.verify: for www domains, handle when root domain user is blocked 
fixes https://console.cloud.google.com/errors/detail/CPWdpJyQ4I-GVg;locations=global;time=P30D?project=bridgy-federated
 2024-12-11 21:29:48 -08:00
Ryan Barrett 5d6d68b5e7
cache models.get_original_user/object_key queries in memcache 
adds new generic common.memcache_memoize decorator for caching any function's output in memcache. for #1149
 2024-12-11 20:17:36 -08:00
Ryan Barrett 3c3dadb524
minor log tweaks, TODO 2024-12-04 14:38:35 -08:00
Ryan Barrett 2831ce1848
common.create_task: bug fix for 65feae0f9b 2024-12-03 12:09:09 -08:00
Ryan Barrett 65feae0f9b
more logging tweaks for tasks 
only log task creations and runs if traceparent header isn't set

for #1149
 2024-12-03 11:03:36 -08:00
Ryan Barrett ccdb77d743
common.create_task: connect trace by adding traceparent header 
https://cloud.google.com/trace/docs/trace-context#http-requests
https://stackoverflow.com/a/71343735/186123
 2024-12-02 18:22:36 -08:00
Ryan Barrett 4f03987f12
stop logging params when creating a new task 
for #1149
 2024-12-02 18:20:34 -08:00
Ryan Barrett 23e0323e60
tweak common.DOMAIN_RE to avoid exponential backtracking 
hopefully fixes https://github.com/snarfed/bridgy-fed/security/code-scanning/53, https://github.com/snarfed/bridgy-fed/security/code-scanning/48
 2024-12-02 11:54:38 -08:00
Ryan Barrett d9807658d0
common.create_task: prune down logging a bit 2024-11-22 09:23:20 -08:00
Ryan Barrett b77715fc3c
create_task: stop logging JSON parameter values 
for #1149
 2024-11-21 15:55:09 -08:00
Ryan Barrett bc4d139ba3
common.as2_request_type: log Accept if it's not AS2 
for #1493
 2024-11-16 14:42:02 -08:00
Ryan Barrett 9725099006
docs: make email address less prominent 
getting too many email requests for support with questions that are already covered in the docs. 😕
 2024-11-16 09:39:11 -08:00
Ryan Barrett 741ce52290
common.create_task: stop logging dict params 
even truncated like they were. for #1149
 2024-11-11 16:33:43 -08:00
Ryan Barrett 3ffe589e96
AP: put Accept activity id on same BF domain as actor 
for #1093
 2024-11-01 21:29:51 -07:00
Ryan Barrett fa04b2ea44
AP actor endpoint: check conneg, redirect to profile if not an AS2 request 
hopefully fixes #1009
 2024-10-31 18:09:30 -07:00
Ryan Barrett 54cf1bf5bf
incoming DMs: don't strip links that aren't @-mentions of the bot; handle empty text 
fixes https://console.cloud.google.com/errors/detail/CJia3JTRqujKcA;locations=global;time=P30D?project=bridgy-federated
 2024-10-31 16:57:16 -07:00
Ryan Barrett b4ac98c84e
move common.add, remove to webutil.util 
in snarfed/webutil@46ef97e4fe
 2024-10-31 09:41:28 -07:00
Ryan Barrett 5b75fa43d5
noop: tests: rename ExplicitEnableFake => ExplicitFake, eefake => efake 2024-10-08 15:03:43 -07:00
Ryan Barrett 41662e0b23
common.create_task: limit logged task body to 1000 chars 2024-10-02 12:18:32 -07:00
Ryan Barrett 788b37279a
pass Object data in receive task HTTP payload instead of through datastore 
trying to cut down datastore load and costs. this switches receive tasks from storing and fetching Objects from the datastore to passing their properties - notably as2, our_as1, bsky, etc - in the HTTP request body, as serialized JSON inside form-encoded params.

for #1354, #1149
 2024-10-01 21:44:12 -07:00
Ryan Barrett 64b3b09365
common.unwrap bug fix, handle integer ids 
fixes https://console.cloud.google.com/errors/detail/CMyCsrj2u_-gHw;locations=global;time=P30D?project=bridgy-federated
 2024-09-26 21:11:15 -07:00
Ryan Barrett a64316df74
Web.poll_feed_task: add last_polled param to detect and suppress dupes 
re 0f805e0885, 6cdbefa6de
 2024-09-21 08:22:21 -07:00
Ryan Barrett 6cdbefa6de
Web.poll_feed_task: don't return 304 because it incurs retries 
0f805e0885 made us both return 304 and create a new task on errors, which led to a task explosion because we'd retry and create more tasks. oops.
 2024-09-21 07:48:08 -07:00
Ryan Barrett 794a772619
switch ATProto chat polling from task to cron job 2024-09-10 16:46:37 -07:00
Ryan Barrett 36ac136ebf
common.report_error: log message and exception 2024-08-30 13:09:15 -07:00
Ryan Barrett 6ebe119e6e
common.report_error bug fix, error_reporting.Client.report_exception doesn't take msg 2024-08-29 21:03:22 -07:00
Ryan Barrett a896b5c869
Protocol.check_supported: allow DMs to/from protocol bot user copy ids 
for #966
 2024-08-29 12:56:07 -07:00
Ryan Barrett 6675d9805c
User.user_link: add name, handle, pictures, proto kwargs, remove maybe_internal_link 2024-08-21 07:55:09 -07:00
Ryan Barrett 70dd6d3ceb
minor logging optimizations 
for https://github.com/snarfed/bridgy-fed/issues/1149
 2024-08-02 08:03:44 -07:00
Ryan Barrett 5679d696a4
cache models.get_originals in memory 
for #1149
 2024-08-01 16:20:13 -07:00
Ryan Barrett e9dc38c75c
actually turn on ndb global cache with global_cache_policy 
🤦
 2024-08-01 12:42:13 -07:00
Ryan Barrett c193a4634b
common.cache_policy, global_cache_timeout_policy: handle both types of keys 
google.cloud.datastore.key.Key or google.cloud.ndb.key.Key. see https://github.com/googleapis/python-ndb/issues/987
 2024-08-01 12:32:28 -07:00
Ryan Barrett 4097fe71fb
use ndb in-memory context cache for DID doc Objects 
for #1149
 2024-08-01 12:09:37 -07:00
Ryan Barrett 3529216e5d
disable caching get_originals (88cbe3b) until bugs are fixed 
for #1149
 2024-07-31 09:14:31 -07:00
Ryan Barrett 88cbe3b7b4
cache models.get_originals in memcache with new memcache_memoize decorator 
for #1149
 2024-07-30 14:50:33 -07:00
Ryan Barrett 33e0d0b14a
common.memcache_key: encode Unicode chars as UTF-8 2024-07-30 14:49:50 -07:00
Ryan Barrett 075c33cade
memcache: encode spaces in keys as %20 
fixes https://console.cloud.google.com/errors/detail/CNPzqYzWg4_TyQE;time=P7D?project=bridgy-federated
 2024-07-16 13:48:52 -07:00
Ryan Barrett 7b0151b0cf
memcache: truncate keys at 250 chars 
max memcache key len:
https://github.com/memcached/memcached/wiki/Commands#standard-protocol
https://pymemcache.readthedocs.io/en/latest/apidoc/pymemcache.client.base.html

fixes https://console.cloud.google.com/errors/detail/CNPzqYzWg4_TyQE;time=P30D?project=bridgy-federated
 2024-07-12 07:50:54 -07:00
Ryan Barrett 98d21ae0d9
common.report_error/exception bug fix, handle running outside request context 2024-07-05 12:15:06 -07:00
Ryan Barrett 866f6593e3
add a few domains to the blocklist 2024-06-27 13:20:07 -07:00
Ryan Barrett 550e1030c4
drop unused TLD_BLOCKLIST 
subsumed by using brevity.TLDs in 84949f265b
 2024-06-23 09:22:50 -07:00
Ryan Barrett fc0cc1118a
activitypub.inbox: short circuit on activity or actor id on opted out domain 2024-06-23 09:20:22 -07:00
Ryan Barrett b20bbf0564
memcache config: try to only use prod Memorystore on prod GAE 2024-06-19 11:01:46 -07:00
Ryan Barrett 4e489a4ee0
activitypub.inbox: store seen activity ids in memcache, short circuit on seen ids earlier 2024-06-13 13:54:37 -07:00