Ryan Barrett
6b43b14c5a
temporarily add Object index on type + updated
...
for #1703
2025-01-22 14:51:59 -08:00
Ryan Barrett
bb50ad38e3
bug fix for actor deletes after #1360
2025-01-22 11:58:16 -08:00
Ryan Barrett
b877a9f3b1
don't expire flag Objects
2025-01-22 11:05:28 -08:00
Ryan Barrett
3f31449832
don't expire follow activity Objects
2025-01-21 21:14:56 -08:00
Ryan Barrett
cc9c7d5226
Web.poll_feed_task: tighten last_polled_feed check to only if the task param is greater
...
for #1712
2025-01-21 17:52:24 -08:00
Ryan Barrett
35bd39298c
garbage collect more Objects, everything except actors, and everything deleted
...
for #1703 , #1149
2025-01-21 14:45:14 -08:00
Ryan Barrett
ab5161bf0a
Protocol.deliver: only rewrite object if targets() updated notify/feed
...
for #1149
2025-01-20 18:39:11 -08:00
Ryan Barrett
f91aa967e5
Object.get_or_create: only write back to datastore if we modify any properties
...
for #1149
2025-01-20 16:03:52 -08:00
Ryan Barrett
0484570fbe
Protocol.receive: switch from Object.get_or_create blind put
...
shouldn't overwrite because we already check that we haven't seen the id before
for #1360
2025-01-20 15:26:23 -08:00
Ryan Barrett
5603e46a48
Protocol.receive: on create/update without full object, fetch it
...
re https://github.com/akirk/friends/issues/436
2025-01-20 15:12:38 -08:00
Ryan Barrett
9e800a4e3c
readthedocs config: add sphinx configuration key
...
https://about.readthedocs.com/blog/2024/12/deprecate-config-files-without-sphinx-or-mkdocs-config/
2025-01-20 15:10:03 -08:00
Ryan Barrett
6f384c9e21
PagesTest.test_update_profile: use fake:profile:... id
2025-01-20 13:45:12 -08:00
Ryan Barrett
c0aa4b6ecd
ids.normalize_user_id: convert profile ids to user ids
2025-01-20 13:45:12 -08:00
Ryan Barrett
3bcde43697
not storing CRUD activities any more: populate Object.notify/feed
...
for #1360
getting closer...
2025-01-20 13:45:12 -08:00
Ryan Barrett
e56f22f92a
Object.get_or_create: drop support for new/changed kwargs, we don't use them any more
2025-01-20 13:45:12 -08:00
Ryan Barrett
d863add480
first pass at not storing CRUD activities any more
...
for #1360
good! but not done yet, need to fix populating Object.notify/feed, handling user vs profile ids
2025-01-20 13:45:12 -08:00
dependabot[bot]
d6d7154700
build(deps): bump domain2idna from 1.12.2 to 1.12.3
...
Bumps [domain2idna](https://github.com/PyFunceble/domain2idna ) from 1.12.2 to 1.12.3.
- [Release notes](https://github.com/PyFunceble/domain2idna/releases )
- [Commits](https://github.com/PyFunceble/domain2idna/commits )
---
updated-dependencies:
- dependency-name: domain2idna
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-01-20 05:01:26 -08:00
dependabot[bot]
ae762963d0
build(deps): bump websockets from 14.1 to 14.2
...
Bumps [websockets](https://github.com/python-websockets/websockets ) from 14.1 to 14.2.
- [Release notes](https://github.com/python-websockets/websockets/releases )
- [Commits](https://github.com/python-websockets/websockets/compare/14.1...14.2 )
---
updated-dependencies:
- dependency-name: websockets
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-01-20 05:01:13 -08:00
Ryan Barrett
44b075877b
atproto_firehose: noop: move logging from subscribe to handle
...
...so that we don't log commits that we currently ignore, eg deletes of follows
2025-01-19 10:36:10 -08:00
Ryan Barrett
4624529eb9
move rumble.com from web blocklist to common blocklist so that it applies to AP too
2025-01-19 10:02:01 -08:00
Ryan Barrett
e76d3ee0ab
atproto_firehose: noop: standardize delete log message
2025-01-19 09:25:57 -08:00
Ryan Barrett
48c4f8a73a
add rumble.com to web fetch blocklist, it serves us infinite HTTP 307 redirects
2025-01-19 08:12:26 -08:00
Ryan Barrett
99774c9dd4
router config: bump target CPU up to .95
...
we're still consistently at 4-5 router instances with only 200-300% CPU. seems like we should be lower.
https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#automatic_scaling
2025-01-18 13:12:35 -08:00
Ryan Barrett
53051f9466
User/Object.add: only update memcache for copies if the copy being added is new
2025-01-18 12:53:12 -08:00
Ryan Barrett
1238735213
Protocol.for_id: ignore our #bridgy-fed-... fragments
2025-01-18 12:38:51 -08:00
Ryan Barrett
f03057502a
start all synthetic id fragments with #bridgy-fed-...
2025-01-18 12:16:47 -08:00
Ryan Barrett
f090d6d182
switch send tasks from stored objects to query params, at least for CRUD activities
...
for #1149
2025-01-17 15:33:55 -08:00
Ryan Barrett
21a0fb2cb4
Protocol.load: suppress debug logging
2025-01-17 15:28:39 -08:00
Ryan Barrett
2fe997d8b8
common.create_task: omit params with value None
2025-01-17 15:27:22 -08:00
Ryan Barrett
5f55edd16f
TestCase.assert_object: remove unused delivered_protocol kwarg
...
was used for per-inbox delivery tracking
2025-01-16 19:42:16 -08:00
Ryan Barrett
19ffd300c6
ATProto._convert: bug fix for when fetching a link preview gets no data
...
for 2363a488fd , fixes https://console.cloud.google.com/errors/detail/CNrq2-2F78_HWg;time=P1D;locations=global?project=bridgy-federated
2025-01-16 14:26:01 -08:00
Ryan Barrett
8796b9edcd
Object.get_or_create: merge repeated fields instead of overwriting
2025-01-16 14:26:01 -08:00
dependabot[bot]
525a26f7b6
build(deps): bump tweepy from 4.14.0 to 4.15.0
...
Bumps [tweepy](https://github.com/tweepy/tweepy ) from 4.14.0 to 4.15.0.
- [Release notes](https://github.com/tweepy/tweepy/releases )
- [Changelog](https://github.com/tweepy/tweepy/blob/master/docs/changelog.md )
- [Commits](https://github.com/tweepy/tweepy/compare/v4.14.0...v4.15.0 )
---
updated-dependencies:
- dependency-name: tweepy
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-01-16 04:27:57 -08:00
Ryan Barrett
58a841e5ac
drop 2w account age req't to 1w
...
cc @anujahooja
2025-01-15 11:52:01 -08:00
Ryan Barrett
a48ce4f7aa
temporarily exempt pixelfed.social from the 2w account age req't
...
cc @anujahooja
2025-01-15 11:50:03 -08:00
Ryan Barrett
c9d0be04c6
bump memcache memoize version for Protocol.for_id
...
when we started caching it in memcache in 2a9f24aee3 , we also cached Nones for valid web domains that just didn't happen to give us mf2. 2363a488fd hopefully fixes that, but we also need to ignore the existing Nones in cache.
2025-01-15 09:02:12 -08:00
Ryan Barrett
1b52ede704
memcache.memoize: add version kwarg
2025-01-15 09:00:26 -08:00
Ryan Barrett
2363a488fd
store blank Objects with source_protocol=web for valid web URLs with no mf2
...
this hopefully stops us from re-fetching them repeatedly in Protocol.for_id or Web.load/fetch
for #1149
2025-01-14 21:27:39 -08:00
Ryan Barrett
2a9f24aee3
cache Protocol.for_id in memcache
...
for #1149
2025-01-14 16:32:04 -08:00
Ryan Barrett
116d201911
memcache.memoize: add write kwarg
2025-01-14 16:31:49 -08:00
Ryan Barrett
3c97522b1e
memcache.memoize: use fully qualified function name in key, including class if any
2025-01-14 15:55:02 -08:00
Ryan Barrett
56c2811422
memcache.memoize: if key function returns None, don't use memcache
2025-01-14 12:53:55 -08:00
Ryan Barrett
0c17d0a40e
remove /memcache_command and /python_eval
...
too scary to have in the codebase even with auth around them
2025-01-14 12:48:45 -08:00
Ryan Barrett
a1e5d4419d
User.get_or_create: create AP keys more aggressively, check that we have all parts
...
fixes https://console.cloud.google.com/errors/detail/CKXLrIb56cr0zQE;locations=global;time=P30D?project=bridgy-federated
2025-01-14 09:04:27 -08:00
dependabot[bot]
24e6aaf682
build(deps): bump wrapt from 1.17.0 to 1.17.2
...
Bumps [wrapt](https://github.com/GrahamDumpleton/wrapt ) from 1.17.0 to 1.17.2.
- [Release notes](https://github.com/GrahamDumpleton/wrapt/releases )
- [Changelog](https://github.com/GrahamDumpleton/wrapt/blob/develop/docs/changes.rst )
- [Commits](https://github.com/GrahamDumpleton/wrapt/compare/1.17.0...1.17.2 )
---
updated-dependencies:
- dependency-name: wrapt
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-01-14 05:07:55 -08:00
dependabot[bot]
bfd38e405e
build(deps): bump google-api-python-client from 2.158.0 to 2.159.0
...
Bumps [google-api-python-client](https://github.com/googleapis/google-api-python-client ) from 2.158.0 to 2.159.0.
- [Release notes](https://github.com/googleapis/google-api-python-client/releases )
- [Commits](https://github.com/googleapis/google-api-python-client/compare/v2.158.0...v2.159.0 )
---
updated-dependencies:
- dependency-name: google-api-python-client
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-01-14 05:06:54 -08:00
Ryan Barrett
3a884a2c4e
Protocol.receive: on a delete for an object we don't have, don't write the object
...
for #1149
2025-01-13 20:52:00 -08:00
Ryan Barrett
1a985ad77b
move Object auth check and authed_as kwarg from get_or_create to get_by_id
2025-01-13 18:42:32 -08:00
Ryan Barrett
202d43c25d
temporarily stop handling newsmast's undos of reposts
...
they've been sending 1-2qps of them to us for a while now, pretty much all spurious, or valid but older than we'd know about. cc #1686
2025-01-13 18:14:27 -08:00
Ryan Barrett
32a60c980c
updates for ndb context caching everything: Object.new/changed logic, tests
...
for #1149 , 18aa302da
2025-01-13 16:19:32 -08:00