Wykres commitów

3346 Commity (6b43b14c5ab99088ff90d7830dbf77f07485cbfd)

Autor SHA1 Wiadomość Data
Ryan Barrett 6b43b14c5a
temporarily add Object index on type + updated
for #1703
2025-01-22 14:51:59 -08:00
Ryan Barrett bb50ad38e3
bug fix for actor deletes after #1360 2025-01-22 11:58:16 -08:00
Ryan Barrett b877a9f3b1
don't expire flag Objects 2025-01-22 11:05:28 -08:00
Ryan Barrett 3f31449832
don't expire follow activity Objects 2025-01-21 21:14:56 -08:00
Ryan Barrett cc9c7d5226
Web.poll_feed_task: tighten last_polled_feed check to only if the task param is greater
for #1712
2025-01-21 17:52:24 -08:00
Ryan Barrett 35bd39298c
garbage collect more Objects, everything except actors, and everything deleted
for #1703, #1149
2025-01-21 14:45:14 -08:00
Ryan Barrett ab5161bf0a
Protocol.deliver: only rewrite object if targets() updated notify/feed
for #1149
2025-01-20 18:39:11 -08:00
Ryan Barrett f91aa967e5
Object.get_or_create: only write back to datastore if we modify any properties
for #1149
2025-01-20 16:03:52 -08:00
Ryan Barrett 0484570fbe
Protocol.receive: switch from Object.get_or_create blind put
shouldn't overwrite because we already check that we haven't seen the id before

for #1360
2025-01-20 15:26:23 -08:00
Ryan Barrett 5603e46a48
Protocol.receive: on create/update without full object, fetch it
re https://github.com/akirk/friends/issues/436
2025-01-20 15:12:38 -08:00
Ryan Barrett 9e800a4e3c
readthedocs config: add sphinx configuration key
https://about.readthedocs.com/blog/2024/12/deprecate-config-files-without-sphinx-or-mkdocs-config/
2025-01-20 15:10:03 -08:00
Ryan Barrett 6f384c9e21
PagesTest.test_update_profile: use fake:profile:... id 2025-01-20 13:45:12 -08:00
Ryan Barrett c0aa4b6ecd
ids.normalize_user_id: convert profile ids to user ids 2025-01-20 13:45:12 -08:00
Ryan Barrett 3bcde43697
not storing CRUD activities any more: populate Object.notify/feed
for #1360

getting closer...
2025-01-20 13:45:12 -08:00
Ryan Barrett e56f22f92a
Object.get_or_create: drop support for new/changed kwargs, we don't use them any more 2025-01-20 13:45:12 -08:00
Ryan Barrett d863add480
first pass at not storing CRUD activities any more
for #1360

good! but not done yet, need to fix populating Object.notify/feed, handling user vs profile ids
2025-01-20 13:45:12 -08:00
dependabot[bot] d6d7154700 build(deps): bump domain2idna from 1.12.2 to 1.12.3
Bumps [domain2idna](https://github.com/PyFunceble/domain2idna) from 1.12.2 to 1.12.3.
- [Release notes](https://github.com/PyFunceble/domain2idna/releases)
- [Commits](https://github.com/PyFunceble/domain2idna/commits)

---
updated-dependencies:
- dependency-name: domain2idna
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-01-20 05:01:26 -08:00
dependabot[bot] ae762963d0 build(deps): bump websockets from 14.1 to 14.2
Bumps [websockets](https://github.com/python-websockets/websockets) from 14.1 to 14.2.
- [Release notes](https://github.com/python-websockets/websockets/releases)
- [Commits](https://github.com/python-websockets/websockets/compare/14.1...14.2)

---
updated-dependencies:
- dependency-name: websockets
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-01-20 05:01:13 -08:00
Ryan Barrett 44b075877b
atproto_firehose: noop: move logging from subscribe to handle
...so that we don't log commits that we currently ignore, eg deletes of follows
2025-01-19 10:36:10 -08:00
Ryan Barrett 4624529eb9
move rumble.com from web blocklist to common blocklist so that it applies to AP too 2025-01-19 10:02:01 -08:00
Ryan Barrett e76d3ee0ab
atproto_firehose: noop: standardize delete log message 2025-01-19 09:25:57 -08:00
Ryan Barrett 48c4f8a73a
add rumble.com to web fetch blocklist, it serves us infinite HTTP 307 redirects 2025-01-19 08:12:26 -08:00
Ryan Barrett 99774c9dd4
router config: bump target CPU up to .95
we're still consistently at 4-5 router instances with only 200-300% CPU. seems like we should be lower.

https://cloud.google.com/appengine/docs/flexible/reference/app-yaml?tab=python#automatic_scaling
2025-01-18 13:12:35 -08:00
Ryan Barrett 53051f9466
User/Object.add: only update memcache for copies if the copy being added is new 2025-01-18 12:53:12 -08:00
Ryan Barrett 1238735213
Protocol.for_id: ignore our #bridgy-fed-... fragments 2025-01-18 12:38:51 -08:00
Ryan Barrett f03057502a
start all synthetic id fragments with #bridgy-fed-... 2025-01-18 12:16:47 -08:00
Ryan Barrett f090d6d182
switch send tasks from stored objects to query params, at least for CRUD activities
for #1149
2025-01-17 15:33:55 -08:00
Ryan Barrett 21a0fb2cb4
Protocol.load: suppress debug logging 2025-01-17 15:28:39 -08:00
Ryan Barrett 2fe997d8b8
common.create_task: omit params with value None 2025-01-17 15:27:22 -08:00
Ryan Barrett 5f55edd16f
TestCase.assert_object: remove unused delivered_protocol kwarg
was used for per-inbox delivery tracking
2025-01-16 19:42:16 -08:00
Ryan Barrett 19ffd300c6
ATProto._convert: bug fix for when fetching a link preview gets no data
for 2363a488fd, fixes https://console.cloud.google.com/errors/detail/CNrq2-2F78_HWg;time=P1D;locations=global?project=bridgy-federated
2025-01-16 14:26:01 -08:00
Ryan Barrett 8796b9edcd
Object.get_or_create: merge repeated fields instead of overwriting 2025-01-16 14:26:01 -08:00
dependabot[bot] 525a26f7b6 build(deps): bump tweepy from 4.14.0 to 4.15.0
Bumps [tweepy](https://github.com/tweepy/tweepy) from 4.14.0 to 4.15.0.
- [Release notes](https://github.com/tweepy/tweepy/releases)
- [Changelog](https://github.com/tweepy/tweepy/blob/master/docs/changelog.md)
- [Commits](https://github.com/tweepy/tweepy/compare/v4.14.0...v4.15.0)

---
updated-dependencies:
- dependency-name: tweepy
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-01-16 04:27:57 -08:00
Ryan Barrett 58a841e5ac
drop 2w account age req't to 1w
cc @anujahooja
2025-01-15 11:52:01 -08:00
Ryan Barrett a48ce4f7aa
temporarily exempt pixelfed.social from the 2w account age req't
cc @anujahooja
2025-01-15 11:50:03 -08:00
Ryan Barrett c9d0be04c6
bump memcache memoize version for Protocol.for_id
when we started caching it in memcache in 2a9f24aee3, we also cached Nones for valid web domains that just didn't happen to give us mf2. 2363a488fd hopefully fixes that, but we also need to ignore the existing Nones in cache.
2025-01-15 09:02:12 -08:00
Ryan Barrett 1b52ede704
memcache.memoize: add version kwarg 2025-01-15 09:00:26 -08:00
Ryan Barrett 2363a488fd
store blank Objects with source_protocol=web for valid web URLs with no mf2
this hopefully stops us from re-fetching them repeatedly in Protocol.for_id or Web.load/fetch

for #1149
2025-01-14 21:27:39 -08:00
Ryan Barrett 2a9f24aee3
cache Protocol.for_id in memcache
for #1149
2025-01-14 16:32:04 -08:00
Ryan Barrett 116d201911
memcache.memoize: add write kwarg 2025-01-14 16:31:49 -08:00
Ryan Barrett 3c97522b1e
memcache.memoize: use fully qualified function name in key, including class if any 2025-01-14 15:55:02 -08:00
Ryan Barrett 56c2811422
memcache.memoize: if key function returns None, don't use memcache 2025-01-14 12:53:55 -08:00
Ryan Barrett 0c17d0a40e
remove /memcache_command and /python_eval
too scary to have in the codebase even with auth around them
2025-01-14 12:48:45 -08:00
Ryan Barrett a1e5d4419d
User.get_or_create: create AP keys more aggressively, check that we have all parts
fixes https://console.cloud.google.com/errors/detail/CKXLrIb56cr0zQE;locations=global;time=P30D?project=bridgy-federated
2025-01-14 09:04:27 -08:00
dependabot[bot] 24e6aaf682 build(deps): bump wrapt from 1.17.0 to 1.17.2
Bumps [wrapt](https://github.com/GrahamDumpleton/wrapt) from 1.17.0 to 1.17.2.
- [Release notes](https://github.com/GrahamDumpleton/wrapt/releases)
- [Changelog](https://github.com/GrahamDumpleton/wrapt/blob/develop/docs/changes.rst)
- [Commits](https://github.com/GrahamDumpleton/wrapt/compare/1.17.0...1.17.2)

---
updated-dependencies:
- dependency-name: wrapt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-01-14 05:07:55 -08:00
dependabot[bot] bfd38e405e build(deps): bump google-api-python-client from 2.158.0 to 2.159.0
Bumps [google-api-python-client](https://github.com/googleapis/google-api-python-client) from 2.158.0 to 2.159.0.
- [Release notes](https://github.com/googleapis/google-api-python-client/releases)
- [Commits](https://github.com/googleapis/google-api-python-client/compare/v2.158.0...v2.159.0)

---
updated-dependencies:
- dependency-name: google-api-python-client
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-01-14 05:06:54 -08:00
Ryan Barrett 3a884a2c4e
Protocol.receive: on a delete for an object we don't have, don't write the object
for #1149
2025-01-13 20:52:00 -08:00
Ryan Barrett 1a985ad77b
move Object auth check and authed_as kwarg from get_or_create to get_by_id 2025-01-13 18:42:32 -08:00
Ryan Barrett 202d43c25d
temporarily stop handling newsmast's undos of reposts
they've been sending 1-2qps of them to us for a while now, pretty much all spurious, or valid but older than we'd know about. cc #1686
2025-01-13 18:14:27 -08:00
Ryan Barrett 32a60c980c
updates for ndb context caching everything: Object.new/changed logic, tests
for #1149, 18aa302da
2025-01-13 16:19:32 -08:00