mirror
/
bridgy-fed
kopia lustrzana https://github.com/snarfed/bridgy-fed
1
0
Forkuj 0
Kod Zgłoszenia Packages Projekty Wydania Wiki Aktywność
1 814 Commity
44 Gałęzie
0 Tagi
16 MiB
Wykres commitów

307 Commity (ee373095e2224808e06551801e2c9f6aabb5ea40)

Autor SHA1 Wiadomość Data
Ryan Barrett 84606500fa
refactoring: unify followers and following AP collection endpoints 2023-01-18 20:32:23 -08:00
Ryan Barrett 6520331627
incoming Follows: synthesize url into follow object stored in Activity 
rendered mf2 HTML proxy pages (in render.py) fall back to redirecting to the follow's AS2 id field, but Mastodon's ids are URLs that don't load in browsers, eg https://jawns.club/ac33c547-ca6b-4351-80d5-d11a6879a7b0. so, set a synthetic URL based on the follower's profile. fixes #336
 2023-01-12 12:28:34 -08:00
Ryan Barrett 4e539488a7
inbound AP: handle Undo Follow with composite inner object 2023-01-09 22:58:35 -08:00
Ryan Barrett 8cdc5ecc4c
inbound AP: handle Follow with composite object 2023-01-08 17:41:15 -08:00
Ryan Barrett 9bb82e6db3
follow UI: store last_follow, misc bug fixes 2023-01-08 12:03:56 -08:00
Ryan Barrett aa0dcbb222
noop: drop content type constants in common, use granary's instead 2023-01-06 21:01:33 -08:00
Ryan Barrett 7ac1006021
background task bug fix: override task runner host 
we were using request.host_url blindly, which was fed.brid.gy for user-facing requests, but bridgy-federated.uc.r.appspot.com for tasks. #335
 2023-01-05 15:05:35 -08:00
Ryan Barrett 4c383a3037
request caching tweaks, webfinger, use new flask_util.cached headers kwarg 2022-12-26 13:34:50 -08:00
Ryan Barrett dc9c699d4f
/inbox: wait until later to load user from datastore 
optimizes Accepts and Deletes sent to individual inbox that don't need the user
 2022-12-08 09:00:53 -08:00
Ryan Barrett a95c2c4b55
incoming follow bug fix, handle www and use_instead 
fixes #314
 2022-12-06 14:09:44 -08:00
Ryan Barrett 0363db65fa
handle new multi-valued url field in AS2 objects 
snarfed/granary@79c512402b
 2022-11-30 21:04:41 -08:00
Ryan Barrett ab834f586a
incoming AP Follow bug fix, reactivate if Follower exists and is inactive 
thanks again @gregorLove!
 2022-11-29 22:43:11 -08:00
Ryan Barrett 559f02ad1d
AP actor handler: handle bad domain 
https://console.cloud.google.com/errors/detail/CKGv-b6impW3Jg;time=P30D?project=bridgy-federated
 2022-11-28 17:27:55 -08:00
Ryan Barrett 2fdc6f29a9
sign HTTP GET requests for AS2 objects 
to support Mastodon's AUTHORIZED_FETCH aka secure mode: https://docs.joinmastodon.org/admin/config/#authorized_fetch

fixes #291
 2022-11-24 09:41:14 -08:00
Ryan Barrett 2279db46fc
start on AP followers/following collections 
for #264
 2022-11-21 18:47:08 -08:00
Ryan Barrett 01cb91d542
handle actor Deletes that get sent to shared inbox 
...by actually deleting the corresponding Follower entities. fixes #284
 2022-11-21 12:14:37 -08:00
Ryan Barrett 2d07ac358d
move activitypub.actor() to common so I can reuse it 2022-11-18 18:49:34 -08:00
Ryan Barrett d0c16d8849
bug fix, use https://fed.brid.gy/[domain] as actor id, not bare domain 
fixes #293
 2022-11-17 16:24:53 -08:00
Ryan Barrett dde86008e2
shared inbox bug fix 
fixes https://console.cloud.google.com/errors/detail/CK7Cx8KS7qyNHQ;time=P30D?project=bridgy-federated
 2022-11-17 14:55:54 -08:00
Ryan Barrett 023f2aa536
sharedInbox bug fix, needs to be inside endpoints mapping 
for #285, https://www.w3.org/TR/activitypub/#endpoints
 2022-11-17 12:59:09 -08:00
Ryan Barrett 8fd49dc882
drop non-public Create activities 
fixes #289
 2022-11-16 16:37:50 -08:00
Ryan Barrett 2bb76a90e7
store Activity entities for AP activities delivered to followers 
for #265
 2022-11-16 15:54:02 -08:00
Ryan Barrett 2d9cc31ff9
switch default home page scheme from http to https 
fixes #269
 2022-11-16 10:43:34 -08:00
Ryan Barrett 320b117470
add AP sharedInbox 
#285, https://www.w3.org/TR/activitypub/#sharedInbox
 2022-11-16 10:09:24 -08:00
Ryan Barrett 50956c02b0
noop, rename Domain => User 2022-11-15 22:00:28 -08:00
Ryan Barrett e3f1431018
noop identifier renames, key => domain or entity 2022-11-15 19:12:20 -08:00
Ryan Barrett 4f3dc03a3e
rename MagicKey => Domain, Response => Activity 
the Python classes, but not (yet) the kinds in the datastore. maybe eventually.
 2022-11-12 15:27:59 -08:00
Ryan Barrett 8aa11f0662
webmention => AP: store outbound followees 
for #264
 2022-11-11 22:50:05 -08:00
Ryan Barrett 8f1d716843
remove debug comment 
for #268
 2022-11-07 19:53:43 -08:00
Ryan Barrett 8e60346dc4
don't strip www, m, and mobile subdomains from user domains 
fixes #267
 2022-11-07 16:28:46 -08:00
Ryan Barrett 001cd1fe11
tried switching HTTP Sig keyId to actor URL for aaronpk, but Mastodon wouldn't verify 
https://chat.indieweb.org/dev/2022-11-05#t1667687865621700
 2022-11-05 15:39:05 -07:00
Ryan Barrett db1441c34c
activitypub: log pretty-printed incoming AP requests 2022-11-05 13:34:58 -07:00
Ryan Barrett 80409af1fe
add missing `f` to log format string 2022-04-06 14:31:58 -07:00
Ryan Barrett 1d36d31064
set User-Agent header globally 2022-03-24 11:18:33 -07:00
Ryan Barrett 96dba41c9b
logging: use separate loggers for each module with their names 2022-02-11 22:38:56 -08:00
Ryan Barrett 535cf7ba70
add response body for inbox Accept activities 
fixes https://console.cloud.google.com/errors/COew6ZH4_eyy2wE
 2021-12-29 19:34:46 -08:00
Ryan Barrett 2f28be09be
convert %-formatted strings with args in logging.* calls to f-strings 2021-12-27 22:45:57 -08:00
Ryan Barrett fdd42ad1d4
override preferredUsername to always be the user's domain 
...since Mastodon looks up [preferredUsername]@fed.brid.gy. see #77
 2021-10-22 21:17:45 -07:00
Ryan Barrett 17d2066008
use @flask_util.cached 2021-08-28 07:18:46 -07:00
Ryan Barrett cf12817212
Flask port: error handling bug fixes, other misc tweaks 2021-08-16 11:47:31 -07:00
Ryan Barrett 32d9e2bf6c
move common.error() to webutil.flask_util 
corresponds to snarfed/webutil@10c088cebd
 2021-08-06 11:01:58 -07:00
Ryan Barrett e1aace0655
flask: use new regex URL route converter 2021-07-12 14:25:00 -07:00
Ryan Barrett 87e0cb8be7
flask: minor tweaks 2021-07-11 23:04:25 -07:00
Ryan Barrett 371a92a5db
flask: port XrdOrJrdHandler, finish porting webfinger 2021-07-11 16:30:14 -07:00
Ryan Barrett b8be570d66
flask: port activitypub 2021-07-10 08:07:40 -07:00
Ryan Barrett f26aed5cbb
flask: port salmon 2021-07-08 22:50:33 -07:00
Ryan Barrett 155be76bca
fix outbound AP headers and signature for Mastodon 3.2.1 
https://github.com/snarfed/bridgy-fed/issues/68#issuecomment-720059695
 2020-11-05 12:43:27 -08:00
Ryan Barrett d22903c3a7
update AP signature generation for Mastodon 3.2.1 changes 
not working yet. :( details in https://github.com/snarfed/bridgy-fed/issues/68#issuecomment-714752553
 2020-10-29 16:08:48 -07:00
Ryan Barrett dba533a14b
temporarily disable actually deleting Followers on AP Delete requests 
mastodon.social sends Deletes for every Bridgy Fed account, all at basically the same time, and we have many Follower objects, so we have to do this table scan for each one, so the requests take a long time and end up spawning extra App Engine instances that we get billed for. and the Delete requests are almost never for followers we have. TODO: revisit this and do it right.
 2020-10-11 08:35:14 -07:00
Ryan Barrett 9eae3087fd
404 requests for root paths that aren't user domains 
lots of these are fediverse tools sniffing for specific implentations, eg mastodon etc.  /siteinfo.json, /status.php, etc.
 2020-03-02 10:50:43 -08:00
Ryan Barrett 9784686b1c
implement AP Delete of actors when their accounts are deleted 
fixes #63
 2020-02-29 20:28:53 -08:00
Ryan Barrett df6b0b58ba
unify request handler classes and handle_exception; move away from HOST[_URL] 
fixes:
* https://console.cloud.google.com/errors/CN68rO-5sOK9cQ
* https://console.cloud.google.com/errors/CJWCu8b5_ureAg
* https://console.cloud.google.com/errors/CN6W4Zy7irzgOA
* https://console.cloud.google.com/errors/CN278MyjhZbtOQ
 2020-01-31 14:40:11 -08:00
Ryan Barrett ee7b324525
bring back HOST_URL override to fed.brid.gy, for URLs emitted into AP 2019-12-26 18:18:44 -08:00
Ryan Barrett 02d36b3b1f
migrate to the app engine standard python 3 runtime! 
https://cloud.google.com/appengine/docs/standard/python3/python-differences
https://cloud.google.com/appengine/docs/standard/python/migrate-to-python3/
 2019-12-25 22:26:26 -08:00
Ryan Barrett ab55c9d62c
ujson.dumps/loads() => util.json_dumps/loads() 2019-12-24 23:26:58 -08:00
Ryan Barrett 99a5c35ae3
switch from webutil.util.memcache_response to cache_response 2019-11-12 21:28:44 -08:00
Ryan Barrett faf676e8bb
switch from json to ultrajson for performance 
https://github.com/esnme/ultrajson/
 2019-10-29 07:06:15 -07:00
Ryan Barrett 7c9a03c827
unify HTTP fetching, HTML and mf2 parsing, and error handling into webutil 
see:
* snarfed/granary#171
* snarfed/webutil@f994884b2b
* snarfed/oauth-dropins@f5b6e73530
* snarfed/granary@284eb11508
 2019-10-03 21:08:26 -07:00
Ryan Barrett c623a295c6
misc noop cleanups based on LGTM alerts 
https://lgtm.com/projects/g/snarfed/bridgy/?mode=list
 2019-09-19 11:57:16 -07:00
Ryan Barrett 9ff0a28dd3
minor bug fix in AP Undo Follow error handling 2019-08-14 11:16:37 -07:00
Ryan Barrett 65044b081c
accept Undo of Follow even if Follower doesn't exist 2019-08-01 10:39:15 -07:00
Ryan Barrett 4b70a89046
handle AP Undo of Follow 
needed for eg mastodon when you unfollow and then try to refollow someone. on unfollow, mastodon sends an Undo, and waits for a 200 before it shows success and will let you refollow.
 2019-08-01 10:32:50 -07:00
Ryan Barrett c055f3aeba
drop HTML tags from webfinger error messages 
fixes #53
 2019-06-24 14:46:45 -07:00
Ryan Barrett 76686af538
cache lots of GET requests 
this helps with requests that make external HTTP fetches, eg indieweb home pages/posts and federated profiles/posts, which change rarely.

in particular, outbound AP requests that get federated widely (eg Mastodon) result in all of those federated instances making the same bridgy fed requests at the same time, often within just a few seconds. more background: tootsuite/mastodon#4486
 2019-04-16 11:05:18 -07:00
Ryan Barrett aa45f0c526
convert AP mentions to home page webmentions 
for #46
 2019-04-16 10:46:40 -07:00
Ryan Barrett 2e33354c27
add following and followers fields to AS2 actors 
for #40. they currently both point to endpoint URLs that don't actually work yet, just like the recently added outbox field.
 2019-01-14 11:08:08 -08:00
Ryan Barrett b237e52d6a
add outbox, summary, and publicKey.id properties to actors 
for #39, for pixelfed
 2019-01-04 08:05:07 -08:00
Ryan Barrett a88165c4e3 webmention => AP: big refactoring to support Create 
#33. still in progress!
 2018-11-16 07:09:55 -08:00
Ryan Barrett 1c728f6590 AP => webmention: fetch actor for all activity types, including replies 
fixes #41
 2018-11-15 13:03:32 -08:00
Ryan Barrett 1c41aa4fd0
AP: blindly accept all Accepts 
#21
 2018-10-24 21:44:21 -07:00
Ryan Barrett 42ad9d1998
include full AS2 actor object in Response activities 
for #21
 2018-10-23 13:09:49 -07:00
Ryan Barrett 98a19a994d
convert AP Follow to indieweb webmention with u-follow-of 
#21, https://indieweb.org/follow
 2018-10-23 11:11:50 -07:00
Ryan Barrett abc5ecd919
AP Follow: store users' followers in the datastore 
#21
 2018-10-21 17:37:33 -07:00
Ryan Barrett a4b309afef
activitypub: refactor Accept response to Follow activity 
...and get tests working. #21
 2018-10-21 15:28:42 -07:00
Ryan Barrett ed3a685831
accept AP follow requests: original patch from @swentel 
...from https://github.com/snarfed/bridgy-fed/issues/21#issuecomment-430403595
 2018-10-19 06:50:00 -07:00
Ryan Barrett 9fc47c8ba9
AP => wm: switch to proxying reply wm source, unwrap URLs 
for #35

example: https://webmention.io/realize.be/webmention/hG654HOgobymY54pMaNS
 2018-10-17 17:49:56 -07:00
Ryan Barrett 2ffd10306f
AP => webmention: handle full AS2 activities 
mastodon used to send bare objects for lots of things, e.g. replies, but now sends ful AS2 Create activities with embedded objects much more often. handle those too.

thanks for the nudge @swentel!
 2018-10-15 11:52:11 -07:00
Ryan Barrett 5047337738
upgrade BS4 to 4.6.3, pin lxml to app engine prod's version 2018-10-11 17:03:26 -07:00
Ryan Barrett a1a66c2f24 fix logging for failed outbound HTTP requests 
also disable logging full parsed mf2 in activitypub actor handler.
 2017-10-24 18:27:07 -07:00
Ryan Barrett c81a6b8ed2 activitypub: follow HTML link rels that point to AS2 objects 
...by reusing common.get_as2(). also lots of misc refactoring.
 2017-10-20 12:49:48 -07:00
Ryan Barrett e985516dc3 return parsed JSON from common.get_as2(); use it in activitypub 2017-10-20 07:13:04 -07:00
Ryan Barrett bb9294ea51 tell common.error() explicitly when to include exc_info 2017-10-17 11:47:01 -07:00
Ryan Barrett bf0897ba81 activitypub and salmon: return 501 on unsupported activity type 2017-10-16 22:21:13 -07:00
Ryan Barrett 73ac7ba1e7 unify webmention sending from salmon and activitypub into common 2017-10-16 09:13:55 -07:00
Ryan Barrett 6190f3bc0c refactor abort() calls to use common.error() 2017-10-15 16:57:33 -07:00
Ryan Barrett f940718790 salmon: support incoming likes and shares (reposts) 2017-10-15 16:57:05 -07:00
Ryan Barrett f2fa44bfff activitypub: fetch and include source actor if necessary 
e.g. for likes and reposts, so that we can render them in our proxy page.
 2017-10-12 23:14:46 -07:00
Ryan Barrett ef89af7372 switch to using Response.get_or_create() 
also test an incoming activitypub like with an id with a fragment
 2017-10-11 18:13:06 -07:00
Ryan Barrett 9a7975bf5d activitypub: use proxy mf2 URLs for likes and reposts/boosts 
for #4
 2017-10-10 22:42:19 -07:00
Ryan Barrett 6a65e2e74a store source post in Response 
...so we can use it to render proxy ActivityPub mf2 pages for webmentions
 2017-10-09 21:11:40 -05:00
Ryan Barrett 19a686edc3 store responses in new Response datastore model 2017-10-09 19:29:50 -05:00
Ryan Barrett 41cf159595 activitypub: minor log message bug fix 2017-10-04 16:59:23 -07:00
Ryan Barrett 4f79e6ebd5 incoming activitypub: return 400 for non-replies (likes etc) 
for #4
 2017-10-04 09:07:29 -07:00
Ryan Barrett 71f0a4c8d4 AP: add publicKey to actor object 
needed for mastodon interop
 2017-10-01 07:01:35 -07:00
Ryan Barrett fcef1e84ec switch from request.host_url to appengine_config.HOST_URL 
...because for requests that were redirected, request.host_url would sometimes lose port. no clue how or why.

e.g. testing mastodon interop locally with me@www.brid.gy, mastodon would fetch

  https://www.brid.gy/.well-known/webfinger?resource=acct:me@www.brid.gy

which would 302 redirect to

  http://localhost:8080/.well-known/webfinger?resource=acct:me@www.brid.gy

and in that request, request.host_url would be http://localhost. but if i curled that second webfinger URL directly, request.host_url would be http://localhost:8080. weird.
 2017-09-30 07:56:40 -07:00
Ryan Barrett c998901108 update webfinger, AS2, etc for receiving AP 2017-09-28 07:25:21 -07:00
Ryan Barrett 4dd8f7e1a7 mastodon interop: salmon + activitypub + webfinger cleanup, tests 2017-09-03 13:03:31 -07:00
Ryan Barrett b975d68a72 mastodon interop: webfinger cleanup, tests 2017-09-03 12:35:18 -07:00
Ryan Barrett c9090401b0 misc tweaks after testing against distbin, mastodon, etc 
- salmon: use top-level <entry>, not <feed>
- activitypub: actor and attributedTo are objects, not string URLs
- activitypub: cc public audience
- activitypub: use inbox in target post object if available
etc...
 2017-08-26 15:20:54 -07:00
Ryan Barrett b7daa0e4ee 400 when we can't find a representative h-card 2017-08-19 13:31:06 -07:00
Ryan Barrett c1c99c6ca5 minor activitypub bug fix (default http, not https) and test improvements 2017-08-19 12:29:10 -07:00
Ryan Barrett 6ddd1d66d9 start on webfinger 2017-08-19 08:21:05 -07:00
Ryan Barrett 04e65d612d add webmention endpoint and conversion to AP inbox delivery 2017-08-15 08:39:32 -07:00
Ryan Barrett 576410005b extract out requests.get() and user agent header into new common.py file 2017-08-14 23:07:24 -07:00
Ryan Barrett de217d34ad rename: bridgy-activitypub => bridgy-federated 
...merging with bridgy-ostatus!
 2017-08-14 12:57:19 -07:00
Ryan Barrett 94c04d41d3 activitypub inbox: accept POSTs, convert to outbound webmention 2017-08-13 14:49:35 -07:00
Ryan Barrett 60a3f7b1cb activitypub actor endpoint: fetch mf2, convert to AS 2017-08-13 00:12:16 -07:00