01cb91d542
handle actor Deletes that get sent to shared inbox
...
...by actually deleting the corresponding Follower entities. fixes #284
2022-11-21 12:14:37 -08:00
65f3ef3cc7
show fediverse address on user page UI, including custom username
...
for #281
2022-11-20 11:46:05 -08:00
b854981497
UI edits: enter web site page, /docs, flashed messages, copy Bridgy's CSS
2022-11-18 22:30:07 -08:00
f384bf5529
add User.verify(), checks redirects and home page representative h-card
...
for #276
2022-11-18 18:49:41 -08:00
97ecc6df46
webmention: handle missing source URL fragment
...
fixes https://console.cloud.google.com/errors/detail/CKKEobWk4d2VHQ;time=P30D?project=bridgy-federated
2022-11-18 15:28:34 -08:00
39cb90e533
Allow providing a URL fragment for posts
...
A number of folks use a single page for multiple posts, using a URL
Fragment parameter to denote which of the posts on the given page should
be used, and are used to this experience with Bridgy.
To allow use of this on Bridgy Fed, too, we can add support for
discovering the ID of the `h-entry` to be Webmention'd in the same way
that we do with [Bridgy].
This largely copies the structure of the existing tests, copying
`test_activitypub_follow`, and adding in multiple posts on the page.
For debugging purposes, we can make sure to log out the `fragment`.
[Bridgy]: f760c0d10e
2022-11-18 06:49:58 -08:00
f127a17fe5
webfinger: handle Bridgy Fed actor URLs
...
hoping to fix errors like this on Mastodon AP delivery:
`Received 401: Public key not found for key https://fed.brid.gy/snarfed.org `
2022-11-17 14:56:05 -08:00
4e0fb6536c
add timeline feeds for posts from fediverse followings
...
for #265
2022-11-17 12:59:09 -08:00
023f2aa536
sharedInbox bug fix, needs to be inside endpoints mapping
...
for #285 , https://www.w3.org/TR/activitypub/#endpoints
2022-11-17 12:59:09 -08:00
8fd49dc882
drop non-public Create activities
...
fixes #289
2022-11-16 16:37:50 -08:00
2bb76a90e7
store Activity entities for AP activities delivered to followers
...
for #265
2022-11-16 15:54:02 -08:00
2d9cc31ff9
switch default home page scheme from http to https
...
fixes #269
2022-11-16 10:43:34 -08:00
320b117470
add AP sharedInbox
...
#285 , https://www.w3.org/TR/activitypub/#sharedInbox
2022-11-16 10:09:24 -08:00
50956c02b0
noop, rename Domain => User
2022-11-15 22:00:28 -08:00
46f039af63
AP: always generate an actor for every outbound activity
...
for #279
2022-11-15 21:43:24 -08:00
e3f1431018
noop identifier renames, key => domain or entity
2022-11-15 19:12:20 -08:00
fd5c88c713
add domain blocklist, right now primarily for Twitter
2022-11-14 22:31:45 -08:00
881307fa0b
wm => AP, don't use Update for a Like/Announce even if we've seen it before
2022-11-14 22:31:45 -08:00
7966650178
AP: put Public in to instead of cc to make Mastodon posts public, not unlisted
...
fixes #277
2022-11-13 21:46:26 -08:00
4cc43f4c56
noop, rename resp => activity
2022-11-13 09:35:47 -08:00
4f3dc03a3e
rename MagicKey => Domain, Response => Activity
...
the Python classes, but not (yet) the kinds in the datastore. maybe eventually.
2022-11-12 15:27:59 -08:00
938a4ac85c
webmention: when checking for fed.brid.gy backlink, don't require / path
...
fixes #278
2022-11-12 07:07:09 -08:00
8aa11f0662
webmention => AP: store outbound followees
...
for #264
2022-11-11 22:50:05 -08:00
e767cf5d1f
refactor /responses and user pages, add follower counts to user pages
...
for #274
more to come
2022-11-11 21:13:51 -08:00
b24a22e817
add /responses/[DOMAIN] user pages and Response.domain property
2022-11-08 06:56:19 -08:00
8e60346dc4
don't strip www, m, and mobile subdomains from user domains
...
fixes #267
2022-11-07 16:28:46 -08:00
001cd1fe11
tried switching HTTP Sig keyId to actor URL for aaronpk, but Mastodon wouldn't verify
...
https://chat.indieweb.org/dev/2022-11-05#t1667687865621700
2022-11-05 15:39:05 -07:00
2e0f6ee0be
update to handle singly valued AS2 icon and image fields
...
snarfed/granary@cfc5a1f743
2022-11-05 14:57:50 -07:00
154d02d908
AP delivery bug fix: don't short circuit if a post is already sent and unchanged
2022-10-29 19:52:35 -07:00
e95f6aa9d3
minor noop comment tweaks
2022-10-08 08:18:25 -07:00
f4c71897ec
update tests to handle snarfed/granary@93a64e91a5
2022-05-27 15:56:48 -07:00
1d36d31064
set User-Agent header globally
2022-03-24 11:18:33 -07:00
96dba41c9b
logging: use separate loggers for each module with their names
2022-02-11 22:38:56 -08:00
7aec2a70de
update tests to handle new User-Agent from webutil
...
snarfed/webutil@ccebf40ac0 , snarfed/oauth-dropins#5
2022-02-09 06:52:41 -08:00
4eaf70aa51
add 'ignored' status for AP requests where the target has no webmention endpoint
2022-01-11 22:40:44 -08:00
fdd42ad1d4
override preferredUsername to always be the user's domain
...
...since Mastodon looks up [preferredUsername]@fed.brid.gy. see #77
2021-10-22 21:17:45 -07:00
d23792d8b3
webmention: skip sending AP Update if content hasn't changed
...
fixes #78
2021-10-10 13:47:33 -07:00
c6f0c417a0
/r: handle trailing garbage chars
...
fixes https://console.cloud.google.com/errors/CO-fpZfMq_6ktgE
2021-09-01 19:48:37 -07:00
e4d285523f
activitypub: handle connection failures better in webmention discovery
...
fixes https://console.cloud.google.com/errors/CPj1-sSij7DcXQ
2021-09-01 08:19:38 -07:00
f4aefff6f4
minor noop test refactoring
2021-08-18 08:04:14 -07:00
cf12817212
Flask port: error handling bug fixes, other misc tweaks
2021-08-16 11:47:31 -07:00
32d9e2bf6c
move common.error() to webutil.flask_util
...
corresponds to snarfed/webutil@10c088cebd
2021-08-06 11:01:58 -07:00
b23705e97e
don't store a Response for OStatus/Salmon unless we actually attempt delivery
2021-07-20 15:55:16 -07:00
2e3360a54b
move Flask utils to oauth_dropins.webutil.flask_util
...
corresponds to snarfed/webutil@5574bb23fa
2021-07-17 21:22:13 -07:00
56cc66d530
flask: add common.RegexConverter
...
based on https://github.com/rhyselsmore/flask-reggie
2021-07-12 13:49:48 -07:00
4a55739b91
flask: port /.well-known/host-meta*, other misc tweaks
...
all tests pass!
2021-07-11 16:50:44 -07:00
371a92a5db
flask: port XrdOrJrdHandler, finish porting webfinger
2021-07-11 16:30:14 -07:00
007f8f16fd
flask: first pass at porting webfinger; incomplete!
...
incomplete because I also need to port webutil.handlers.XrdOrJrdHandler
2021-07-11 13:39:19 -07:00
4fffc073d2
flask: port webmention, add exception handler
2021-07-11 08:48:28 -07:00
c17cb3394b
flask: fix test_common, drop unused common.canonicalize_domain decorator
2021-07-10 08:53:37 -07:00
b8be570d66
flask: port activitypub
2021-07-10 08:07:40 -07:00
f26aed5cbb
flask: port salmon
2021-07-08 22:50:33 -07:00
bb5ae9910d
flask: port /wm/
2021-07-08 07:25:44 -07:00
5b8699bec1
flask: port /r/, start to port common
2021-07-07 21:02:13 -07:00
0b7388fed3
flask: move app to app.py, get templates working, port /responses
2021-07-07 08:07:20 -07:00
86a4afdc97
flask: render: get tests working
2021-07-06 20:34:35 -07:00
fa2a970b2c
flask: render: add caching, get_required_param, update tests
2021-07-06 13:45:56 -07:00
a4c5a8e4c5
redirect: handle single /s that got collapsed by the browser (etc)
2021-06-28 22:52:04 -07:00
d4a94ff75a
migrate from webmention-tools to webutil.webmention
2021-04-25 11:40:19 -07:00
064acef4b0
verify SSL certs (more)
...
requires snarfed/webmention-tools@0059627cfd
2021-04-03 21:15:28 -07:00
db732650a4
add https://w3id.org/security/v1 to actors' @context for HTTP sigs
...
fixes #76
2021-03-22 23:55:14 -07:00
17fa355226
webfinger: misc noop comment and test tweaks
2021-03-12 14:35:59 -08:00
f9e8a5abd2
webfinger tests: expect application/jrd+json for JRD, not application/json
...
for snarfed/webutil@4b277abaa4
2021-03-11 14:14:33 -08:00
f74a6d33fa
add synthetic id to outgoing AS2 activities
...
for #12
2021-03-10 20:37:28 -08:00
1f977a7d5c
stop /r/ from being an open redirect by checking that we've seen the domain
2021-03-07 07:36:34 -08:00
6b4089efe4
/r/ redirect endpoint: use HTTP 301, not 302
2021-03-06 21:47:08 -08:00
06cd35abba
upgrade to python 3.9 runtime and feedparser 6.0.2
2021-03-06 08:03:36 -08:00
33436a35a1
webmention: de-dupe inboxes before delivering
2021-02-24 13:41:46 -08:00
c12b675a7a
webfinger: handle acct:[domain]@fed.brid.gy requests
...
fixes #73
2020-12-30 10:26:48 -08:00
eef94eb033
if ActivityPub inbox delivery fails, don't fall back to Salmon
2020-11-13 09:50:14 -08:00
155be76bca
fix outbound AP headers and signature for Mastodon 3.2.1
...
https://github.com/snarfed/bridgy-fed/issues/68#issuecomment-720059695
2020-11-05 12:43:27 -08:00
8af4571648
handle django-salmon port to pycryptodome
...
in snarfed/django-salmon@76f31ed25c
2020-10-31 13:23:36 -07:00
dba533a14b
temporarily disable actually deleting Followers on AP Delete requests
...
mastodon.social sends Deletes for every Bridgy Fed account, all at basically the same time, and we have many Follower objects, so we have to do this table scan for each one, so the requests take a long time and end up spawning extra App Engine instances that we get billed for. and the Delete requests are almost never for followers we have. TODO: revisit this and do it right.
2020-10-11 08:35:14 -07:00
2c15820ef6
webmention => AP: handle multiple in-reply-to links
...
fixes #65 . thanks again for reporting, @nekr0z!
2020-06-06 08:40:07 -07:00
2a91f01393
webmention: handle missing Content-Type header
...
for https://console.cloud.google.com/errors/CNnflKqP5rHWvgE , https://console.cloud.google.com/errors/CPyMpaulkMKWZA
2020-05-20 23:36:11 -07:00
9eae3087fd
404 requests for root paths that aren't user domains
...
lots of these are fediverse tools sniffing for specific implentations, eg mastodon etc. /siteinfo.json, /status.php, etc.
2020-03-02 10:50:43 -08:00
9784686b1c
implement AP Delete of actors when their accounts are deleted
...
fixes #63
2020-02-29 20:28:53 -08:00
df6b0b58ba
unify request handler classes and handle_exception; move away from HOST[_URL]
...
fixes:
* https://console.cloud.google.com/errors/CN68rO-5sOK9cQ
* https://console.cloud.google.com/errors/CJWCu8b5_ureAg
* https://console.cloud.google.com/errors/CN6W4Zy7irzgOA
* https://console.cloud.google.com/errors/CN278MyjhZbtOQ
2020-01-31 14:40:11 -08:00
02d36b3b1f
migrate to the app engine standard python 3 runtime!
...
https://cloud.google.com/appengine/docs/standard/python3/python-differences
https://cloud.google.com/appengine/docs/standard/python/migrate-to-python3/
2019-12-25 22:26:26 -08:00
ab55c9d62c
ujson.dumps/loads() => util.json_dumps/loads()
2019-12-24 23:26:58 -08:00
99a5c35ae3
switch from webutil.util.memcache_response to cache_response
2019-11-12 21:28:44 -08:00
faf676e8bb
switch from json to ultrajson for performance
...
https://github.com/esnme/ultrajson/
2019-10-29 07:06:15 -07:00
7c9a03c827
unify HTTP fetching, HTML and mf2 parsing, and error handling into webutil
...
see:
* snarfed/granary#171
* snarfed/webutil@f994884b2b
* snarfed/oauth-dropins@f5b6e73530
* snarfed/granary@284eb11508
2019-10-03 21:08:26 -07:00
00d0cc5557
fully qualify relative Atom feed URLs before fetching
...
fixes #58 . thanks again for reporting @fluffy-critter!
2019-09-23 11:20:11 -07:00
7617d4893e
update test to match granary new whitespace handling
...
...again. specifically snarfed/granary@0ac54362ae
2019-09-19 11:56:29 -07:00
ef8b9b13cc
bug fix in webmention => activitypub target fetch error handling
...
fixes https://console.cloud.google.com/errors/CPyMpaulkMKWZA
2019-08-13 16:23:47 -07:00
879f6d1752
return 400 on more bad inputs, eg webmention source URLs
2019-08-13 13:29:31 -07:00
65044b081c
accept Undo of Follow even if Follower doesn't exist
2019-08-01 10:39:15 -07:00
f02c212f37
AP delivery: skip inactive followers
2019-08-01 10:36:39 -07:00
4b70a89046
handle AP Undo of Follow
...
needed for eg mastodon when you unfollow and then try to refollow someone. on unfollow, mastodon sends an Undo, and waits for a 200 before it shows success and will let you refollow.
2019-08-01 10:32:50 -07:00
6219e2d25e
update test to match granary new whitespace handling
...
specifically snarfed/granary@48b55441c5
2019-06-24 14:48:24 -07:00
7c8a2a4603
fix postprocess_as2() crash on multiply-valued inReplyTo
...
fixes https://console.cloud.google.com/errors/COTu_PXPjJ2ZWw
2019-06-06 06:35:57 -07:00
801bf4075d
detect non-domain requests, eg /nodeinfo.json, and 404
...
these are probably other mastodon instances assuming we're mastodon too.
2019-04-19 08:00:21 -07:00
90f7ac3e5b
add HTML meta redirects to mf2 rendered pages for end users
...
browsers will follow them, and hopefully all webmention receivers should/do ignore them, so we'll get the best progressive enhancement for both worlds.
IRC background:
https://chat.indieweb.org/dev/2019-04-11#t1555004634348000
https://chat.indieweb.org/dev/2019-04-16#t1555440757959400
2019-04-17 08:44:26 -07:00
088e9cfaf7
skip outbound webmentions to same domain as source
2019-04-16 11:42:17 -07:00
aa45f0c526
convert AP mentions to home page webmentions
...
for #46
2019-04-16 10:46:40 -07:00
5bc639216e
more error handling for AS2 objects without id or URL
...
follows b7e44c9295https://console.cloud.google.com/errors/CLnu14G46vHLOg
2019-04-15 08:14:37 -07:00
6e7c2008e9
handle SSL failures when fetching arbitrary URLs
...
fixes https://console.cloud.google.com/errors/CJOuzd2b1sehPA
2019-04-10 08:08:02 -07:00
2e33354c27
add following and followers fields to AS2 actors
...
for #40 . they currently both point to endpoint URLs that don't actually work yet, just like the recently added outbox field.
2019-01-14 11:08:08 -08:00
b7e8cd7d42
add conneg + AS2 support to /r/... redirect URLs
...
for pixelfed, #39 . specifically, if the client asks for application/activity+json or application/ld+json (which pixelfed does), fetch and convert to AS2 instead of returning a 302 redirect.
2019-01-04 12:17:50 -08:00
b237e52d6a
add outbox, summary, and publicKey.id properties to actors
...
for #39 , for pixelfed
2019-01-04 08:05:07 -08:00
b7f89dce99
webmention => AP: handle actor/attributedTo id as well as url
...
for #40
2018-12-11 10:59:41 -08:00
0af5c136bb
webmention => AP/Salmon: handle no targets or followers, return 200
...
fixes https://console.cloud.google.com/errors/CIrig_2B6_i87AE
2018-11-27 15:14:56 -08:00
e964190162
webmention => AP: check for link to bridgy fed in source page
...
fixes #42
2018-11-27 10:27:12 -08:00
a9324adceb
webmention => AP: put images into AS2 'attachment' field for Mastodon
...
for https://github.com/snarfed/bridgy-fed/issues/33#issuecomment-440965618
2018-11-23 22:17:37 -08:00
a88165c4e3
webmention => AP: big refactoring to support Create
...
#33 . still in progress!
2018-11-16 07:09:55 -08:00
2bb418dc72
webmention => AP support for u-follow-of => Follow
2018-10-24 21:28:52 -07:00
42ad9d1998
include full AS2 actor object in Response activities
...
for #21
2018-10-23 13:09:49 -07:00
98a19a994d
convert AP Follow to indieweb webmention with u-follow-of
...
#21 , https://indieweb.org/follow
2018-10-23 11:11:50 -07:00
e090c2ba0a
AP Follow bug fix: actors are fed.brid.gy/DOMAIN, not /r/ redirect URLs
2018-10-21 18:54:27 -07:00
abc5ecd919
AP Follow: store users' followers in the datastore
...
#21
2018-10-21 17:37:33 -07:00
a4b309afef
activitypub: refactor Accept response to Follow activity
...
...and get tests working. #21
2018-10-21 15:28:42 -07:00
9fc47c8ba9
AP => wm: switch to proxying reply wm source, unwrap URLs
...
for #35
example: https://webmention.io/realize.be/webmention/hG654HOgobymY54pMaNS
2018-10-17 17:49:56 -07:00
27e56396b8
AP => wm: remove our redirect from target URLs
...
fixes the second half of #35
2018-10-17 12:00:38 -07:00
9fb7f2fe26
AP => wm: prefer object URL for webmention source if available
...
fixes half of #35
2018-10-17 11:52:34 -07:00
25d2724700
add Mention tag for Mastodon replies
...
fixes #34 . thanks @swentel!
2018-10-16 11:38:12 -07:00
2ffd10306f
AP => webmention: handle full AS2 activities
...
mastodon used to send bare objects for lots of things, e.g. replies, but now sends ful AS2 Create activities with embedded objects much more often. handle those too.
thanks for the nudge @swentel!
2018-10-15 11:52:11 -07:00
b25960ca93
wrap activity ids and urls and actor ids in our /r/ endpoint
...
for #16 , #32 . cc @swentel.
2018-10-14 07:58:17 -07:00
e720e543d8
add /r/ redirect endpoint
...
for #16 , #32 . cc @swentel. more to come.
2018-10-14 07:42:28 -07:00
118f8380c7
fix tests for yet another parser change that dropped implied u-url
2018-10-11 17:16:06 -07:00
6681a5f2c7
fix unit test failure triggered by newer versions of mf2py or BS4 or ...
...
problem is that explicit p-name includes `<img>` `src` value, but implicit doesn't. background in https://github.com/microformats/microformats2-parsing/issues/35 etc.
```
======================================================================
FAIL: test_activitypub_create_author_only_url (tests.test_webmention.WebmentionTest)
Mf2 author property is just a URL. We should run full authorship.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/Users/ryan/src/bridgy-fed/local/lib/python2.7/site-packages/mock/mock.py", line 1305, in patched
return func(*args, **keywargs)
File "tests/test_webmention.py", line 383, in test_activitypub_create_author_only_url
self.assert_equals(repost_as2, kwargs['json'])
File "/Users/ryan/src/bridgy-fed/local/lib/python2.7/site-packages/oauth_dropins/webutil/testutil.py", line 182, in assert_equals
%s""" % (msg, ''.join(e.args), expected, actual))
AssertionError: None: [actor] [name] u'Ms. \u2615 Baz' != u'Ms. \u2615 Baz http://orig/pic '
- Ms. \u2615 Baz
+ Ms. \u2615 Baz http://orig/pic
Expected value:
{u'@context': u'https://www.w3.org/ns/activitystreams ',
u'actor': {u'icon': ({u'type': u'Image', u'url': u'http://orig/pic '},),
u'id': u'http://localhost/orig ',
u'image': ({u'type': u'Image', u'url': u'http://orig/pic '},),
u'name': u'Ms. \u2615 Baz',
u'preferredUsername': u'orig',
u'type': u'Person',
u'url': u'http://orig '},
u'cc': [u'https://www.w3.org/ns/activitystreams#Public ',
u'http://orig/author ',
u'http://orig/recipient ',
u'http://orig/bystander '],
u'id': u'http://a/repost ',
u'name': u'reposted!',
u'object': u'tag:orig,2017:as2',
u'type': u'Announce',
u'url': u'http://a/repost '}
Actual value:
{u'@context': u'https://www.w3.org/ns/activitystreams ',
u'actor': {u'icon': [{u'type': u'Image', u'url': u'http://orig/pic '}],
u'id': u'http://localhost/orig ',
u'image': [{u'type': u'Image', u'url': u'http://orig/pic '}],
u'name': u'Ms. \u2615 Baz http://orig/pic ',
u'preferredUsername': u'orig',
u'type': u'Person',
u'url': u'http://orig '},
u'cc': [u'https://www.w3.org/ns/activitystreams#Public ',
u'http://orig/author ',
u'http://orig/recipient ',
u'http://orig/bystander '],
u'id': u'http://a/repost ',
u'name': u'reposted!',
u'object': u'tag:orig,2017:as2',
u'type': u'Announce',
u'url': u'http://a/repost '}
```
2018-10-11 16:56:55 -07:00
b8d52b3dac
move test/ => tests/ to avoid shadowing python's built in test module
...
fixes confusing problems with dev_appserver starting in cloud sdk 219 (app-engine-python 1.9.76). background in https://issuetracker.google.com/issues/117145272#comment25 .
2018-10-11 16:07:53 -07:00
Ryan Barrett