Got an IndieWeb site? Want to interact with federated social networks like Mastodon, Hubzilla, and more? Bridgy Fed is for you.
 
 
 
 
Go to file
Ryan Barrett e1856c21a1
add more logging for when we write Objects
2023-02-07 08:24:36 -08:00
.circleci bridgy-at: add lexrpc dep, install atproto lexicons on circle 2023-01-12 19:33:53 -08:00
.github dependabot auto-merge workflow: message when we skip major versions 2022-04-25 11:49:10 -07:00
scripts migrate_activity_to_object: resume from latest_updated 2023-02-05 08:17:11 -08:00
static user page activities: show counts of delivered, failed, undelivered 2023-02-07 08:01:21 -08:00
templates user page activities: show counts of delivered, failed, undelivered 2023-02-07 08:01:21 -08:00
tests user page activities: if object is user, render as pretty user link 2023-02-06 21:28:40 -08:00
.gcloudignore webmention => AP: handle multiple in-reply-to links 2020-06-06 08:40:07 -07:00
.gitignore more app/repo scaffolding 2022-12-24 09:11:01 -08:00
README.md update fediverse app compatibility, move from readme to docs 2023-01-18 16:02:49 -08:00
activitypub.py Activity => Object: use StructuredProperty for Object.delivered etc, add protocol 2023-02-04 20:46:27 -08:00
add_webmention.py cache 502s and 504s for requests that fetch users' sites 2023-01-24 16:29:19 -08:00
app.py flask app: suppress some lexprc and negotiator logging 2023-01-16 09:01:29 -08:00
app.yaml bump pending latency down to 500ms, threads up to 30, for link preview DOSes 2023-01-22 07:46:06 -08:00
appengine_config.py unify request handler classes and handle_exception; move away from HOST[_URL] 2020-01-31 14:40:11 -08:00
common.py add more logging for when we write Objects 2023-02-07 08:24:36 -08:00
config.py cache more aggressively: bump expiration up to 60s, threshold to 3k 2023-01-24 16:13:22 -08:00
follow.py add more logging for when we write Objects 2023-02-07 08:24:36 -08:00
index.yaml Activity => Object: user dashboard UI bug fixes, add missing Object index 2023-02-04 20:46:28 -08:00
indieauth_client_id add follow UI to user/[domain]/following 2023-01-07 09:34:55 -08:00
lexicons add XRPC server and method skeletons 2022-12-24 21:08:12 -08:00
models.py user page activities UI: if actor has no displayName, default to username 2023-02-07 08:24:24 -08:00
oauth_dropins_fonts lots of UI tweaks 2022-11-12 23:19:09 -08:00
oauth_dropins_static switch oauth_dropins symlink to oauth_dropins_static, drop it from repo 2021-08-06 11:19:33 -07:00
pages.py user page activities: if object is user, render as pretty user link 2023-02-06 21:28:40 -08:00
redirect.py cache 502s and 504s for requests that fetch users' sites 2023-01-24 16:29:19 -08:00
render.py Activity => Object: temporarily disable inner object rendering 2023-02-05 08:17:22 -08:00
requirements.txt add pkce to deps 2023-02-04 19:08:34 -08:00
superfeedr.py logging: use separate loggers for each module with their names 2022-02-11 22:38:56 -08:00
webfinger.py remove OStatus parts of Webfinger 2023-01-25 20:59:40 -08:00
webmention.py add more logging for when we write Objects 2023-02-07 08:24:36 -08:00
xrpc_actor.py bluesky: misc minor XPRC error handling 2023-01-13 20:12:44 -08:00
xrpc_feed.py Activity => Object: update xrpc_feed.py 2023-02-04 20:46:27 -08:00
xrpc_graph.py add new common.fetch_followers() fn, use in UI, AP collections, and XRPCs 2023-01-19 15:29:52 -08:00

README.md

Bridgy Fed Circle CI Coverage Status

Bridgy Fed connects your web site to Mastodon and the fediverse via ActivityPub, webmentions, and microformats2. Your site gets its own fediverse profile, posts and avatar and header and all. Bridgy Fed translates likes, reposts, mentions, follows, and more back and forth. See the user docs for more details.

https://fed.brid.gy/

Also see the original design blog posts.

License: This project is placed in the public domain.

Development

Pull requests are welcome! Feel free to ping me in #indieweb-dev with any questions.

First, fork and clone this repo. Then, install the Google Cloud SDK and run gcloud components install beta cloud-datastore-emulator to install the datastore emulator. Once you have them, set up your environment by running these commands in the repo root directory:

gcloud config set project bridgy-federated
python3 -m venv local
source local/bin/activate
pip install -r requirements.txt

Now, run the tests to check that everything is set up ok:

gcloud beta emulators datastore start --use-firestore-in-datastore-mode --no-store-on-disk --host-port=localhost:8089 --quiet < /dev/null >& /dev/null &
python3 -m unittest discover

Finally, run this in the repo root directory to start the web app locally:

GAE_ENV=localdev FLASK_ENV=development flask run -p 8080

If you send a pull request, please include (or update) a test for the new functionality!

If you hit an error during setup, check out the oauth-dropins Troubleshooting/FAQ section. For searchability, here are a handful of error messages that have solutions there:

bash: ./bin/easy_install: ...bad interpreter: No such file or directory

ImportError: cannot import name certs

ImportError: No module named dev_appserver

ImportError: cannot import name tweepy

File ".../site-packages/tweepy/auth.py", line 68, in _get_request_token
  raise TweepError(e)
TweepError: must be _socket.socket, not socket

error: option --home not recognized

You may need to change granary, oauth-dropins, mf2util, or other dependencies as well as as Bridgy Fed. To do that, clone their repo locally, then install them in "source" mode with e.g.:

pip uninstall -y granary
pip install -e <path to granary>

To deploy to the production instance on App Engine - if @snarfed has added you as an owner - run:

gcloud -q beta app deploy --no-cache --project bridgy-federated *.yaml

Stats

I occasionally generate stats and graphs of usage and growth via BigQuery, like I do with Bridgy. Here's how.

  1. Export the full datastore to Google Cloud Storage. Include all entities except MagicKey. Check to see if any new kinds have been added since the last time this command was run.

    gcloud datastore export --async gs://bridgy-federated.appspot.com/stats/ --kinds Follower,Response
    

    Note that --kinds is required. From the export docs:

    Data exported without specifying an entity filter cannot be loaded into BigQuery.

  2. Wait for it to be done with gcloud datastore operations list | grep done.

  3. Import it into BigQuery:

    for kind in Follower Response; do
      bq load --replace --nosync --source_format=DATASTORE_BACKUP datastore.$kind gs://bridgy-federated.appspot.com/stats/all_namespaces/kind_$kind/all_namespaces_kind_$kind.export_metadata
    done
    
  4. Check the jobs with bq ls -j, then wait for them with bq wait.

  5. Run the full stats BigQuery query. Download the results as CSV.

  6. Open the stats spreadsheet. Import the CSV, replacing the data sheet.

  7. Check out the graphs! Save full size images with OS or browser screenshots, thumbnails with the Download Chart button.