Go to file
Tao Bojlén 6efce18c3b update plausible 2023-06-10 20:45:17 +01:00
.github/workflows fix crawls of well-connected instances 2023-06-10 09:36:03 +01:00
.reuse fix DEP5 file to follow spec 2019-09-21 14:28:50 +01:00
.vscode add debug config 2020-10-11 11:29:36 +01:00
LICENSES move to REUSE copyright spec 2019-09-19 10:04:02 +01:00
backend fix nodeinfo for some pixelfed instances 2023-06-10 20:41:38 +01:00
frontend update plausible 2023-06-10 20:45:17 +01:00
gephi only put instances with a type on the graph 2019-08-18 17:25:24 +02:00
.dokku-monorepo fix backend app name in .dokku-monorepo 2019-07-14 13:12:35 +01:00
.gitignore crawl less often, and fewer statuses 2023-06-10 20:23:07 +01:00
.gitlab-ci.yml Squashed commit of the following: 2023-06-04 17:30:45 +01:00
BILL-OF-MATERIALS.md Squashed commit of the following: 2023-06-04 17:30:45 +01:00
CHANGELOG.md fix #104 2020-10-13 17:26:26 +01:00
LICENSE Add LICENSE 2019-09-21 14:26:26 +00:00
README.md prep for react-router v6 2023-06-10 14:12:26 +01:00
docker-compose.yaml Revert "remove elasticsearch" 2023-06-10 11:40:16 +01:00
example.env Revert "remove elasticsearch" 2023-06-10 11:40:16 +01:00
nlnet-logo.png add nlnet logo to about page 2019-07-27 16:55:00 +03:00
screenshot.png add deployment instructions to README 2019-07-20 13:45:34 +03:00


fediverse.space 🌐

The map of the fediverse that you always wanted.

Read the latest updates on Mastodon: @fediversespace

A screenshot of fediverse.space


You'll need the following to work on fediverse.space:

  • For the crawler + API:
    • Elixir
    • Postgres
    • Elasticsearch
  • For laying out the graph:
    • Java
  • For the frontend:
    • Node.js

Running it


  • cp example.env .env and modify environment variables as required
  • docker-compose up
  • Create the elasticsearch index:
    • iex -S mix app.start
    • Elasticsearch.Index.hot_swap(Backend.Elasticsearch.Cluster, :instances)


  • cd frontend && npm install
  • npm start



./gradlew shadowJar compiles the graph layout program. java -Xmx1g -jar build/libs/graphBuilder.jar runs it.


  • npm run build creates an optimized build for deployment


This project doesn't crawl personal instances: the goal is to understand communities, not individuals. The threshold for what makes an instance "personal" is defined in the backend config and the graph builder SQL.


You don't have to follow these instructions, but it's one way to set up a continuous deployment pipeline. The following are for the backend; the frontend is just a static HTML/JS site that can be deployed anywhere.

  1. Install Dokku on your web server.
  2. Install dokku-postgres, dokku-monorepo, dokku-elasticsearch, and dokku-letsencrypt.
  3. Create the apps
  • dokku apps:create phoenix
  • dokku apps:create gephi
  1. Create the backing database
  • dokku postgres:create fediversedb
  • dokku postgres:link fediversedb phoenix
  • dokku postgres:link fediversedb gephi
  1. Set up ElasticSearch
  • dokku elasticsearch:create fediverse
  • dokku elasticsearch:link fediverse phoenix
  1. Set the build dirs
  • dokku builder:set phoenix build-dir backend
  • dokku builder:set gephi build-dir gephi
  1. Update the backend configuration. In particular, change the user_agent in config.exs to something descriptive.
  2. Push the apps, e.g. git push dokku@<DOMAIN>:phoenix (note that the first push cannot be from the CD pipeline).
  3. Set up SSL for the Phoenix app
  • dokku letsencrypt:enable phoenix
  • dokku letsencrypt:cron-job --add
  1. Set up a cron job for the graph layout (use the dokku user). E.g.
0 2 * * * /usr/bin/dokku run gephi java -Xmx1g -jar build/libs/graphBuilder.jar

Before the app starts running, make sure that the Elasticsearch index exists -- otherwise it'll create one called instances, which should be the name of the alias. Then it won't be able to hot swap if you reindex in the future.


NLnet logo

Many thanks to NLnet for their support and guidance of this project.