Set up workers

[gabrc52]

https://matrix-org.github.io/synapse/latest/workers.html

For reference, we have 6 cores and 12 threads:

$ inxi -C
CPU:
  Info: 2x 6-core model: Intel Xeon X5680

• Install redis
• Enable [replication] in the main process
• Enable redis-based replication
• Generate and add shared secret
• Ensure all authentication, especially SAML and including our custom display name picker, all run in the same worker
• Make the directory and our custom endpoints run on a separate worker
• Choose what workers we want
• Sanity-check our choices or ask for help by going to the Synapse-Admins room
• Make configuration files for each worker
• Add instance_map with workers
• Change systemd units to use workers: https://matrix-org.github.io/synapse/latest/systemd-with-workers/
• Configure nginx to actually use the workers
• Monitor workers: https://matrix-org.github.io/synapse/latest/metrics-howto.html#monitoring-workers

[gabrc52]

https://matrix-org.github.io/synapse/latest/metrics-howto.html#monitoring-workers

Keep in mind workers need additional setup with metrics

[gabrc52]

I feel like we can also do this incrementally or gradually. We can start by adding a new worker to send push notifications, a new worker to deal with federation, one to deal with media, and other things which are pretty standalone.