Relationships in Rich Text blocks (currently only Media) do not work in CMS Live Preview.
This is a bug in Payload (payloadcms/payload#5285).
Idea for workaround: if a relationship is not resolved in an affected block, load the object client-side from the CMS.