Since you need to self-host Jellyfin, then you are responsible for making the service public.
Finally found what’s causing my laptop’s DNS servers to change automatically in the background. It was the systemd-resolved FallbackDNS setting. Disabled it in a config and now I can access all my custom DNS names.
laughs in LineageOS