Yeah, Mastodon isn't primarily designed for this.
Long media is better suited to media-based Fediverse platforms like @peertube and @funkwhale which both have podcast features.
People on Mastodon can follow accounts on PeerTube and channels on Funkwhale, they'll see the media appear in their Mastodon feed.