Those are two separate settings, one for posts, one for media - plus a third for user archives.
The problem is that remote posts cannot be fetched and therefore are not cached again. Something that wasn't clear to me when I turned on the cleanup and making it a pretty dangerous setting.