I had to create an iTunes playlist called “On Device” and drag from iTunes Library to Playlist, then set old school iTunes sync to include that playlist in podcasts. Then in Podcasts.app I could safely choose items that wouldn’t use data.

In several iOS apps there’s a (generally poorly implemented) way to restrict pick lists to on-device content, but I couldn’t figure that out for Podcasts.app.