Can I install plugins on an ephemeral store?

Absolutely. You have full admin access — you can install plugins from the Shopware Store, upload custom plugins, configure themes, and modify any settings just as you would on a production store.