Fixes up a few things in the script and workflow to make it possible to run in CI without interactive prompts.