Until now we used a lot of try/except to keep going when preparing the
environment for the build; it should just work now, so let's fail early.