py-torch: Align customized package to spack@0.18.1 upstream

We allow for newer py-pybind11 versions than upstream; upstream pins a specific
version, but, e.g., arbor needs a newer one. Currently, this should just work
fine :).