We should lock the password safe when we no longer need it, i. e. in PasswordSafe::drop. This is currently not possible without side effects (at least on the Nitrokey Storage), see nitrokey-storage-firmware issue 65.
PasswordSafe::drop