If the admin wishes to use software keys, it might not be desirable to keep the file unencrypted (or the passphrase in KeyNanny config).
For this case it might be interesting to supply the pass phrase after KeyNanny startup via the daemon protocol.
Of course, KeyNanny will not be able to serve requests for encrypted tuples before the private key has been unlocked.
Bonus points: consider secret sharing for key protection.