Deep Exploration with PAC-Bayes See https://github.com/adinlab/PAC-Bayes-ActorCritic for a public implementation.