Imported from https://github.com/alex-petrenko/curious-rl