Imported from https://github.com/google-research/episodic-curiosity