Imported from https://github.com/MathijsMul/babyai-emergent-guidance