Imported from https://github.com/siddharthverma314/proximalpolicyoptimization