Imported from https://github.com/adi-sharma/RLIE_A3C