This folder contains the CNTK python implementation of the inception-v3 model. The original official repo is here.
The original directory of CNTK Inception contains code for cifar10 and imagenet datasets. In our benchmark, we use the imagenet1K dataset.
To use our benchmark, first prepare the dataset according to the following steps:
1, Download and decompress the imagenet1K 2012 dataset. Note that you need to sign up for an account at image-net.org to download the dataset. Rename and move your deceompressed directories so that the raw data folder looks like this:
ImageNet1K/
ImageNet_train/
n01440764/
n01443537/
n01484850/
...
ImageNet_val/
ILSVRC2012_val_00000001.JPEG
ILSVRC2012_val_00000002.JPEG
ILSVRC2012_val_00000003.JPEG
...
2, Copy dataset/Read_labelclsloc.py
& dataset/create_train_map.py
to ImageNet1K/ImageNet_train/
, and dataset/ILSVRC2012_validation_ground_truth.txt
& dataset/create_val_map.py
to ImageNet1K/ImageNet_val/
3, Generate train_map.txt and val_map.txt by:
DATA_DIR=<ABS_PATH_TO_ImageNet1K/ImageNet_train/>
cd $DATA_DIR
python3.5 create_train_map.py $DATA_DIR
cd ../ImageNet_val
python create_val_map.py
Currently we provide CNTK BrainScript supported by CNTK-2.0. We will update to latest version of CNTK in future release.
To train the model with CNTK BrainScript, obtain the CNTK executable by following:\
1, Install open MPI by sudo apt-get install libopenmpi-dev
;\
2, Download and decompress CNTK-2.0 GPU version for Linux here. To use other version, check here (Please download the release, not the source code);\
3, Add dependency libs to the environment by:
export LD_LIBRARY_PATH=LD_LIBRARY_PATH:<PATH/TO/cntk/cntk/dependencies/lib>
4, You should find the cntk executable in <PATH/TO/cntk/cntk/bin/cntk>
.
To start the training of Inception-v3 with mini-batch size x with CNTK BrainScript, you need to:\
1, Change the DataDir
variable in source/BrainScript/InceptionV3.cntk
to <ABS_PATH_TO_ImageNet1K/ImageNet_train/>
;\
2, Modify the minibatchSize
variable to x;\
3, Start the training by:
<PATH/TO/cntk/cntk/bin/cntk> configFile=InceptionV3.cntk
If you see segmentation fault, see if ulimit -s 65536
solves the issue.