UniformAugment

Unofficial PyTorch Reimplementation of UniformAugment. Most of codes are from Fast AutoAugment and PyTorch RandAugment.

Introduction

UniformAugment is an automated data augmentation approach that completely avoids a search phase. UniformAugment’s effectiveness is comparable to the known methods, while still being highly efficient by virtue of not requiring any search.

Install

pip install git+https://github.com/tgilewicz/uniformaugment/

Usage

from torchvision.transforms import transforms
from UniformAugment import UniformAugment

transform_train = transforms.Compose([
    transforms.RandomCrop(32, padding=4),
    transforms.RandomHorizontalFlip(),
    transforms.ToTensor(),
    transforms.Normalize(_CIFAR_MEAN, _CIFAR_STD),
])
# Add UniformAugment with num_ops hyperparameter (num_ops=2 is optimal)
transform_train.transforms.insert(0, UniformAugment())

Experiment

The details of the experiment were consulted with the authors of the UniformAugment paper.

You can run an example experiment with,

$ python UniformAugment/train.py -c confs/wresnet28x10_cifar.yaml --dataset cifar10 \
    --save cifar10_wres28x10.pth --dataroot ~/data --tag v1

CIFAR-10 Classification, TOP1 Accuracy

Model	Paper's Result	Run1	Run2	Run3	Run4	Avg (Ours)
Wide-ResNet 28x10	97.33	97.26	97.31	97.33	97.42	97.33
Wide-ResNet 40x2	96.25	96.27	96.36	96.5	96.54	96.41

CIFAR-100 Classification, TOP1 Accuracy

Model	Paper's Result	Run1	Run2	Run3	Run4	Avg (Ours)
Wide-ResNet 28x10	82.82	83.55	82.56	82.66	82.72	82.87
Wide-ResNet 40x2	79.01	79.06	79.08	79.09	78.77	79.00

ImageNet Classification

Model	Paper's Result	Ours
ResNet-50	77.63	77.80
ResNet-200	80.4	Stay tuned

Core class

class UniformAugment:
    def __init__(self, ops_num=2):
        self._augment_list = augment_list(for_autoaug=False)
        self._ops_num = ops_num

    def __call__(self, img):
        # Selecting unique num_ops transforms for each image would help the
        #   training procedure.
        ops = random.choices(self._augment_list, k=self._ops_num)

        for op in ops:
            augment_fn, low, high = op
            probability = random.random()
            if random.random() < probability:
                img = augment_fn(img.copy(), random.uniform(low, high))

        return img

References

• UniformAugment : Paper
• Fast AutoAugment : Code Paper
• Pytorch RandAugment: Code