Quick Links: Overview & Installation | Environment | Evaluation | Submission

AI Safety Challenge (TanksWorld)

Home project for AI Arena's TanksWorld challenge environment.

Below are details about the challenge in general, installing necessary software, and getting started.

For environment details see: TanksWorld Data Documentation

For rules and evaluation see: Evaluation

For submission guidelines see: Submission

Installation Quick Start Guide

These install instructions are for Linux clients. We recommend installing the anaconda distribution of python to manage the dependencies.

Getting a Linux System

We've tested extensively on Ubuntu 16.04, although other linux OS systems may work.

Anaconda Install

If you are already familiar with anaconda, skip to the next section.

Visit https://www.anaconda.com/distribution/ and download the python 3 version. This should download a .sh script. Navigate to your home folder in a terminal and run the script:

bash <path/to/anaconda/script.sh>

When prompted, answer yes. This is especially important when the install scipt asks: “Do you wish the installer to initialize Anaconda3 by running conda init?”. Note: If you accidentally answer [no] to this question, you can delete the /anaconda3/ folder that will have been created in your home directory and run the script again.

Finally, to begin using conda simply run:

bash

You should now see "(base)" on the far left of your terminal prompt, indicating you are in the base conda environment. In the next section you will create a separate conda environment to contain this project and dependencies.

TanksWorld and Dependencies

The tanksworld executable is bundled in the repo in the exe/ directory. Make sure the executable has the right permissions. This repo includes both a headless and a graphical version of the tanksworld environment. Use the headless execuatable for training and use the graphical version to view the results.

chmod -R 755 aisafetytanks

Create a project conda environment and install some requirements.

conda create -n aisafety python=3.6
conda activate aisafety
conda install -c conda-forge tensorflow=1.14.0 mpi4py
pip install mlagents==0.9.3 stable_baselines==2.9.0

pip install  mlagents==0.9.3 stable_baselines==2.9.0

Clone the ai safety challenge and the AI arena repo and install. The ai arena is located at https://github.com/cgrivera/ai-arena

pip install -e ai-safety-challenge/
pip install -e ai-arena/

Go into the tankworld folder and run the main script with mpi. The -n flag indicates the number of processes that will run simultaneously. Make sure the conda environment that you created is activated when you run.

• exe is the absolute path to the latest tanksworld executable located in the exe directory
• logdir is the location that logfiles, saved policies, and performance plots will be saved.
• n is the number of processes, if you add enough processes, additional environments will be run

cd ai-safety-challenge/tanksworld
mpiexec --oversubscribe -n 14 python my_main_script.py --exe <</absolute/path/to/the/executable>> --logdir testrun

or, if the above crashes due to not accepting the --oversubscribe flag:
mpiexec -n 14 python my_main_script.py --exe <</absolute/path/to/the/executable>> --logdir testrun

Make sure you replace <</absolute/path/to/the/executable>> with the executable location!

TanksWorld Details

See additional details about the environment in the manuscript

Environment Description

The TanksWorld environment is a square arena approximately 100 x 100 feet wide, surrounded on all sides by an irregular rocky wall.
It hosts a 5v5 Red versus Blue battle between two teams of learning agents, each controlled by a single policy. Each battle has a random distribution of static obstacles that are regenerated uniquely for every match. To demonstrate the question of AI Safety in reinforcement learning, there are two neutral tanks that navigate the environment randomly, with no regard for the battle around them. They can be killed, but cannot attack.

The two teams always start a match on opposite sides of the arena facing one another, but which team on what side is always randomly chosen. Each tank can drive and shoot. A launched shell will damage any tank that it detonates near, whether that's an enemy, a teammate, a bystander tank, or the tank who originally launched the shell. Neutral objects in the scene are indestructible, but a flying shell will still detonate if it comes in contact with one.

For details about the states, actions, and rewards coming to and from the environment, please see: TanksWorldData.md

Evauating Policies Viewing the Environment

Download the headed version of of the tanksworld environment.

Errors FAQ

GLibC related errors.

Some systems experience problems related to glibc. The solution is to update the glibc libraries on the machine.

sudo add-apt-repository ppa:ubuntu-toolchain-r/test
sudo apt-get update
sudo apt-get upgrade
export NO_AT_BRIDGE=1
sudo apt-get install libstdc++6

Underlying Unity Simulation

NOTE: This has been moved to: UnitySim.md

License

MIT