Running GPT Neo with Rust

The project was originally inspired from here.

Dependencies

INSTALLING C++ DISTRIBUTIONS OF PYTORCH

Execution

Run the following lines:

export LIBTORCH="/usr/local/lib/libtorch"
export LD_LIBRARY_PATH="$LIBTORCH/lib${LD_LIBRARY_PATH:+:$LD_LIBRARY_PATH}"

Then, run the following:

cargo run

Resources

• Gpt-Neo Low VRAM