Explore PyTorch compilers to optimize and deploy models efficiently.
Learn about APIs like torch.compile and torch.export
that let you enhance model performance and streamline deployment
processes.
Explore advanced topics such as compiled autograd, dynamic compilation
control, as well as third-party backend solutions.
Warning
TorchScript is no longer in active development.
.. customcarditem:: :header: torch.compile Tutorial :card_description: Speed up your models with minimal code changes using torch.compile, the latest PyTorch compiler solution. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/torch_compile_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: torch.compile End-to-End Tutorial :card_description: An example of applying torch.compile to a real model, demonstrating speedups. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/torch_compile_full_example.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Compiled Autograd: Capturing a larger backward graph for torch.compile :card_description: Learn how to use compiled autograd to capture a larger backward graph. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/compiled_autograd_tutorial.html :tags: Model-Optimization,CUDA,torch.compile
.. customcarditem:: :header: Inductor CPU Backend Debugging and Profiling :card_description: Learn the usage, debugging and performance profiling for ``torch.compile`` with Inductor CPU backend. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/inductor_debug_cpu.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Dynamic Compilation Control with torch.compiler.set_stance :card_description: Learn how to use torch.compiler.set_stance :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_compiler_set_stance_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Demonstration of torch.export flow, common challenges and the solutions to address them :card_description: Learn how to export models for popular usecases :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_export_challenges_solutions.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: (beta) Compiling the Optimizer with torch.compile :card_description: Speed up the optimizer using torch.compile :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/compiling_optimizer.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: (beta) Running the compiled optimizer with an LR Scheduler :card_description: Speed up training with LRScheduler and torch.compiled optimizer :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/compiling_optimizer_lr_scheduler.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Using Variable Length Attention with ``torch.compile`` :card_description: Speed up training with torch.compiled variable length attention :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/variable_length_attention_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Using User-Defined Triton Kernels with ``torch.compile`` :card_description: Learn how to use user-defined kernels with ``torch.compile`` :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_compile_user_defined_triton_kernel_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Compile Time Caching in ``torch.compile`` :card_description: Learn how to use compile time caching in ``torch.compile`` :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_compile_caching_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Compile Time Caching Configurations :card_description: Learn how to configure compile time caching in ``torch.compile`` :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_compile_caching_configuration_tutorial.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: Reducing torch.compile cold start compilation time with regional compilation :card_description: Learn how to use regional compilation to control cold start compile time :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/regional_compilation.html :tags: Model-Optimization,torch.compile
.. customcarditem:: :header: torch.export AOTInductor Tutorial for Python runtime :card_description: Learn an end-to-end example of how to use AOTInductor for python runtime. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: recipes/torch_export_aoti_python.html :tags: Basics,torch.export
.. customcarditem:: :header: Deep dive into torch.export :card_description: Learn how to use torch.export to export PyTorch models into standardized model representations. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: intermediate/torch_export_tutorial.html :tags: Basics,torch.export
.. customcarditem:: :header: (optional) Exporting a PyTorch model to ONNX using TorchDynamo backend and Running it using ONNX Runtime :card_description: Build a image classifier model in PyTorch and convert it to ONNX before deploying it with ONNX Runtime. :image: _static/img/thumbnails/cropped/Exporting-PyTorch-Models-to-ONNX-Graphs.png :link: beginner/onnx/export_simple_model_to_onnx_tutorial.html :tags: Production,ONNX,Backends
.. customcarditem:: :header: Extending the ONNX exporter operator support :card_description: Demonstrate end-to-end how to address unsupported operators in ONNX. :image: _static/img/thumbnails/cropped/Exporting-PyTorch-Models-to-ONNX-Graphs.png :link: beginner/onnx/onnx_registry_tutorial.html :tags: Production,ONNX,Backends
.. customcarditem:: :header: Exporting a model with control flow to ONNX :card_description: Demonstrate how to handle control flow logic while exporting a PyTorch model to ONNX. :image: _static/img/thumbnails/cropped/Exporting-PyTorch-Models-to-ONNX-Graphs.png :link: beginner/onnx/export_control_flow_model_to_onnx_tutorial.html :tags: Production,ONNX,Backends
.. customcarditem:: :header: Building a Convolution/Batch Norm fuser in FX :card_description: Build a simple FX pass that fuses batch norm into convolution to improve performance during inference. :image: _static/img/thumbnails/cropped/Deploying-PyTorch-in-Python-via-a-REST-API-with-Flask.png :link: intermediate/torch_compile_conv_bn_fuser :tags: FX
.. customcarditem:: :header: Building a Simple Performance Profiler with FX :card_description: Build a simple FX interpreter to record the runtime of op, module, and function calls and report statistics :image: _static/img/thumbnails/cropped/Deploying-PyTorch-in-Python-via-a-REST-API-with-Flask.png :link: intermediate/fx_profiling_tutorial.html :tags: FX
.. toctree:: :maxdepth: 2 :hidden: :caption: torch.compile intermediate/torch_compile_tutorial intermediate/torch_compile_full_example intermediate/compiled_autograd_tutorial intermediate/inductor_debug_cpu recipes/torch_compiler_set_stance_tutorial recipes/torch_export_challenges_solutions recipes/compiling_optimizer recipes/compiling_optimizer_lr_scheduler intermediate/variable_length_attention_tutorial recipes/torch_compile_user_defined_triton_kernel_tutorial recipes/torch_compile_caching_tutorial recipes/regional_compilation
.. toctree:: :maxdepth: 2 :hidden: :caption: torch.export intermediate/torch_export_tutorial recipes/torch_export_aoti_python recipes/torch_export_challenges_solutions
.. toctree:: :maxdepth: 2 :hidden: :caption: ONNX beginner/onnx/intro_onnx beginner/onnx/export_simple_model_to_onnx_tutorial beginner/onnx/onnx_registry_tutorial beginner/onnx/export_control_flow_model_to_onnx_tutorial
.. toctree:: :maxdepth: 2 :includehidden: :hidden: :caption: Code Transforms with FX intermediate/torch_compile_conv_bn_fuser intermediate/fx_profiling_tutorial