Documentation Models Image generation models Vision models FLUX Gemma 2 Idefics 2 LLaVA Phi 3.5 MoE Phi 3.5 Vision Llama 3.2 Vision Qwen2-VL Idefics 3 and Smol VLM DeepSeek V2 DeepSeek V3 MiniCPM-O 2.6 Adapters Docs X-LoRA non-granular LoRA and X-LoRA examples Quantization Docs ISQ UQFF Topology Other Chat templates and tokenizers Paged Attention Sampling TOML selector Tool calling Cross-device inference Device mapping Topology
