Add CPU offloading support for all diffusion models#405

LawJarp-A wants to merge 3 commits intovllm-project:mainvllm-project/vllm-omni:mainfrom

LawJarp-A:feature/cpu_offloadingLawJarp-A/vllm-omni:feature/cpu_offloadingCopy head branch name to clipboard