[distributed] Context parallelism with tensor parallelism - #50511

[distributed] Context parallelism with tensor parallelism#50511

3outeille wants to merge 2 commits into

cp-3-cp-sizehuggingface/transformers:cp-3-cp-sizefrom

cp-6-tp-x-cphuggingface/transformers:cp-6-tp-x-cpCopy head branch name to clipboard