Skip to content

Commit b1b1eda

Browse files
authored
Merge pull request #197 from jsl9208/main
add an online tutorial on deploying quantized MOSS
2 parents 8f85a41 + 8185661 commit b1b1eda

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -461,6 +461,7 @@ bash run.sh
461461
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - 将MOSS接入视频问答
462462
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - 支持在线部署MOSS的算力平台
463463
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - 社区提供的Docker镜像,运行int4量化版和GradIOUI
464+
- [V100单卡在线部署Int8量化版MOSS教程](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - 提供了量化版MOSS的部署样例,以及部署过程中一些问题的解决方法
464465
465466
如果您有其他开源项目使用或改进MOSS,欢迎提交Pull Request添加到README或在Issues中联系我们。
466467

README_en.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -450,6 +450,7 @@ Note: In the tokenizer of `moss-moon-003-base`, the eos token is `<|endoftext|>`
450450
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - Watch videos with MOSS!
451451
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - A compute platform for deploying MOSS!
452452
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - Community-provided Docker images running int4 quantization and GradIOUI
453+
- [An online tutorial on deploying quantized MOSS on single V100](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - A step-by-step tutorial on deploying moss-moon-003-sft-int8 is provided, and some specific solutions to common problems are also given
453454
454455
If you have other open-sourced projects that used or improved MOSS, please feel free to submit Pull Requests to README or reach out to us in Issues.
455456

0 commit comments

Comments
 (0)