MindSpore的vLLM插件,支持基于vLLM框架部署MindSpore模型的推理服务。
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
AKG(Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.
Transformer算子加速库蓝区代码仓
cann-ops-adv,是基于昇腾硬件的融合算子库(adv表示advanced)。
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.