MindSpore的vLLM插件,支持基于vLLM框架部署MindSpore模型的推理服务。
AKG(Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.