# vllm-mindspore

**Repository Path**: xmoqian/vllm-mindspore

## Basic Information

- **Project Name**: vllm-mindspore
- **Description**: MindSpore的vLLM插件，支持基于vLLM框架部署MindSpore模型的推理服务。
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: ms_inferrt
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 128
- **Created**: 2025-08-14
- **Last Updated**: 2025-09-30

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# MS-InferRT

## Description

DART project is a collection of programming language, intermediate representation, and runtime, designed for AI (abbreviated as DA). The key task is to provide a light-weight and high-performance runtime for MindSpore in the inference phase. It's under development by now.

## Software Architecture

![dart architecture](./docs/architecture_dart.svg)

## Instructions

### Standard build

```bash
bash build.sh
```

### Build with unit tests

```bash
bash build.sh -t
```

### Run all unit tests

```bash
bash tests/ut/cpp/run_test.sh
```