vLLM-Ascend ============================================ .. raw:: html

vllm-ascend

面向昇腾 NPU 的 vLLM 社区插件 · 高性能 LLM 推理加速

🚀 快速开始

📦

安装指南

环境准备与安装步骤

🚀

快速上手

5 分钟跑通推理任务

📖

用户指南

特性配置与部署方案

👨‍💻

开发者指南

贡献代码与特性开发

✨ 核心特性

🔌 硬件插件化架构 ⚡ 高性能推理加速 🧩 丰富模型支持 🌐 分布式推理 🔧 完整工具链 🤝 社区共建
---- .. 以下 toctree 直接引用 upstream submodule 的子目录 index 文件(如 tutorials/models/index), .. 无需额外的 nav RST 包装文件。路径从 sources/vllm-ascend/ 出发, .. 通过 ../_generated/sources/vllm-ascend/ 指向 make copy-docs 生成的内容。 .. Makefile 仅删除 upstream 根目录 index(避免与本文件冲突),子目录 index 完整保留。 .. toctree:: :maxdepth: 2 :hidden: :caption: Getting Started ../_generated/sources/vllm-ascend/quick_start ../_generated/sources/vllm-ascend/installation ../_generated/sources/vllm-ascend/tutorials/models/index ../_generated/sources/vllm-ascend/tutorials/features/index ../_generated/sources/vllm-ascend/tutorials/hardwares/index ../_generated/sources/vllm-ascend/faqs .. toctree:: :maxdepth: 2 :hidden: :caption: User Guide ../_generated/sources/vllm-ascend/user_guide/support_matrix/index ../_generated/sources/vllm-ascend/user_guide/configuration/index ../_generated/sources/vllm-ascend/user_guide/feature_guide/index ../_generated/sources/vllm-ascend/user_guide/deployment_guide/index ../_generated/sources/vllm-ascend/user_guide/release_notes .. toctree:: :maxdepth: 2 :hidden: :caption: Developer Guide ../_generated/sources/vllm-ascend/developer_guide/contribution/index ../_generated/sources/vllm-ascend/developer_guide/feature_guide/index ../_generated/sources/vllm-ascend/developer_guide/evaluation/index ../_generated/sources/vllm-ascend/developer_guide/performance_and_debug/index .. toctree:: :maxdepth: 1 :hidden: :caption: Community ../_generated/sources/vllm-ascend/community/governance ../_generated/sources/vllm-ascend/community/contributors ../_generated/sources/vllm-ascend/community/versioning_policy ../_generated/sources/vllm-ascend/community/user_stories/index