diff --git a/docs/context/torch_npu-npu_moe_distribute_combine_add_rms_norm.md b/docs/context/torch_npu-npu_moe_distribute_combine_add_rms_norm.md index 8938a2558b7d920272c16c01b8522014c01acd84..6118b96bc7dce5567b5d8b00edb9c0d6264f92b6 100644 --- a/docs/context/torch_npu-npu_moe_distribute_combine_add_rms_norm.md +++ b/docs/context/torch_npu-npu_moe_distribute_combine_add_rms_norm.md @@ -129,7 +129,7 @@ torch_npu.npu_moe_distribute_combine_add_rms_norm(expand_x, expert_ids, expand_i - BS:表示待发送的token数量。 - Atlas A3 训练系列产品/Atlas A3 推理系列产品:取值范围为01时,不支持TP域通信。 diff --git a/docs/context/torch_npu-npu_moe_distribute_combine_v2.md b/docs/context/torch_npu-npu_moe_distribute_combine_v2.md index 7a8be37ad54973a6df59c27ea39c981ac02ae59f..bb9c4959f1659625df7d6608ba30756bc963ba4d 100644 --- a/docs/context/torch_npu-npu_moe_distribute_combine_v2.md +++ b/docs/context/torch_npu-npu_moe_distribute_combine_v2.md @@ -161,7 +161,7 @@ torch_npu.npu_moe_distribute_combine_v2(expand_x, expert_ids, assist_info_for_co - Atlas A2 训练系列产品/Atlas 800I A2 推理产品/A200I A2 Box 异构组件:取值范围为0Atlas A3 训练系列产品/Atlas A3 推理系列产品:取值范围为0Atlas A2 训练系列产品/Atlas 800I A2 推理产品/A200I A2 Box 异构组件:仅该场景的shape使用了该变量。 diff --git a/docs/context/torch_npu-npu_moe_distribute_dispatch_v2.md b/docs/context/torch_npu-npu_moe_distribute_dispatch_v2.md index 9a8ce0b4302367746ad287b8a164b799dda0524b..84cb4f0474d1399e96e967d2ef45e795deae5bf7 100644 --- a/docs/context/torch_npu-npu_moe_distribute_dispatch_v2.md +++ b/docs/context/torch_npu-npu_moe_distribute_dispatch_v2.md @@ -145,13 +145,13 @@ torch_npu.npu_moe_distribute_dispatch_v2(x, expert_ids, group_ep, ep_world_size, - Atlas A2 训练系列产品/Atlas 800I A2 推理产品/A200I A2 Box 异构组件:取值范围为0Atlas A3 训练系列产品/Atlas A3 推理系列产品:取值范围为0Atlas A2 训练系列产品/Atlas 800I A2 推理产品/A200I A2 Box 异构组件:仅该场景的shape使用了该变量。 - local\_expert\_num:表示本卡专家数量。 - - 对于共享专家卡,`local\_expert\_num`为1。 + - 对于共享专家卡,`local_expert_num`为1。 - 对于MoE专家卡,local\_expert\_num=moe\_expert\_num/\(ep\_world\_size-shared\_expert\_rank\_num),当`local_expert_num`大于1时,不支持TP域通信。 - HCCL_BUFFSIZE: