# 并行问题案例

-   **[MindSpore分布式模型并行报错：operator Mul init failed或者CheckStrategy failed.](MindSpore分布式模型并行报错-operator-Mul-init-failed或者CheckStrategy-failed.md)**  

-   **[MindSpore跑模型并行报错ValueError: array split does not result in an equal division](MindSpore跑模型并行报错ValueError-array-split-does-not-result-in-an-equal-division.md)**  

-   **[MindSpore训练大模型报错：BrokenPipeError: \[Errno 32\] Broken pipe, EOFError](MindSpore训练大模型报错-BrokenPipeError-Errno-32-Broken-pipe-EOFError.md)**  

-   **[MindSpore大模型并行需要在对应的yaml里面做哪些配置](MindSpore大模型并行需要在对应的yaml里面做哪些配置.md)**  

-   **[模型并行显示内存溢出](模型并行显示内存溢出.md)**  

-   **[MindSpore模型Pipeline并行发现有些卡的log中loss为0](MindSpore模型Pipeline并行发现有些卡的log中loss为0.md)**  

-   **[MindSpore8卡报Socket times out问题](MindSpore8卡报Socket-times-out问题.md)**  

-   **[MindSpore模型Pipeline并行训练报错RuntimeError: Stage 0 should has at least 1 parameter. but got none.](MindSpore模型Pipeline并行训练报错RuntimeError-Stage-0-should-has-at-least-1-parameter-but-got-none.md)**  

-   **[并行策略为8:1:1时报错RuntimeError: May you need to check if the batch size etc. in your 'net' and 'parameter dict' are same.](并行策略为8-1-1时报错RuntimeError-May-you-need-to-check-if-the-batch-size-etc-in-your-net-and-parameter-dict.md)**  

-   **[模型并行策略为 1:1:8 时报错RuntimeError: Stage num is 8 is not equal to stage used: 5](模型并行策略为-1-1-8-时报错RuntimeError-Stage-num-is-8-is-not-equal-to-stage-used-5.md)**  

-   **[MindSpore报错：wq.weight in the argument 'net' should have the same shape as wq.weight in the argument 'parameter\_dict'.](MindSpore报错-wq-weight-in-the-argument-net-should-have-the-same-shape-as-wq-weight-in-the-argument-pa.md)**  

-   **[MindSpore跑分布式报错TypeError: The parameters number of the function is 636, but the number of provided arguments is 635.](MindSpore跑分布式报错TypeError-The-parameters-number-of-the-function-is-636-but-the-number-of-provided-arg.md)**  

-   **[MindSpore数据并行报错Call GE RunGraphWithStreamAsync Failed，EL0004: Failed to allocate memory.](MindSpore数据并行报错Call-GE-RunGraphWithStreamAsync-Failed-EL0004-Failed-to-allocate-memory.md)**  

-   **[MindSpore分布式8节点报错Call GE RunGraphWithStreamAsync Failed, ret is: 4294967295](MindSpore分布式8节点报错Call-GE-RunGraphWithStreamAsync-Failed-ret-is-4294967295.md)**  

-   **[MindFormers进行单机八卡调用时报错No parameter is entered. Notice that the program will run on default 8 cards.](MindFormers进行单机八卡调用时报错No-parameter-is-entered-Notice-that-the-program-will-run-on-default-8-cards.md)**  

-   **[MindSpore分布式并行报错The strategy is XXX, shape XXX cannot be divisible by strategy value XXX](MindSpore分布式并行报错The-strategy-is-XXX-shape-XXX-cannot-be-divisible-by-strategy-value-XXX.md)**  

-   **[MTP使用多进程生成mindrecord，报错RuntimeError: Unexpected error. \[Internal ERROR\] Failed to write mindrecord meta files.](MTP使用多进程生成mindrecord-报错RuntimeError-Unexpected-error-Internal-ERROR-Failed-to-write-mindrecord-meta.md)**  

-   **[流水线并行报错Reshape op can't be a border.](流水线并行报错Reshape-op-can-t-be-a-border.md)**  

-   **[增加数据并行数之后模型占用显存增加](增加数据并行数之后模型占用显存增加.md)**  

-   **[MindSpore分布式ckpt权重A转换为其他策略的分布式权重B](MindSpore分布式ckpt权重A转换为其他策略的分布式权重B.md)**  

-   **[流水线并行没开Cell共享导致编译时间很长](流水线并行没开Cell共享导致编译时间很长.md)**  

-   **[多机训练报错：import torch\_npu.\_C ImportError: libascend\_hal.so: cannot open shared object file: No such file or directory](多机训练报错-import-torch_npu-_C-ImportError-libascend_hal-so-cannot-open-shared-object-file-No-such-file.md)**  

-   **[docker执行报错：RuntimeError: Maybe you are trying to call 'mindspore.communication.init\(\)' without using 'mpirun'](docker执行报错-RuntimeError-Maybe-you-are-trying-to-call-mindspore-communication-init()-without-using-mp.md)**  

