Search results

**Issue with Dockerized DeepSpeed-MII Persistent Deployment (LLama 3 70B Model) – Tensor Parallelism Not Effective**

Status: Open.

#568 In deepspeedai/DeepSpeed-MII;

· InderjeetVishnoi opened on Jul 2, 2025

ValueError: Unsupported model type qwen3

Status: Open.

#566 In deepspeedai/DeepSpeed-MII;

· dgzxx-2000 opened on May 14, 2025

Question: Is Expert Parallelism Supported?

Status: Open.

#565 In deepspeedai/DeepSpeed-MII;

· paprika0741 opened on May 12, 2025

[Bug] Excessive Memory Usage for Phi-3-Mini

Status: Open.

#559 In deepspeedai/DeepSpeed-MII;

· riedgar-ms opened on Mar 13, 2025

text-generation-bloom560m-example cannot run

Status: Open.

#551 In deepspeedai/DeepSpeed-MII;

· helloburke opened on Jan 13, 2025

ValueError: Unsupported model type mllama

Status: Open.

#549 In deepspeedai/DeepSpeed-MII;

· MaorSagi opened on Dec 1, 2024

splitting models across nodes

Status: Open.

#547 In deepspeedai/DeepSpeed-MII;

· shahsavari-mhd opened on Nov 26, 2024

How to use data parallelism in multi gpus inference

Status: Open.

#546 In deepspeedai/DeepSpeed-MII;

· hhf-hu opened on Nov 22, 2024

Issue: Multi-node and Multi-GPU Inference Problems with DeepSpeed MII

Status: Open.

#545 In deepspeedai/DeepSpeed-MII;

· lcnmzz00 opened on Nov 20, 2024

Please clarify structured output support

Status: Open.

#544 In deepspeedai/DeepSpeed-MII;

· MRYingLEE opened on Nov 19, 2024

Updating transformers issue with bloom models

Status: Open.

#541 In deepspeedai/DeepSpeed-MII;

· loadams opened on Nov 1, 2024

Updating transformers issue with zero-shot-image-classification

Status: Open.

#540 In deepspeedai/DeepSpeed-MII;

· loadams opened on Nov 1, 2024