DeepSeek R1 Distill Llama 70B

DeepSeek R1 Distill Llama 70B is a dense 70B parameter distilled reasoning model.

Deploy dedicated endpoint

Try in Playground

Example Usage

Input

Python


  from openai import OpenAI
  
  client = OpenAI(
      base_url="https://api.modular.com",
      api_key="<your_api_token>",
  )
  
  response = client.chat.completions.create(
      model="modelname",
      messages=[
          {"role": "system", "content": "You are a helpful assistant."},
          {"role": "user", "content": "Who won the world series in 2020?"},
      ],
      stream=True,
  )
  
  for chunk in response:
      if chunk.choices[0].delta.content:
          print(chunk.choices[0].delta.content, end="")

Get your API token

Output

  The Los Angeles Dodgers won the 2020 World Series.
  
  What else can I help you with?

Model Details

Developed by
DeepSeek
Model family
DeepSeek
Modality
LLM,
Context Window
128K
Total Params
70B
Precision
BF16
Deployment options
Shared, Dedicated, Self-hosted

Why choose DeepSeek R1 Distill Llama 70B on Modular?

High performance, out of the box
Run leading open models with strong default performance and the ability to optimize down to the kernel — extracting more from every GPU.
Lower Infrastructure Costs
Deploy efficiently across NVIDIA and AMD hardware to reduce GPU count, increase throughput, and avoid expensive closed-model licensing.
Easy Integration
Integrate through an OpenAI-compatible endpoint, swap models freely, and scale across clouds or hardware without redesigning your application stack.

Want to self-host this model with our open source infrastructure?

Read How

🔥 Trending models

DeepSeek V3.2

DeepSeek V3.2 is a 685B MoE model with 37B active parameters, excelling at code, math, and general reasoning tasks.

LLM

GLM-5

GLM-5 by Zhipu AI is a 744B MoE model with 44B active parameters, featuring strong reasoning capabilities across multilingual tasks.

LLM

gpt-oss-120b

gpt-oss-120b by OpenAI is a 117B MoE model with 5.1B active parameters and 128 experts, featuring reasoning capabilities.

LLM

Kimi K2.5

Kimi K2.5 by Moonshot AI is a ~1T MoE model with 32B active parameters, supporting text and vision with reasoning capabilities.

LLM

Vision

Similar models

Qwen3-Coder-480B-A35B

Qwen3-Coder-480B-A35B by Alibaba is a 480B MoE model with 35B active parameters, optimized for code generation with hybrid reasoning.

LLM

Phi-4

Phi-4 by Microsoft is a dense 14B parameter model for text generation.

LLM

Ministral 14B

Ministral 14B by Mistral AI is a dense 14B parameter model supporting text and vision with reasoning.

LLM

Vision

MiMo-V2-Flash

MiMo-V2-Flash by Xiaomi is a 309B MoE reasoning model with 15B active parameters.

LLM

View all models

Get started with Modular

Request a demo
Schedule a demo of Modular and explore a custom end-to-end deployment built around your models, hardware, and performance goals.
- Distributed, large-scale online inference endpoints
- Highest-performance to maximize ROI and latency
- Deploy in Modular cloud or your cloud
- View all features with a custom demo
Book a demo
Talk with our sales lead Jay!
30min demo. Evaluate with your workloads. Ask us anything.