Mistral Small 3.1 24B

Mistral Small 3.1 by Mistral AI is a dense 24B parameter model supporting text and vision.

Deploy dedicated endpoint

Try in Playground

Example Usage

Input

Python


  from openai import OpenAI
  
  client = OpenAI(
      base_url="https://api.modular.com",
      api_key="<your_api_token>",
  )
  
  response = client.chat.completions.create(
      model="modelname",
      messages=[
          {"role": "system", "content": "You are a helpful assistant."},
          {"role": "user", "content": "Who won the world series in 2020?"},
      ],
      stream=True,
  )
  
  for chunk in response:
      if chunk.choices[0].delta.content:
          print(chunk.choices[0].delta.content, end="")

Get your API token

Output

  The Los Angeles Dodgers won the 2020 World Series.
  
  What else can I help you with?

Model Details

Developed by
Mistral AI
Model family
Mistral AI
Modality
LLM,
Vision,
Context Window
128K
Total Params
24B
Precision
BF16 / FP8
Deployment options
Shared, Dedicated, Self-hosted

Why choose Mistral Small 3.1 24B on Modular?

High performance, out of the box
Run leading open models with strong default performance and the ability to optimize down to the kernel — extracting more from every GPU.
Lower Infrastructure Costs
Deploy efficiently across NVIDIA and AMD hardware to reduce GPU count, increase throughput, and avoid expensive closed-model licensing.
Easy Integration
Integrate through an OpenAI-compatible endpoint, swap models freely, and scale across clouds or hardware without redesigning your application stack.

Want to self-host this model with our open source infrastructure?

Read How

🔥 Trending models

DeepSeek V3.2

DeepSeek V3.2 is a 685B MoE model with 37B active parameters, excelling at code, math, and general reasoning tasks.

LLM

GLM-5

GLM-5 by Zhipu AI is a 744B MoE model with 44B active parameters, featuring strong reasoning capabilities across multilingual tasks.

LLM

gpt-oss-120b

gpt-oss-120b by OpenAI is a 117B MoE model with 5.1B active parameters and 128 experts, featuring reasoning capabilities.

LLM

Kimi K2.5

Kimi K2.5 by Moonshot AI is a ~1T MoE model with 32B active parameters, supporting text and vision with reasoning capabilities.

LLM

Vision

Similar models

MiMo-V2-Flash

MiMo-V2-Flash by Xiaomi is a 309B MoE reasoning model with 15B active parameters.

LLM

Llama 3.1 405B

Llama 3.1 405B by Meta is a dense 405B parameter model for text generation.

LLM

Qwen3-VL-4B

Qwen3-VL-4B by Alibaba is a dense 4B vision-language model supporting text, vision, and video with reasoning.

LLM