WATCH OUR 2023 MODCON KEYNOTE

ModCon '23 Keynote Live

The futureof AI development starts here

Mojo 🔥 - the programming language for all AI developers

Available on Mac 🍎, Linux & Windows (WSL)

Unpacking modular (0.1.0) ... Setting up modular (0.1.0) ...

  __  __           _       _
 |  \/  |         | |     | |
 | \  / | ___   __| |_   _| | __ _ _ __
 | |\/| |/ _ \ / _` | | | | |/ _` | '__|
 | |  | | (_) | (_| | |_| | | (_| | |
 |_|  |_|\___/ \__,_|\__,_|_|\__,_|_|

Thanks for installing the Modular CLI!
To get started, type "modular --help".
To install Mojo, type "modular install mojo".

Visit https://www.modular.com/mojo for our getting started guide.
Join our Discord at https://discord.gg/modular,
or file issues on Github at https://github.com/modularml/mojo/issues. modular install mojo # Found release for https://packages.modular.com/mojo @ 0.3.0--release, installing to /root/.modular/pkg/packages.modular.com_mojo
# Downloads complete, setting configs...
# Configs complete, running post-install hooks...
Testing `MODULAR_HOME=/root/.modular` * `/root/.modular/pkg/packages.modular.com_mojo/bin/mojo`...
TEST: `mojo --help`... OK
TEST: `mojo run --help`... OK
TEST: `mojo build test_mandelbrot.mojo`... OK
TEST: `mojo build test_python.mojo`... OK
TEST: `mojo demangle`... OK
reformatted /tmp/tmpmclc50j5/test_format.mojo

All done! ✨ 🍰 ✨
# Installation complete. Mojo is installed under $HOME/.modular. Set $MODULAR_HOME in your current shell to this location, and add $HOME/.modular/pkg/packages.modular.com_mojo/bin to your PATH.
# Downloads complete, setting configs...
# Configs complete, running post-install hooks...
🔥 Mojo installed! 🔥 python3 matmul.py Throughput of a 128x128 matrix multiplication in Python:
0.00215 GFLOP/s mojo matmul.🔥 Throughput of a 512x512 vectorized + parallelized matrix multiplication in Mojo:
79.636 GFLOP/s (36870x speedup over Python)

Our unified, extensible platform superpowers your AI

Modular is an integrated, composable suite of tools that simplifies your AI infrastructure so your team can develop, deploy, and innovate faster.

Clouds

Ai Frameworks

Engine

Devices

Model deployment

The world’s fastest unified inference engine

Modular’s inference engine unifies AI industry frameworks and hardware, enabling you to deploy to any cloud or on-prem environment with minimal code changes – unlocking unmatched usability, performance, and portability.

Learn more Read the docs

COMpute portability

Run your models
anywhere, reduce costs

Seamlessly move your workloads to the best hardware for the job without rewriting or recompiling your models. Avoid lock-in and take advantage of cloud price efficiencies and performance improvements without migration costs.

Learn more

Programmability & Extensibility

Mojo 🔥 — a new programming language for all AI developers

Mojo is a programming language that combines the usability of Python with the performance of C, unlocking unparalleled programmability of AI hardware and extensibility of AI models.

Learn more Read the docs

SOftmax.🔥

def softmax(lst):
  norm = np.exp(lst - np.max(lst))
  return norm / norm.sum()

struct NDArray:
  def max(self) -> NDArray:
    return self.pmap(SIMD.max)

struct SIMD[type: DType, width: Int]:
  def max(self, rhs: Self) -> Self:
    return (self >= rhs).select(self, rhs)

model Scalability

Deploy the largest models in the world on our stack

The Modular Compute Platform dynamically partitions models with billions of parameters and distributes their execution across multiple machines, enabling unparalleled efficiency, scale, and reliability for the largest workloads.

Contact Sales

LLaMA

Gopher

Jurassic

WORLD CLASS ENTERPRISE & COMMUNITY SUPPORT

Get help from the people who know Modular best

As a community member, you can chat with the Modular team directly on Discord, and as an enterprise customer, you get direct support from industry experts to keep you running and enable you to scale to your next challenges.

Chat with us now

General

Modular

Today at 4:17PM

How can we help you?

Deploy on the fastest unified infrastructure on the planet

Modular unlocks state-of-the-art latency, efficiency, and throughput, helping you productionize larger models and realize massive cost savings on your cloud bill.

Queries per Second *

125 qps

TensorFlow

qps

PyTorch

qps

Modular Engine

125
qps

* Model

DLRM RMC1

Instance

AWS c6g.4xlarge

(Graviton2)

Batch Size

Don’t believe us? Put us to the test.

Explore our performance

Language

Run Test

Computer Vision

Run Test

Recommendation

Run Test

LAUNCHING IN 2024

Modular's cloud
compute platform

Join the waiting list

01.

TRAINING AT SCALE

Notebooks for training on the largest compute clusters using Python & Mojo 🔥 for highly optimized workloads.

02.

MANAGED & BYOC

Utilize our managed environment, or Bring your own cloud (BYOC), for seamless workload management.

03.

PERFORMANCE & METRICS

Detailed machine performance and metrics data to provide end-to-end insight into your AI workloads.

04.

DEVELOPER FIRST UI & CLI

Leverage our easy-to-use web UI or CLI tooling to seamlessly manage your training and deployment workflows.

05.

SECURITY & ENCRYPTION

Enterprise security & encryption for your data to be secured at rest and in transit on your data stores.

Why Modular?

Built by the world’s AI experts,

Our team has built most of the world’s existing AI infrastructure, including TensorFlow, PyTorch, TPUs, and MLIR, and launched software like Swift and LLVM. Now we’re focused on rebuilding AI infrastructure for the world.

Reinvented from the ground up

To unlock the next wave of AI innovation, we need a “first principles” approach to the lowest layers of the AI stack. We can’t pile on more and more layers of complexity on top of already over-complicated existing solutions.

Built with generality in mind

Natively multi-model, multi-framework, multi-hardware, and multi-cloud — our infrastructure scales from the largest clusters down to the smallest edge devices and in-between.

Infrastructure that just works

We build technology that meets you where you are at. You shouldn’t have to rewrite your models or application code, grapple with confusing converters, or be a hardware expert to take advantage of state-of-the-art technology.

Built for you

Move beyond Big Tech’s trickle-down infrastructure. Get direct access to industry experts that will help solve any issue you have with our infrastructure and make sure we’re meeting your SLA/SLOs.

Ready to get started?

API References, Tutorials, & More

Read the docs

The futureof AI development starts here

Our unified, extensible platform superpowers your AI

The world’s fastest unified inference engine

Run your modelsanywhere, reduce costs

Mojo 🔥 — a new programming language for all AI developers

Deploy the largest models in the world on our stack

Get help from the people who know Modular best

Deploy on the fastest unified infrastructure on the planet

Don’t believe us? Put us to the test.

Language

Computer Vision

Recommendation

Modular's cloud compute platform

01.

02.

03.

04.

05.

Why Modular?

Built by the world’s AI experts,

Reinvented from the ground up

Built with generality in mind

Infrastructure that just works

Built for you

Ready to get started?

Run your models
anywhere, reduce costs

Modular's cloud
compute platform