Modal

What is Modal?

Modal is a cloud platform built for developers, with a focus on teams working with AI, data, and machine learning (ML). It lets you run CPU or GPU tasks for AI and data-heavy applications without managing the underlying infrastructure. It is designed to be fast and scalable, thanks to a custom container system built in Rust that enables quick cold starts. It offers a serverless environment, a suite of developer tools, and usage-based pricing that includes free compute credits every month. You can use Modal for compute tasks such as running generative AI models, handling large batch jobs, or managing job queues.

Who created Modal?

Modal was founded by a team led by Erik Jankowski. The platform is geared toward developers in AI, data, and machine learning, providing a serverless environment for running generative AI models, large-scale batch jobs, and job queues. It handles CPU, GPU, and data-intensive compute tasks so developers can focus on writing code instead of managing infrastructure.

What is Modal used for?

Modal supports a range of demanding computational workloads:

• Running generative AI models: Deploy and run AI models in the cloud.
• Large-scale batch jobs: Process large datasets or perform complex calculations.
• Job queues: Manage and execute tasks in a structured, ordered way.
• Data-intensive compute: Handle applications requiring significant data processing.
• Scaling: Scale workloads up to hundreds of GPUs.
• Parallel GPU finetuning: Run massively parallel finetune jobs, including training hundreds of LLMs at the same time.
• Job scheduling: Plan and automate task execution.
• Built-in storage: Manage data directly within the platform.
• Custom containers: Package applications in containers for consistent execution.
• Simple setup: Define infrastructure needs with a couple of decorators in your code.

Pricing is usage-based: you pay only for the compute you use.

Who is Modal for?

Modal suits anyone building or deploying AI and data-intensive applications, including:

• AI professionals working directly with AI technologies.
• Data scientists analyzing and interpreting complex data.
• Machine learning engineers building, training, and deploying ML models.
• AI researchers pushing the boundaries of AI.
• Developers focused on generative AI and data-heavy applications who want to avoid infrastructure management.

Key takeaways

Modal is a serverless cloud platform for CPU and GPU compute, aimed at AI, data, and ML teams. Its Rust-based container system delivers fast cold starts, it scales to hundreds of GPUs, and its usage-based pricing with monthly free compute credits makes it accessible for teams of different sizes.