Modal provides a serverless platform tailored for AI teams, facilitating the execution of tasks like running generative AI models and large-scale batch jobs. It allows users to bring their own code while handling the underlying infrastructure. Engineered for scalability, Modal boasts a container system built from scratch in Rust, ensuring rapid cold-start times and seamless scaling to hundreds of GPUs.
Developers can define environments, storage, job scheduling, web endpoints, and observability aspects entirely in code, eliminating the need for Dockerfiles and YAML configurations. Modal prioritizes security with gVisor runtime and adheres to industry-standard SOC 2 compliance.