Apache Mesos

Apache Mesos is a distributed systems kernel that abstracts CPU, memory, and storage into a single pool of resources for massive-scale cluster management.

Engineered at UC Berkeley to handle the world's most demanding workloads, Apache Mesos treats an entire datacenter like a single computer. It uses a unique two-level scheduling architecture to run diverse frameworks—including Spark, Kafka, and Cassandra—on the same shared infrastructure without resource contention. While the project moved to the Apache Attic in late 2025, its legacy remains cemented by its ability to scale to 10,000+ nodes for industry giants like Apple, Netflix, and Uber. Operators rely on its high availability via ZooKeeper and native support for Docker and AppC to maintain fault-tolerant, elastic environments.

https://mesos.apache.org