Apache Mesos
 | |
| Developer(s) | Apache Software Foundation |
|---|---|
| Stable release | 1.4.1
/ November 16, 2017 |
| Repository | |
| Written in | C++ |
| Type | Cluster management software |
| License | Apache License 2.0 |
| Website | mesos |
Apache Mesos is an open-source project to manage computer clusters. It was developed at the University of California, Berkeley.
History
Mesos began as a research project in the UC Berkeley RAD Lab by then PhD students Benjamin Hindman, Andy Konwinski, and Matei Zaharia, as well as professor Ion Stoica. The students started working on the project as part of a course taught by David Culler. It was originally named Nexus but due to a conflict with another university's project, was renamed to Mesos.[1]
Mesos was first presented in 2009 (while still named Nexus) by Andy Konwinski at HotCloud '09 in a talk accompanying the first paper published about the project.[2] Later in 2011 it was presented in a more mature state in a talk by Zaharia at the Usenix Symposium on Networked Systems Design and Implementation conference about the paper "Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center" by Benjamin Hindman, Andy Konwinski, Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, Ion Stoica.[3]
On July 27, 2016, the Apache Software Foundation announced version 1.[4] It added the ability to centrally supply Docker, rkt and appc instances.[5]
Technology
Mesos uses Linux Cgroups to provide isolation for CPU, memory, I/O and file system.[6] Mesos is comparable to Google's Borg scheduler, a highly secretive platform used internally to manage and distribute Google's services.[7]
Apache Aurora
Apache Aurora is a Mesos framework for both long-running services and cron jobs, originally developed by Twitter starting in 2010 and open sourced in late 2013.[8] It can scale to tens of thousands of servers, and holds many similarities to Google's Borg[9][10] including its rich DSL for configuring services.
Chronos
Chronos is a distributed cron-like system, that is elastic and can also express dependencies between jobs.[11]
Marathon
Marathon is promoted for platform as a service or container orchestration system scaling to thousands of physical servers. It is fully REST based and allows canary style deploys and deployment topologies. It is written in the programming language Scala.[12]
Users
Social networking site Twitter began using Mesos and Apache Aurora in 2010, after Hindman gave a presentation to a group of Twitter engineers.[7]
Airbnb said in July 2013 that it uses Mesos to run data processing systems like Apache Hadoop and Apache Spark.[13]
The Internet auction website eBay stated in April 2014 that it used Mesos to run continuous integration on a per-developer basis. They accomplish this by using a custom Mesos plugin that allows developers to launch their own private Jenkins instance.[14]
In April 2015, it was announced that Apple service Siri is using its own Mesos framework called Jarvis.[15]
In August 2015, it was announced that Verizon selected Mesosphere's DC/OS, which is based on open source Apache Mesos, for data center service orchestration.[16]
In November 2015, Yelp announced they had been using Mesos and Marathon for a year and a half for production services.[17]
Commercial support
Software startup Mesosphere Inc sells the Datacenter Operating System, a distributed operating system, based on Apache Mesos.[18] In September 2015, Microsoft announced a commercial partnership with Mesosphere to build container scheduling and orchestration services for Microsoft Azure.[19]
References
- ^ Zaharia, Matei. "HUG Meetup August 2010: Mesos: A Flexible Cluster Resource manager - Part 1". youtube.com. Retrieved 13 January 2015.
- ^ A Common Substrate for Cluster Computing
- ^ Hindman, Benjamin; Konwinski, Andy; Zaharia, Matei; Ghodsi, Ali; Joseph, Anthony; Katz, Randy; Shenker, Scott; Stoica, Ion (2011). "Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center" (PDF). NSDI. 11: 22-22. Retrieved 12 January 2015.
- ^ "The Apache Software Foundation Announces Apache Mesos v1.0". Press release. July 27, 2016. Retrieved February 24, 2017.
- ^ http://siliconangle.com/blog/2016/07/27/mesos-1-0-brings-a-new-container-runtime-and-more-third-party-integrations/
- ^ Bappalige, Sachin P. (2014-09-15). "Open-Source Datacenter Computing with Apache Mesos". OpenSource.com. Red Hat. Retrieved 2016-12-10.
- ^ a b Metz, Cade. "Return of the Borg: How Twitter Rebuilt Google's Secret Weapon". wired.com. Wired. Retrieved 12 January 2015.
- ^ "All about Apache Aurora". Twitter. Retrieved 20 May 2015.
- ^ "Large-scale cluster management at Google with Borg" (PDF). Google. Retrieved 20 May 2015.
- ^ "Twitter's Aurora and How It Relates to Google's Borg". Retrieved 20 May 2015.
- ^ "Chronos". GitHub.com. GitHub. Retrieved 30 March 2015.
- ^ "Marathon". Mesosphere.GitHub.io. Mesosphere. 2014. Retrieved 30 March 2015.
- ^ Harris, Derrick. "Airbnb is engineering itself into a data-driven company". gigaom.com. Retrieved 12 January 2015.
- ^ The eBay PAAS Team. "Delivering eBay's CI Solution with Apache Mesos - Part I". EbayTechBlog.com. eBay. Retrieved 12 January 2015.
- ^ Harris, Derrick (2015-04-23). "Apple Details How It Rebuilt Siri on Mesos". Mesosphere.com. Mesosphere. Retrieved 2015-04-27.
- ^ "Verizon selects Mesosphere DCOS as nationwide platform for data center service orchestration". Verizon. Retrieved 21 August 2015.
- ^ "Introducing PaaSTA: An Open, Distributed, Platform as a Service". engineeringblog.yelp.com. Retrieved 2016-07-12.
- ^ "The Mesosphere DCOS". mesosphere.com. Retrieved 13 January 2015.
- ^ Mary Jo Foley (September 29, 2015). "New Azure Container Service to bring together Mesos, Docker and Azure cloud". ZDNet.
