This covers the Openstack Marconi service: Queuing as a Service. Answers the how, what, and why of Marconi, dives into the API and the architecture, and discusses the future of the project.
service: queues, messages, claims An HTTP-driven, mostly-RESTful API Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
service: queues, messages, claims An HTTP-driven, mostly-RESTful API An Openstack hopeful Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
service: queues, messages, claims An HTTP-driven, mostly-RESTful API An Openstack hopeful Open-source! Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
service: queues, messages, claims An HTTP-driven, mostly-RESTful API An Openstack hopeful Open-source! Marconi is not: Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
service: queues, messages, claims An HTTP-driven, mostly-RESTful API An Openstack hopeful Open-source! Marconi is not: A replacement for X (celery, zmq, rabbitmq) Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
service: queues, messages, claims An HTTP-driven, mostly-RESTful API An Openstack hopeful Open-source! Marconi is not: A replacement for X (celery, zmq, rabbitmq) A message broker Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
often credited with the invention of radio Marconi (the service) is all about managing messages Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
that is: Open Easy to use Scalable Extensible Marconi aims to fill those needs Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
is closed - you can’t run your own instance Celery? Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
is closed - you can’t run your own instance Celery? Celery is a task-based service Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
is closed - you can’t run your own instance Celery? Celery is a task-based service It depends on a broker to handle the queuing aspects Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
is closed - you can’t run your own instance Celery? Celery is a task-based service It depends on a broker to handle the queuing aspects RabbitMQ, qpid, ZMQ? Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
is closed - you can’t run your own instance Celery? Celery is a task-based service It depends on a broker to handle the queuing aspects RabbitMQ, qpid, ZMQ? You have to scale them yourself Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
to queues (FIFO guaranteed) Claims: workers claim messages That’s all there is to it. Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
configure. . . : Logging details Transport drivers: wsgi, zmq As well as transport-specific configuration! Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
configure. . . : Logging details Transport drivers: wsgi, zmq As well as transport-specific configuration! Storage drivers Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
configure. . . : Logging details Transport drivers: wsgi, zmq As well as transport-specific configuration! Storage drivers Messages: size (default: 256KB), batch size Queues: name length Philosophy: configure all the things! Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
It’s pre-alpha status (Don’t run this in production!) Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
GET /v1/queues/{queue} GET /v1/queues/{queue}/stats DELETE /v1/queues/{queue} Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
sqlite, mongodb Transport: wsgi (zmq in the works) Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
sqlite, mongodb Transport: wsgi (zmq in the works) Authentication: keystone, nova, endpoint (client-side) The idea is to be highly configurable Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
sqlite, mongodb Transport: wsgi (zmq in the works) Authentication: keystone, nova, endpoint (client-side) The idea is to be highly configurable You know what you need - you make the trade-offs Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
|-- base.py |-- helpers.py |-- __init__.py |-- wsgi ‘-- zmq ‘-- __init__.py # you can help make this happen! Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
you need to work with it python-marconiclient is. . . : Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
you need to work with it python-marconiclient is. . . : A Python API for communicating with a marconi server Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
you need to work with it python-marconiclient is. . . : A Python API for communicating with a marconi server A CLI that accomplishes the same Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
you need to work with it python-marconiclient is. . . : A Python API for communicating with a marconi server A CLI that accomplishes the same A reference implementation for alternate marconi clients Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
form, we have contributors (5-6) (We need more conributors!) Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
form, we have contributors (5-6) (We need more conributors!) We keep our code: Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
form, we have contributors (5-6) (We need more conributors!) We keep our code: Here: server Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
form, we have contributors (5-6) (We need more conributors!) We keep our code: Here: server And here: client Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi
form, we have contributors (5-6) (We need more conributors!) We keep our code: Here: server And here: client Join us on IRC: #openstack-marconi @ freenode Alejandro Cabrera (alejandro.cabrera@rackspace.com) Message Queues as a Service: Introducing Marconi