Ask Your Question

[Marconi] Kafka support and high throughput

asked 2014-05-29 08:52:00 -0500

keith-newstadt gravatar image

Has anyone given thought to using Kafka to back Marconi? And has there been discussion about adding high throughput APIs to Marconi.

We're looking at providing Kafka as a messaging service for our customers, in a scenario where throughput is a priority. We've had good luck using both streaming HTTP interfaces and long poll interfaces to get high throughput to other web services we've built. Would this use case be appropriate in the context of the Marconi roadmap?


Keith Newstadt

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2014-05-30 11:44:39 -0500

kgriffs gravatar image

updated 2014-05-30 11:46:46 -0500

Thanks for the great question; as it happens, the Marconi team has had several requests for a Kafka driver over the past few months. We are also looking at some other options, such as Redis, to serve high-throughput use cases. On the API side, we are discussing adding support for either long-polling or WebSocket, but haven't decided one way or the other yet.

The team would love to get some help prototyping a Kafka driver. If you are interested, please get in touch via the (openstack-dev mailing list) (using the prefix "[marconi]" in the subject), or via IRC in #openstack-marconi on Freenode.

edit flag offensive delete link more


Yes, we're interested. I'll reach out to discuss further.

Thanks, Keith

keith-newstadt gravatar imagekeith-newstadt ( 2014-06-05 09:47:04 -0500 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools


Asked: 2014-05-29 08:52:00 -0500

Seen: 147 times

Last updated: May 30 '14