[Marconi] Kafka support and high throughput

asked 2014-05-29 08:52:00 -0600

keith-newstadt gravatar image

Has anyone given thought to using Kafka to back Marconi? And has there been discussion about adding high throughput APIs to Marconi.

We're looking at providing Kafka as a messaging service for our customers, in a scenario where throughput is a priority. We've had good luck using both streaming HTTP interfaces and long poll interfaces to get high throughput to other web services we've built. Would this use case be appropriate in the context of the Marconi roadmap?

Thanks,

Keith Newstadt

keith_newstadt@symantec.com

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
0

answered 2014-05-30 11:44:39 -0600

kgriffs gravatar image

updated 2014-05-30 11:46:46 -0600

Thanks for the great question; as it happens, the Marconi team has had several requests for a Kafka driver over the past few months. We are also looking at some other options, such as Redis, to serve high-throughput use cases. On the API side, we are discussing adding support for either long-polling or WebSocket, but haven't decided one way or the other yet.

The team would love to get some help prototyping a Kafka driver. If you are interested, please get in touch via the https://wiki.openstack.org/wiki/Mailing_Lists#Future_Development (openstack-dev mailing list) (using the prefix "[marconi]" in the subject), or via IRC in #openstack-marconi on Freenode.

edit flag offensive delete link more

Comments

Yes, we're interested. I'll reach out to discuss further.

Thanks, Keith

keith-newstadt gravatar imagekeith-newstadt ( 2014-06-05 09:47:04 -0600 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools

Stats

Asked: 2014-05-29 08:52:00 -0600

Seen: 142 times

Last updated: May 30 '14