All-in one: Openstack with Neutron + Ceph

asked 2014-02-20 07:02:29 -0600

Mathias Ewald gravatar image

Hi, I am planning to run an OpenStack cluster but for a couple of external reasons I cannot afford to have external non-compute nodes managing compute nodes. Right know, all I have is a single big server but need the flexibility to easily extend the environment server by server. Each server has a local RAID with a total 8TB of disk space. So I thought I will use CEPH for distributed and therefore shared storage allowing live migration. All OpenStack VMs (controller, network, etc) I wanted to place on the compute node as a KVM virtual machine. Maybe managed by pacemaker for automatic failover.

Any reasons not to or things to keep in mind? Did anyone try that before? And: Will the nova scheduler take into account those non-OpenStack systems?

cheers Mathias

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2014-02-23 19:11:07 -0600

SamYaple gravatar image

You again. You seem to be following my path exactly as I trekked through Openstack originally.

I did exactly what you are asking. I had a single node running all services. As I got some dev hardware in I slowly added new hardware to the whole stack. Eventually it was time to remove the original node as it was very old hardware. All in all it was fairly easy to do. I do not recommend packing up Neutron into a VM. I got it to work in a flat network, but it was a pain. Just run it on the bare metal with everything else and save yourself the headache.

Ceph gave me a good bit of trouble being on a single node, but once I added in some more monitors and hosts for OSDs it worked out. (Originally I had these OSDs inside of LVM partitions because i only had a finite number of disks. It was very non preformant).

In the end, The only part that I had to redo copmletely was the database. I went with MariaDB and galera as opposed to MySQL on a single node. But I was able to migrate the data itself, so no big loss.

As far as nova-scheduler goes, I don't have an answer for you.

edit flag offensive delete link more


Yeah I am with the NSA and know exactly what you're up to! Then do the same :D Can you be more specific about Neutron in a VM? What exactly was the pain? Regarding CEPH in a single node I will probably start with a simple EXT4 and then go to CEPH once I can bring in the second node.

Mathias Ewald gravatar imageMathias Ewald ( 2014-03-03 09:17:47 -0600 )edit

The neutron server will work in a VM, if you have a very strong grasp of linux networking and tunneling. I do not recommend it because it is hard and there is no real gain. I would suggest a chroot if you want to keep the services isolated. But just throwing them all onto one machine is also an option!

SamYaple gravatar imageSamYaple ( 2014-03-04 11:48:07 -0600 )edit

Get to know Ask OpenStack

Resources for moderators

Question Tools

1 follower


Asked: 2014-02-20 07:02:29 -0600

Seen: 809 times

Last updated: Feb 23 '14