IncludeOS on VMware/ESXi/vSphere
IncludeOS has, since its inception, supported the paravirtualized drivers for virtio-net. Our deployment platforms where the ones that support virtio. KVM/Qemu, Virtualbox, Openstack and the Google Compute Engine. We’ve now expanded our support adding ESXi to our list of supported platforms. ESXi is the hypervisor powering all of VMware’s enterprise products. Here is how this support came about.
One of our industrial partners, Basefarm, had an experimental Openstack platform and they gave us a whole lot of virtual servers. We moved our build and test systems into Openstack and things were working well. We expanded our partnership by working on what we internally refer to as Piranha - a load balancing product.
Earlier this year Basefarm decided to retire their Openstack installation. I’m not certain what the reasons for this was, but they have at least two other virtual platforms in production and I’m guessing they would prefer avoiding further complexity. This presented two problems for us. 1) where are we going to host our test and QA environment? And 2) what will happen to our Piranha?
Piranha will get a proper introduction in a later post, but the short and sweet of it is that we’re building a load balancing and firewalling platform on top of IncludeOS. Turns out load balancing and firewalling is an perfect task for a performant unikernel.
Redpill-Linpro, an open source-oriented hosting company, stepped forward and made some room in their openstack environment so we were able to move our internal infrastructure there rather quickly. Kudos to them for helping us out.
We were still forced to do something to get our load balancing project further along. Our goal is to have our load balancer in production before the end of the year. As most of Basefarms production systems run on VMware that became our next target. Since IncludeOS runs directly on x86 hardware and we had rudimentary IDE support (port IO, residing in src/hw/ide.cpp) it was already booting just fine - all we were really missing was a networking driver. Alf solved this by locking himself in his cave for a week emerging with a fully functional VMXNET3 driver for IncludeOS (src/drivers/vmnet3*).
So, we’re now in the position where IncludeOS boots and runs on ESXi and all the products that are capable of offering vmxnet3 paravirtualized drivers. This includes VSphere which is the core hypervisor platform Basefarm uses for their virtual servers as well as vcloud, the VMware cloud offering.
This means that you can now compile your IncludeOS image and deploy it on VMware as well as kvm/qemu. No changes are needed to your application’s source; simply add vmxnet3 to the list of drivers in your CMakeList. The IP stack will see this as just another NIC and configuration is as before. If you don’t mind adding a few Kb to your binaries you can simply link all network drivers into the image making it “universal”.
In May we demonstrated our load balancer platform for the Oslo VMware User Group. In attendance was VMware’s chief technologist Cormac Hogan. He summarised the presentation in a blog post My first look at unikernels on VSphere.
If you think this might be relevant to you, feel free to reach out to me on twitter or our Gitter chat or in any other way. I’m easy to find.