OpenStack Flamingo Reduces Technical Debt, Boosts Performance

Wait 5 sec.

The oldest open source Infrastructure as a Service (IaaS) cloud just celebrated its latest birthday with a new release.Flamingo, the latest version of OpenStack, comes with significant technical debt reduction and expanded enterprise features.The release — the 32nd major update — is marked by substantial improvements in concurrency, security, hardware support and a more flexible release cadence, solidifying its role in large-scale deployments, whether you want the latest and greatest features or slower, more stable releases.Flamingo is the result of the work of 480 contributors representing organizations including BBC R&D, Ericsson, NVIDIA, Rackspace, Red Hat, Samsung SDS, SAP and Walmart, integrating almost 8,000 code changes.Flamingo arrives with OpenStack powering over 55 million compute cores in production environments globally. It’s a long way from how the project began.The Origin Story of OpenStackIn 2008, people were still dismissing the cloud as just someone else’s computer. Top tech executives like Larry Ellison, Oracle’s CEO, dismissed cloud computing as simply the latest fashion.Everyone eventually got the message that the cloud was a fundamentally different paradigm, but some people were ahead of the game. One such group included developers at NASA Ames Research Center, Rackspace and Anso Labs, who together built the open source IaaS cloud, OpenStack.It wasn’t the first cloud. Contenders for that honor include the Amazon Elastic Compute Cloud, an ancestor of Amazon Web Services (AWS), and Microsoft Azure. Although they were built on Linux and other open source programs, they were proprietary platforms.In 2010, the Ames team wanted NASA to host and manage its own computing and data resources, and created Nebula, an early IaaS cloud. But, as Brian Gracely, then Red Hat’s senior director of product strategy, said in a 2020 post on NASA’s blog, “NASA didn’t have the staff to build the whole thing and maintain it long-term.”So, the Ames team went the open source route, and in doing so, helped lay the groundwork for OpenStack. The first major building block, Nova, is still part of OpenStack today. At the time, though, as one developer put it, “It’s live, it’s buggy, it’s beta. Check it out.”Simultaneously, Jonathan Bryce, co-founder of Rackspace, and his crew were working on their own open source cloud project. Then, Bryce told me, “We met these folks at NASA, and that went really well. So, we flew out to [Ames’ main campus] Moffett Field and spent a whole day with them.“The whole time, everybody was just sitting there nodding because we were rebuilding our stuff in Python. They were using Python. We picked the Apache 2 license. They picked the Apache 2 license. So, we were, ‘Yes, we have to join forces!'”A New Approach To Open Source CollaborationAnd they did. The first OpenStack release, Austin, appeared in 2010. Besides creating OpenStack, this would be the first time government-funded software had been released under an open source license.It was “a bit different than how open source had been approached,” recalled Bryce, who was named executive director of the Cloud Native Computing Foundation (CNCF) in June.“For the most part, open source projects were a collaboration among people who were trying to scratch their own itch or open core projects where a single company built an open source project heart, but all the extras were proprietary, and they owned the entire monetization process.”With OpenStack, he said, “We wanted open source software to be a key enabler of not just our business, but everyone’s business. So from the beginning, we were really interested in having a big ecosystem of folks coming together to build it all.”How OpenStack Became a Cloud Computing PowerhouseFrom its very first days, OpenStack had many companies investing in it and sharing the open source wealth. Early members, who are still with it today, include Dell, Cisco, Mirantis, and Red Hat. Today, OpenStack has thousands of contributors from more than 500 companies.Within a few years, OpenStack’s popularity exploded. HP, IBM, Red Hat, VMware and many other tech powers threw their support behind OpenStack.“A couple of things came together,” said Jim Curry, then Rackspace’s senior vice president of strategy and corporate development. “First, cloud technology and its form factor were hitting an inflection point. After several years, Amazon Web Services was just moving into the mainstream, and people were looking not just for an open source alternative, but for any AWS alternative.”It was more than that, Bryce said: “We had laid the groundwork, built the community and gotten the software to a point where its market ecosystem really started to go crazy.” It was being used for almost everything you could use a cloud for.To better manage the growing projects, its corporate backers and developers formed the OpenStack Foundation in September 2012. This was a nonprofit corporate entity to promote and manage OpenStack software and its community.Then, Bryce continued, “One of the most interesting and kind of unexpected technology turns happened. The telecom industry really started to engage with OpenStack. When we started OpenStack, we were thinking about data center software for distributed storage.”However, starting in 2014, software-defined networks (SDNs) and network functions virtualization (NFV) began to run as the backbones of cellular networks.OpenStack has become the default telecom cloud. Companies such as Verizon, AT&T, China Mobile and Deutsche Telekom have built their 5G infrastructure and SDNs to replace older 4G systems.At the same time, OpenStack was being used in what its creators had first dreamed up for it. As Bryce put it, “Everything from airlines, automobile manufacturers, financial services, government agencies and private, hybrid and public clouds are using OpenStack.”For example, in Europe, OpenStack is used as the foundation for public clouds. These include hyperscale clouds from Deutsche Telekom/T-Systems, Cleura Public Cloud and OVH Public Cloud. Then, there are unusual public clouds. One example: OneQuode, a Pacific Ocean-based cloud provider that specializes in delivering low-latency and high-speed gaming to customers from Korea to San Francisco and the islands in between.OpenStack and the Linux Foundation Join ForcesIn recent years, OpenStack has also been quietly growing in private clouds. For example, Korean automaker Hyundai uses OpenStack for its private cloud, hCloud.“There are several reasons why we are using OpenStack,” Younghold Han, Hyundai’s vice president of car cloud, told me. “First, there’s data security. We want to control our security.“And finally, there’s cost. So before Hyundai, I worked in Samsung’s mobile business unit. We launched multiple services for our users that ran on AWS, and you cannot imagine how the costs grew exponentially. So we built out our private cloud.”Besides this, OpenStack users kept exploring new use cases. For example, Bryce said, “TensorFlow came along, and now OpenStack is used for AI and machine learning [ML]. And it’s also being used for transcoding video at the edge, so people can watch 4K videos on their phones. Innovation never stops.”Additionally, other significant projects have emerged from OpenStack. These include Airship, a cloud-provisioning system; Kata Containers, lightweight, container-like virtual machines (VMs); StarlingX, an edge cloud stack; and Zuul, a CI/CD program. Thanks to these projects, starting in 2021, the OpenInfra Foundation evolved from the OpenStack Foundation to reflect a broader mission beyond just OpenStack.Recently, however, the OpenStack community took one more step. In March, the OpenInfra Foundation united with the Linux Foundation. Jim Zemlin, the Linux Foundation’s executive director, summed up the logic for this move in his keynote at his organization’s member summit that month: “OpenInfra and our cloud projects are kind of like peanut butter and chocolate.”Bryce, who still heads the OpenInfra Foundation as well as his new role at CNCF, said in his keynote at that March event, “We’re expanding our overall reach, and we’re going to be able to take open source more places.”The future looks bright for OpenStack and its new friends.What’s New in the OpenStack Flamingo Release?The Flamingo release’s headline achievement is the large-scale removal of Eventlet, a Python concurrency library that has been at the foundation of OpenStack for almost 18 years. This migration to modern Python async frameworks was completed in such OpenStack modules as Barbican, Heat, Ironicand Mistral. Progress has also been made in removing it from Nova and Neutron.These changes will reduce persistent operational problems and technical debt. Eventlet will eventually be entirely removed from OpenStack. The result will be improved performance, scalability and sustainability for this release and the ones that follow.“This progress in Eventlet migration has strengthened OpenStack for the long run,” said Goutham Pacha Ravi, chair of the OpenStack Technical Committee, in a statement. The transition means faster and more reliable bare-metal provisioning, improved concurrency and lower risk of unexpected side effects from outdated code dependencies.Moreover, Flamingo continues OpenStack’s move into confidential computing and reinforces access control. Key Flamingo upgrades include:Nova gains support for one-time-use passthrough devices and AMD SEV-ES secure enclave support.Magnum enables credential rotation for Kubernetes clusters — a critical security feature for cloud native deployments.Manila supports bring-your-own encryption keys for file servers.Horizon introduces QR code onboarding for two-factor authentication, streamlining secure cloud operations.These enhancements are designed to support modern workloads, such as AI, ML and high-performance computing, while bolstering privacy and data protection for enterprises.Introducing OpenStack’s New Release ScheduleWith Flamingo, OpenStack is introducing a “non-Skip Level Upgrade Release Process (SLURP)” six-month release. For some time now, there’s been a dispute between OpenStack users who preferred fast, every-six-month releases and others who wanted a year or even longer cadence between releases.In this compromise, every other release will be considered to be a SLURP release. Upgrades will be supported between SLURP releases, in addition to between adjacent major releases, as they are now.Companies wanting to stay on the six-month cycle will deploy every SLURP and “not-SLURP” release as always. Businesses wishing to move to a one-year upgrade cycle will synchronize on a SLURP release, and then skip the following “not-SLURP” release, and only upgrade when the subsequent SLURP is released.Got all that? The next SLURP release, OpenStack 2026.1 “Gazpacho,” is scheduled for April.In the meantime, we’ll soon see what users make of Flamingo. I suspect that thanks to its modernization of Python async frameworks, it will be the most popular OpenStack release to date.The post OpenStack Flamingo Reduces Technical Debt, Boosts Performance appeared first on The New Stack.