Pinterest Automates Hadoop Cluster Scaling and Migration with Internal Orchestration System

Wait 5 sec.

Recently, Pinterest disclosed its internal orchestration framework, called Hadoop Control Center (HCC), to automate the scaling and migration of its large-scale Hadoop clusters. This move addresses the operational complexity and limitations Pinterest previously faced when managing thousands of nodes across dozens of YARN clusters on AWS. By Claudio Masolo