NetApp has announced the launch of Spot Wave by NetApp, and Spot Ocean’s support of Microsoft Azure Kubernetes Service. Together, these products provide customers with leading solutions for simple, scalable, and efficient infrastructure for cloud-native applications.
Wave automates the provisioning, deployment, autoscaling and optimisation for running Apache Spark big data applications on Kubernetes in the cloud and helps to reduce cloud waste and costs by up to 90 percent. Using Wave as a turnkey product, organisations can deploy Spark environments faster and more easily, and focus on putting their data to work knowing that Wave is ensuring their infrastructure is continuously optimised for availability, performance, and cost.
Wave is built on Spot’s AI-based engine, using the same proven technology as Spot Ocean. Wave provides:
Cost optimisation: Wave runs Spark jobs on containerised infrastructure using an intelligent mix of spot, on-demand, and reserved instances, affording customers up to 90 percent cost savings on cloud infrastructure.
Serverless infrastructure and Spark-aware autoscaling: Built-in autoscaling matches the right type and size of compute instances to Spark jobs based on workload requirements to maximise performance and efficiency.
Spark job right-sizing and monitoring: Continuously tune Spark configuration for jobs based on analysis of actual Spark job requirements.
“Organisations are rapidly adopting Kubernetes to deliver cloud-native applications with greater speed and agility, not only for stateless services but also for big data applications,” said Amiram Shachar, vice president and general manager of Spot by NetApp. “The necessity for organisations to balance cloud infrastructure cost, performance and availability for optimal efficiency is complex and time-consuming. Spot Wave and Ocean are solving that problem by providing a serverless experience for Spark and ensuring their infrastructure is continuously optimised.”
NetApp also announced that Ocean, Spot’s serverless container engine and the foundation of Spot Wave, now supports Microsoft Azure Kubernetes Service (AKS), adding to its support for AWS ECS (Elastic Container Service) and EKS (Elastic Kubernetes Service), and Google’s GKE (Google Kubernetes Engine).
“Wave builds on the capabilities that we love in Ocean, focusing on the specific needs of big data applications,” said Gal Aviv, chief technology officer at Fyber. “It will be very powerful to be able to plug Spark applications into Wave. The solution also has the amazing value of executing jobs with existing tools and potentially spin up the right infrastructure to power intensive ML applications.”
NetApp and Spot by NetApp have deep histories of involvement and experience in Kubernetes and the Kubernetes community. With ongoing investments in NetApp and Spot by NetApp products for Kubernetes, NetApp provides the leading solutions and capabilities for application-driven infrastructure and data management needed by companies to run critical cloud-native applications.
Thanks for your insight for your fantastic posting. I’m glad I have taken the time to see this.