Universal application platform for running any application anywhere.Comprehensive built-in security for protecting data, infrastructure, and access.Simplified customer experience for automation and management at scale.vSphere 6.7 supports both existing and next-generation applications through its: It provides a powerful, flexible, and secure foundation for business agility that accelerates the digital transformation to cloud computing and promotes success in the digital economy. VMware vSphere 6.7 is the next-generation infrastructure for next-generation applications. This section provides an overview of the technologies used in this solution: - VMware vSphere 6.7 - VMware vSAN 6.7 - Cloudera Enterprise Failover testing to demonstrate the vSAN resiliency with the comparison of FTT=1 and FTT=0 settings.Performance testing based on various workloads including Cloudera’s storage validation benchmarks, Hadoop benchmarks such as the TeraSort Suite and TestDFSIO, and Spark machine learning benchmarks including the new IoT Analytics benchmark from VMware.This solution is a performance showcase of running Hadoop workloads on vSAN: Note the Host Affinity feature requires VMware validation before the deployment. overhead of additional replication at the vSAN layer. However, HA/DRS needs to be turned off and upgrades and patches must be carefully managed.Ĭustomers have an option to choose either option based on the trade off, ease of operation vs. Host Affinity reduces additional storage overhead at the vSAN layer and better performance attributed to less writes (with FTT=1, higher IO amplification for additional replica). Notably, with FTT=1, vSAN ensures there is always at least one active current copy of data available while hosts are upgraded on a rolling basis.
With the FTT=1 option, vSAN maintains an additional layer of protection and all standard features such as VMware vSphere ® High Availability and VMware vSphere Distributed Resource Scheduler™, upgrades and patches work as-is. Host Affinity pins the data to the host running the VM and runs without any replication at the vSAN layer. For example, with host failures to tolerate (FTT) set to 1, vSAN maintains two copies of data and survive one host going down without impacting availability.Ī new policy called Host Affinity is introduced in vSAN 6.7.
VSAN supports various levels of failure protection. This storage can then be carved out in chunks and attached to a VM storage policy. The aggregated capacity is managed as a single resource pool. VMware vSAN is a hyperconverged storage platform that pools capacity from local disks across a VMware ESXi™ host cluster. This solution demonstrates the deployment varieties of running Hadoop workloads on VMware vSAN™ using the Cloudera Distribution including Apache Hadoop. IT departments are being tasked to provide server clusters to run Hadoop, Spark, and other Big Data programs for a variety of different uses and sizes. Server virtualization has brought its advantages of rapid deployment, ease of management, and improved resource utilization to many data center applications, and Big Data is no exception. Note: Check the latest Cloudera Data Platform on VMware Cloud Foundation Powered by VMware vSAN reference architecture. This section covers the business introduction and solution overview.