Software-defined storage is a key technology in the SDDC. This design uses VMware Virtual SAN (vSAN) to implement software-defined storage for the management clusters.

vSAN is a fully integrated hypervisor-converged storage software. vSAN creates a cluster of server hard disk drives and solid state drives, and presents a flash-optimized, highly resilient, shared storage datastore to hosts and virtual machines. vSAN allows you to control capacity, performance, and availability on a per virtual machine basis through the use of storage policies.

The software-defined storage module has the following requirements and options.

Minimum of 3 hosts providing storage resources to the vSAN cluster.

vSAN is configured as hybrid storage or all-flash storage. 

A vSAN hybrid storage configuration requires both magnetic devices and flash caching devices.

An All-Flash vSAN configuration requires vSphere 6.0 or later.  

Each ESXi host that provides storage resources to the cluster must meet the following requirements.

Minimum of one SSD. The SSD flash cache tier should be at least 10% of the size of the HDD capacity tier.

Minimum of two HHDs.

RAID controller compatible with vSAN. 

10 Gbps network for vSAN traffic \ with Multicast enabled.

vSphere High Availability Isolation Response set to power off virtual machines. With this setting, no possibility of split brain conditions in case of isolation or network partition exists. In a split-brain condition, the virtual machine might be powered on by two hosts by mistake. See design decision SDDC-VI-VC-012 for more details. 

vSAN Physical Storage Design Decision 

Decision ID

Design Decision

Design Justification

Design Implication

SDDC-PHY-STO-001

Use one or more 200 GB or greater SSD and two or more traditional 1 TB or greater HDDs to create at least a single disk group in the management cluster.

Using a 200 GB SSD and two 1 TB HDD's allows enough capacity for the management VMs with a minimum of 10% flash-based caching.

When using only a single disk group you limit the amount of striping (performance) capability and increase the size of the fault domain.

vSphere offers two different vSAN modes of operation, all-flash or hybrid.

Hybrid Mode

In a hybrid storage architecture, vSAN pools server-attached capacity devices (in this case magnetic devices) and caching devices, typically SSDs or PCI-e devices to create a distributed shared datastore.

All-Flash Mode

vSAN can be deployed as all-flash storage. All-flash storage uses flash-based devices (SSD or PCI-e) only as a write cache while other flash-based devices provide high endurance for capacity and data persistence.

vSAN Mode Design Decision

Decision ID

Design Decision

Design Justification

Design Implication

SDDC-PHY-STO-002

Configure vSAN in hybrid mode in the management cluster.

The VMs in the management cluster, which are hosted within vSAN, do not require the performance or expense of an all-flash vSAN configuration.

vSAN hybrid mode does not provide the potential performance or additional capabilities such as deduplication of an all-flash configuration.