VMware Validated Design Reference Architecture Guide

1 VMware Validated Design Reference Architecture Guide VMware Validated Design for Software-Defined Data Center This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this document, see EN-002167-00 VMware Validated Design Reference Architecture Guide 2016 VMware , Inc. All rights reserved. Page 2 of 208 You can find the most up-to-date technical documentation on the VMware Web site at: The VMware Web site also provides the latest product updates. If you have comments about this documentation, submit your feedback to: 2016 VMware , Inc. All rights reserved.

2 This product is protected by and international copyright and intellectual property laws. This product is covered by one or more patents listed at VMware is a registered trademark or trademark of VMware , Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. VMware , Inc. 3401 Hillview Avenue Palo Alto, CA 94304 Validated Design Reference Architecture Guide 2016 VMware , Inc. All rights reserved. Page 3 of 208 Contents 1 Purpose and Intended Audience .. 12 2 Architecture Overview .. 13 Physical Infrastructure Architecture .. 14 Pod Architecture .. 14 Physical Network Architecture .. 16 Availability Zones and Regions.

3 22 Virtual Infrastructure Architecture .. 24 Virtual Infrastructure Overview .. 24 Network Virtualization Architecture .. 26 Cloud Management Platform Architecture .. 31 Logical Design of the Cloud Management Platform .. 32 Operations Architecture Overview .. 35 vSphere Data Protection Architecture .. 35 vRealize Operations Manager Architecture .. 36 vRealize Log Insight Architecture .. 39 3 Detailed Design .. 42 Physical Infrastructure Design .. 42 Physical Design Fundamentals .. 43 Physical Networking Design .. 49 Physical Storage Design .. 59 Virtual Infrastructure Design .. 68 Virtual Infrastructure Design Overview .. 69 ESXi Design .. 71 vCenter Server Design .. 73 Virtualization Network 85 NSX Design .

4 99 Shared Storage Design .. 121 Cloud Management Platform Design .. 138 vRealize Automation Design .. 139 vRealize Orchestrator 171 Operations Infrastructure Design .. 180 vSphere Data Protection Design .. 181 vRealize Operations Manager Design .. 188 vRealize Log Insight Design .. 198 VMware Validated Design Reference Architecture Guide 2016 VMware , Inc. All rights reserved. Page 4 of 208 List of Tables Table 1. Design Elements and Components of the Cloud Management Platform .. 31 Table 2. Characteristics of the Cloud Management Platform Design .. 32 Table 3. Cloud Management Platform Elements .. 33 Table 4. vRealize Operations Manager Logical Node Architecture .. 39 Table 5. Regions .. 43 Table 6.

5 Availability Zones and Regions Design Decisions .. 44 Table 7. Required Number of Racks .. 45 Table 8. POD and Racks Design Decisions .. 46 Table 9. ESXi Host Design Decisions .. 48 Table 10. Host Memory Design Decision .. 49 Table 11. Jumbo Frames Design Decisions .. 53 Table 12. VLAN Sample IP Ranges .. 56 Table 13. Physical Network Design 58 Table 14. Additional Network Design Decisions .. 59 Table 15. Virtual SAN Physical Storage Design Decision .. 60 Table 16. Virtual SAN Mode Design Decision .. 61 Table 17. Hybrid and All-Flash Virtual SAN Endurance Classes .. 62 Table 18. SSD Endurance Class Design Decisions .. 62 Table 19. SSD Performance Classes .. 63 Table 20. SSD Performance Class Selection .. 64 Table 21.

6 SSD Performance Class Design Decisions .. 64 Table 22. Virtual SAN HDD Environmental Characteristics .. 65 Table 23. HDD Characteristic Selection .. 65 Table 24. HDD Selection Design 66 Table 25. NFS Usage Design Decisions .. 67 Table 26. NFS Hardware Design Decision .. 67 Table 27. Volume Assignment Design Decisions .. 68 Table 28. ESXi Boot Disk Design Decision .. 72 Table 29. ESXi User Access Design Decisions .. 73 Table 30. Other ESXi Host Design Decisions .. 73 Table 31. vCenter Server Design Decision .. 73 Table 32. vCenter Server Platform Design Decisions .. 74 Table 33. Platform Service Controller Design Decisions .. 75 Table 34. Methods for Protecting vCenter Server System and the vCenter Server Appliance.

7 76 Table 35. Logical Specification for Management vCenter Server Appliance .. 77 Table 36. Logical Specification for Compute and Edge vCenter Server 77 Table 37. vCenter Appliance Sizing Design Decisions .. 77 VMware Validated Design Reference Architecture Guide 2016 VMware , Inc. All rights reserved. Page 5 of 208 Table 38. vCenter Database Design Decisions .. 78 Table 39. vSphere HA Design Decisions .. 79 Table 40. vSphere Cluster Workload Design Decisions .. 80 Table 41. Management Cluster Design Decisions .. 81 Table 42. Management Cluster Attributes .. 81 Table 43. Edge Cluster Design Decisions .. 82 Table 44. Edge Cluster Attributes .. 82 Table 45. Compute Cluster Design Decisions .. 83 Table 46. Monitor Virtual Machines Design Decisions.

8 83 Table 47. vSphere Distributed Resource Scheduling Design Decisions .. 84 Table 48. VMware Enhanced vMotion Compatibility Design Decisions .. 84 Table 49. vCenter Server TLS Certificate Design Decisions .. 84 Table 50. Virtual Switch Design Decisions .. 87 Table 51. Virtual Switches for Management Cluster Hosts .. 88 Table 52. vSphere Distributed Switch Port Group Configuration Settings .. 88 Table 53. Management Virtual Switches by Physical/Virtual 89 Table 54. Management Virtual Switch Port Groups and VLANs .. 89 Table 55. Management VMkernel Adapter .. 90 Table 56. Virtual Switches for Edge Cluster Hosts .. 90 Table 57. vSphere Distributed Switch Edge Port Group Configuration Settings .. 91 Table 58. Edge Cluster Virtual Switches by Physical/Virtual NIC.

9 92 Table 59. Edge Cluster Virtual Switch Port Groups and 92 Table 60. Edge Cluster VMkernel Adapter .. 93 Table 61. Virtual Switches for Compute Cluster Hosts .. 93 Table 62. vSphere Distributed Switch Compute Port Group Configuration Settings .. 94 Table 63. Compute Cluster Virtual Switches by Physical/Virtual NIC .. 95 Table 64. Compute Cluster Virtual Switch Port Groups and VLANs .. 95 Table 65. Compute Cluster VMkernel Adapter .. 95 Table 66. NIC Teaming and Policy .. 96 Table 67. NIC Teaming Design Decision .. 96 Table 68. Network I/O Control Design Decision .. 97 Table 69. VXLAN Design Decisions .. 99 Table 70. NSX for vSphere Design Decision .. 100 Table 71. Consumption Method Design Decisions .. 102 Table 72.

10 NSX Controller Design Decision .. 103 Table 73. NSX for vSphere Physical Network Requirements .. 104 Table 74. Resource Specification of NSX Components .. 105 Table 75. NSX Edge Service Gateway Sizing Design Decision .. 106 Table 76. vSphere Compute Cluster Split Design Decisions .. 108 VMware Validated Design Reference Architecture Guide 2016 VMware , Inc. All rights reserved. Page 6 of 208 Table 77. VTEP Teaming and Failover Configuration Design Decision .. 110 Table 78. Logical Switch Control Plane Mode Decision .. 111 Table 79. Transport Zones Design Decisions .. 112 Table 80. Routing Model Design Decision .. 112 Table 81. Transit Network Design Decision .. 113 Table 82. Tenant Firewall Design Decision .. 114 Table 83.