ARCHITECTURE GUIDELINES AND BEST PRACTICES FOR ... …

1 JANUARY 2017 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDEARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 2 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHERET able of ContentsOverview ..9 Document change log ..9 Audience ..9 SAP Acknowledgments ..9 Introduction ..9 Production Support ..10 Enabling Products and Technologies ..13 SAP HANA ..13 Real-time Analytics ..14 Real-time Applications ..15 OLTP Workloads ..15 SAP HANA Deployment Options ..15 SAP HANA Scale-Up Option ..17 SAP HANA Scale-Out Option ..21 SAP HANA Appliance Model ..23 SAP HANA Tailored Datacenter Integration (TDI) ..24 SAP HANA TDI Support Process ..25 vmware vSphere ..26 vmware vSphere 6 .x New Features ..28vSphere 5 .5 vs 6 .0 ..30 vmware Resource Isolation and Security Basis for SAP HANA Multi-VM.

2 32 vmware vMotion (Live Migration) ..35 Migrating SAP HANA Databases with vmware vMotion ..37 Why is it critical to follow these best PRACTICES ? ..40 Managing SAP HANA Landscapes Using vmware DRS ..42 vmware High Availability ..44 SAP HANA VM Clones and Template ..46 vmware Host Profiles ..47 Migration from vSphere 5 .5 to vSphere 6 .x ..47 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 3 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREV irtualized SAP HANA Reference ARCHITECTURE ..48 General Concepts and Overview ..49 ARCHITECTURE Overview ..49 Storage Layer ..53 Virtual Machine File System ..54 Datastores ..54 NFS Datastores ..55 SCSI Adapters ..56 File System Considerations and Alignment ..57 Server and Network Layer ..61 SAP HANA on vSphere Server Considerations ..62 Virtual CPUs (vCPUs) and Hyperthreading ..62 Memory Considerations.

3 64 Non-Uniform Memory Access ..65 SAP HANA on vSphere Network Considerations ..68 Virtualization Layer ..74 Application and OS Layer ..76 Management Layer ..76 Availability Considerations for vCenter Server ..77 SAP HANA on vSphere High Availability (HA) ..77 SAP HANA High Availability Solutions Overview ..79 Fault Recovery ..80 SAP HANA Service Auto-Restart .. 80 Host Auto-Failover (standby host) ..80 vmware vSphere HA for SAP HANA ..80 vmware vSphere HA with External Cluster or Monitoring Solution for SAP HANA ..85 Disaster Recovery (DR) ..87 SAP HANA Data Persistence ..87 SAP HANA on vSphere Backup and Restore ..88 SAP HANA on vSphere Storage Replication ..89 Storage-based Replication .. 90 vmware vSphere Replication ..91 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 4 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHERESAP HANA system replication.

4 93 vmware vSphere Site Recovery Manager (SRM) ..95 Virtual SAP HANA Sizing ..96 Virtual SAP HANA Sizing Considerations ..96 SAP HANA Sizing Procedure ..100 Using SAP Quick Sizer HANA version (new systems) ..103 Using SAP HANA sizing reports to determine the memory and disk requirements of SAP HANA (existing systems) ..111 HANA database server selection process based on memory requirements 112 Virtual HANA Configuration Examples ..120 Deployment Options and Support Status ..122 best PRACTICES Configuration ..124 best PRACTICES Optimizing SAP HANA on vSphere ..126 Monitor and verify an SAP HANA installation ..132 Performance Optimization for Production-Level SAP HANA VMs ..132 Support Process for SAP HANA on vmware vSphere ..138 Summary ..140 vmware Acknowledgments ..140 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 5 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREList of FiguresFigure 1: SAP HANA: The Platform for All Applications.

5 13 Figure 2: SAP HANA In-memory Platform for a New Class of Real-time Analytics and Mission-Critical Applications10 ..14 Figure 3: Scaling Options of an SAP HANA System on vmware vSphere ..17 Figure 4: SAP HANA Single-Host System (Scale-Up) Configuration ..18 Figure 5: SAP HANA Multi-VM Single-Host System (Scale-Up) Configuration ..19 Figure 6: SAP HANA Landscape Consolidation Example ..20 Figure 7: SAP HANA Multiple-host System (Scale-Out) on vSphere Configuration ..22 Figure 8: SAP HANA Scale-Out/Multiple VM Landscape Consolidation ..23 Figure 9: SAP Tailored Datacenter Integration (TDI) ..25 Figure 10: vmware vSphere Virtual Infrastructure ..28 Figure 11: HPE vSphere 5 .5 vs 6 .0 SAP HANA BW-EML Benchmark Results ..31 Figure 12: Comparison between vSphere 5 .5, 6 .0 and 6 .5, *1, with specific OEM partners, *2 as of writing this guide only 4 TiB are currently supported.

6 6 TiB tests are on the roadmap ..31 Figure 13: Co-deployment and Consolidation of Independent and Different SAP Workloads on a Server ..33 Figure 14: Transparent Page Sharing Page-Content Hashing ..33 Figure 15: Network Isolation of a Virtualized Server Environment ..34 Figure 16: vmware vMotion ..35 Figure 17: Non-critical vMotion Scenarios ..41 Figure 18: Critical vMotion Scenario ..41 Figure 19: Maintenance Window After a HW Upgrade and vMotion ..42 Figure 20: vmware Distributed Resource Scheduler ..43 Figure 21: vmware HA/DR Solutions Protection at Every Level ..44 Figure 22: vmware High Availability .. 45 Figure 23: Virtualized SAP HANA High-level ARCHITECTURE ..50 Figure 24: vmware vCenter Server ..51 Figure 25: Converting a Virtualized SAP HANA Scale-Up to a Scale-Out System ..52 Figure 26: SAP HANA TDI Scale-Up and Scale-Out Systems Sharing a Single TDI Storage.

7 52 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 6 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREF igure 27: Virtual Machines Accessing Different Types of Storage ..53 Figure 28: SAP Recommended SAP HANA File System Layout ..56 Figure 29: Virtualized SAP HANA Disk Layout of a Scale-Up System ..59 Figure 30: SAP HANA on vSphere 6 .0 Certification ARCHITECTURE ..61 Figure 31: CPU Utilization Across All Virtual Machines ..64 Figure 32: Node Boundaries and VM Placement ..66 Figure 33: SAP HANA on vSphere NUMA best PRACTICES ..66 Figure 34: NUMA Node Sharing Example with Haswell 18-Core System ..67 Figure 35: SAP HANA VM with 36 vCPUs and 500 GiB RAM, Sized to Fit into a Single NUMA Node (CPU Socket) of an 18-Core CPU with 512 GiB RAM Attached ..67 Figure 36: vSphere Standard Switch ARCHITECTURE ..69 Figure 37: Logical Network Connections per SAP HANA Server.

8 70 Figure 38: vSphere SAP HANA Scale-Out Network Configuration of a Virtualized 3+1 SAP HANA Scale-Out System ..73 Figure 39: vSphere Versions Compared ..75 Figure 40: SAP HANA Hardware Directory OS Filter Criteria ..76 Figure 41: SAP HANA System High Availability Phases ..78 Figure 42: vmware vSphere HA Combined with SAP HANA Service Auto-Restart ..81 Figure 43: SAP HANA Protected Systems via vSphere HA ..83 Figure 44: vmware HA VM Restart After OS Failure ..83 Figure 45: vmware HA - Protection Against Host Failures ..84 Figure 46: SAP HANA Service Auto-Restart Feature Combined with vmware HA ..85 Figure 47: SAP HANA System Replication as Fast RTO Cluster Solution ..87 Figure 48: SAP HANA Data Persistence ..88 Figure 49: SAP HANA Backup and Recovery Methods ..89 Figure 50: SRM Configure Replication per VM ..92 Figure 51: Configure RPO per VM ..92 Figure 52: SAP HANA on vSphere Replication.

9 94 Figure 53: SAP HANA Site Failover Managed by vmware SRM ..96 Figure 54: General SAP HANA Sizing Procedure with Building Blocks, Sizing Guide ..101 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 7 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREF igure 55: Sizing Result of an SAP Simple Finance on HANA Application, Quick Sizer Version 244 ..105 Figure 56: SoH Sizing Example Based on Quick Sizer Result ..106 Figure 57: Sizing Result of an SAP Business Warehouse Powered by SAP HANA Application, Quick Sizer Version 244 ..106 Figure 58: BWoH Sizing Example Based on Quick Sizer Result ..107 Figure 59: Excerpt from a BW Sizing Report ..111 Figure 60: Certified SAP HANA Hardware Directory ..114 Figure 61: vmware Compatibility Guide ..115 Figure 62: vmware HCL Results View ..115 Figure 63: Detailed View of a Server in the vmware HCL ..116 Figure 64: HANA Certified Directory Server Detailed View.

10 116 Figure 65: Server Configuration Example with Three Independent SAP HANA Instances and 1 .5% RAM Overhead ..118 Figure 66: Example Server Non-production Configuration with Five Independent SAP HANA Instances ..120 Figure 67: Example Server Configuration for SoH Instances on 4-Socket 4 TB E7-v4 Systems ..121 Figure 68: Example Server Configuration for BWoH Instances on 4-Socket 2 TB E7-v4 Systems ..121 Figure 69: SAP Support Workflow for vmware Related Escalations ..139 ARCHITECTURE AND TECHNICAL CONSIDERATIONS GUIDE | 8 ARCHITECTURE GUIDELINES AND best PRACTICES FOR DEPLOYMENTS OF SAP HANA ON vmware VSPHEREList of TablesTable 1: SAP HANA vSphere Version Support Status as of December 2016 ..11 Table 2: SAP HANA vSphere 5 .5 Support Status per Use Case and Workloads as of December 2016 ..12 Table 3: SAP HANA vSphere 6 .0 Support Status per Use Case and Workloads as of December 2016.