EUC Score Test Results

[List of Test Results Collected with EUC Score Experiments]

VMware Horizon

Benchmarking different aspects of VMware Horizon and the Blast protocol. The test results presented here are a subset of the complete dataset collected during VMware Horizon test sequences. Click on a link below to navigate to a test sequence and select a Sync Player clip.

VMware Test Drive 2023 - GPU versus No GPU

Test Engineer: Benny Tritsch Date of test: 19 Oct 2023

Test Goal

Explore the difference between a Blast connection to a VMware TestDrive VM with NVIDIA L40-2Q GPU versus a VM without GPU.

 

Selected Sync Player Clips

Simload and Link View and Type Observation
Sync Player SL1-MSEdgeAquariumWebGL SxS View - GPU Very smooth animation at 60fps with GPU (10% load). The CPU load goes to almost 100% without GPU, but renders only 4fps and is choppy.
Sync Player SL1-MSEdgeVideoGrid9 SxS View - GPU Video decode can be offloaded to GPU and produces significantly higher video frame rate at the price of a 4 times higher network consumption.

Summary of Test Observations

Adding a GPU significantly improves the perceived remote user experience, despite the 175ms round trip time of the connections.

 

Test Setup Details

TestDrive VM with NVIDIA L40-2Q

TestDrive VM with no GPU

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage, NVIDIA L40-2Q GPU.

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage, no GPU.

Connection: VMware Blast from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Connection: VMware Blast from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

 

VMware Test Drive 2023 - Blast versus PCoIP

Test Engineer: Benny Tritsch Date of test: 19 Oct 2023

Test Goal

Analyze the difference between a high-latency Blast connection versus a high-latency PCoIP connection to a VMware TestDrive VM with an NVIDIA L40-2Q GPU partition.

 

Selected Sync Player Clips

Simload and Link View and Type Observation
Sync Player SL1-FurMarkOpenGL SxS View - GPU Smooth rendering at 60fps with Blast (35% GPU load). Choppy rendering at 15fps with PCoIP (2% GPU load).
Sync Player SL1-RollercoasterDX9 SxS View - GPU 60fps on the Blast side. 15fps, choppy rendering and significantly higher bandwidth requirements on the PCoIP side.
Sync Player SL1-MSEdgeVideoGrid SxS View - GPU Great video quality with Blast. Very choppy videos with PCoIP. Note the different usage of the GPU's video decoder.
Sync Player SL3-GDIPlusRect SxS View - GPU Score: 1.88 with Blast, 1.9 with PCoIP (smaller is better). Very choppy screen output on the PCoIP side.

Summary of Test Observations

With a network round trip time of 175ms, the Blast connection performs better than the PCoIP connection for many Simloads. IMPORTANT: The results may be a lot more in favour of PCoIP under low latency network conditions.

 

Test Setup Details

TestDrive VM with Blast Protocol

TestDrive VM with PCoIP Protocol

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage, NVIDIA L40-2Q.

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage, NVIDIA L40-2Q.

Connection: Blast from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Connection: PCoIP from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

 

VMware Test Drive 2023 - Blast versus "Web Blast"

Test Engineer: Benny Tritsch Date of test: 19 Oct 2023

Test Goal

Compare a high-latency Blast connection from the full Horizon client with a high-latency Blast connection from a Chrome browser ("Web Blast").

 

Selected Sync Player Clips

Simload and Link View and Type Observation
Sync Player SL1-ChromePhotoGalleryJS SxS View - STD Smooth animation on the Blast side. Slightly choppy animation and transitions on the Web Blast side.
Sync Player SL1-MSEdgeVideoConf6 SxS View - STD Very good video performance on the Blast side. Choppy videos on the Web Blast side.
Sync Player SL1-RollercoasterDX9 SxS View - STD 10 to 15fps on the Blast side. Lower frame rate and artifacts on the Web Blast side.

Summary of Test Observations

Perceived user experience is the same for most Simloads, independently if connected from the full Horizon client or from a Chrome web browser. But some Simloads show different results, depneding on the nature of the application running in the remote session.

 

Test Setup Details

TestDrive VM with Blast Protocol

TestDrive VM with PCoIP Protocol

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage.

System Under Test: VMware TestDrive, Windows 11, Intel Xeon Gold 6330 2x2vCPUs @ 2.00GHz, 8GB RAM, 120GB Storage.

Connection: Blast from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Connection: "Web Blast" from the EUC Score lab in Germany to VMware TestDrive in the US, 175ms round trip time.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.

 

VMware Test Drive 2022

Test Engineer: Benny Tritsch Date of test: 22 May 2022

Test Goal

Measure the perceived user experience over a Blast connection from the EUC Score lab in Germany toa GPU-accelerated session hosted on VMware Test Drive located in VMware's Houston datacenter.

 

Selected Sync Player Clips

Simload and Link View and Type Observation
Sync Player SL1-BSPBlendingDX11 Single View - GPU Great application response time despite 130ms network round trip time. 3D load stays low, showing the power of the NVIDIA V100 GPU.
Sync Player SL1-ChromeFishbowlHTML5 Single View - GPU Growing outgoing network bandwidth on growing number of fish objects in the bowl.
Sync Player SL1-DominoOpenGL Single View - GPU VMware Horizon limits the frame rate on the session side to 60fps, keeping CPU and GPU consumption low.
Sync Player SL1-MSEdgeVideoConf6 Single View - GPU Decoding of the six videos is offloaded to the GPU, keeping CPU consumption low.
Sync Player SL1-MSEdgeWaterWebGL Single View - GPU Rendering of the water after user interaction at highest quality level.

Summary of Test Observations

The VMware Test Drive VM shows outstanding performance despite 130ms round trip time.

 

Test Setup Details

  • System Under Test: VMware Test Drive, Windows 10, Xeon Gold 6140 4vCPUs @ 2.3GHz, 8GB RAM, VMware Virtual disk SCSI Disk Device 150GB, NVIDIA GRID V100-2Q vGPU, 2GB VRAM.
  • Connection: VMware Blast, 130ms round trip time.
  • Endpoint: NUC2, Intel NUC 8i7HNK with Windows 11, i7-8705G CPU @ 3.10GHz, 16GB RAM, 500GB Samsung SSD 850 EVO M.2, AMD Radeon RX Vega M GL, 4GB VRAM.