LoadRunner and Performance Center
cancel

Uncover the potential of Network Virtualization Insights—now available from LoadRunner!

Uncover the potential of Network Virtualization Insights—now available from LoadRunner!

hilale

Dan Belfer.jpg

This post was written by Dan Belfer, from the Performance Quality Assurance Team

 

One of the new and exciting features that was added to Performance Center 12.53—NV Insights—is now available from Hewlett Packard Enterprise LoadRunner 12.53 Patch 2.

Network Virtualization Insights analyzes application performance under various load and network conditions according to the scripts in a scenario. Its comprehensive network analysis report comprises information suitable for various audiences—from top-level managers to performance engineers. Starting from the high-level dashboard, the report is divided into multiple sections. This enables customers to drill down and focus on specific interests and gain insight about each and every transaction and virtual location. The report also provides invaluable guidelines on how to optimize an application for improved performance. (Link to NV Insights report demo)

In this blog, I want to give a hands-on example of running a simple Web HTTP/HTML script that runs in Controller and generates an NV Insights report at the end of the run.

Here are some preliminary guidelines:

  • Network Virtualization must be installed on the Load Generator machine (Windows only). During full standard installation, NV4HPControllerSetup.exe and NV4HPLGSetup.exe are installed automatically. You can find the files for a custom installation under <DVD_folder>\Additional Components\HP NV.
    Standalone Load Generator installations install NV4HPLGSetup.exe, by default.
  • Not all LoadRunner protocols are covered, but TruClient and Web-based protocols are included.
  • NV Insights is enabled only when the ‘Enable Network Virtualization’ checkbox is selected in the Virtual Location Settings dialog box.
  • When adding virtual locations on Controller, use the ‘Per Group’ mode.
  • Likewise, NV Insights is enabled only for the scenarios configured in the "Vuser Group" mode (not "Percentage" mode).
  • When defining virtual locations to be used together with NV Insights, make sure to turn on the "Enable packet capture" setting.
  • When working with unique parameters, make sure you have enough unique parameter values for an additional 2 Vusers that are added to each group; for which NV Insights is activated (more on this below).

NV Insights uses a specialized mechanism that collects data by running two additional Vusers (free of charge) on every group for which "NV Insights" is selected. The first additional Vuser runs without network emulation at the beginning of the script, providing a baseline for later comparison. The second additional Vuser runs with the same network emulation as the one defined for its Vuser group; and is launched together with the last Vuser from the group, i.e. at the peak of the group's activity. Each of these additional Vusers runs for one iteration only , and thus their presence does not distort the results of the original load test in any significant manner. At the end of the run, NV Insights compares the results for each transaction and virtual location pair and generates a report.

Let’s dig in with a simple example of a scenario that runs with one group using a WEB/HTTP/HTML script. We’ll run the test on localhost with network emulation , selecting the “NV Insights” for every group.

 

In the scheduler, we are selecting 4 Vusers in total, each one starts after 15 seconds.

 NV Insights edit action.png

 

We want to add emulation to the group, so let’s define ‘Emulation_300’ with 300ms latency and 3 percent packet loss.

Virtual Location settings.png

Finally, to add NV Insights to our run, in the ‘Run’ tab, we’ll select the new ‘NV Insights’ column check box for our group. By default, this column is un-checked. You can see that NV Insights will run on the group because the following message is displayed:

 

Here’s what the scenario looks like before starting the run.

 

NV emulation 3000.png

 

When the run starts, two additional groups appear, each with one Vuser. These are the groups added by NV Insights.

NV Scenario groups.png

 

At the beginning of the run, the first regular Vuser runs with emulation, and the baseline Vuser added for NV Insights runs without emulation.

NV Scenario groups baseline.png

After the baseline run finishes, the scenario continues.

NV Scenario groups group name.png

 

When all Vusers are running, the ‘peak’ Vuser is added for NV Insights.

NV Scenario groups reached peak of run.png

 

The NV Insights Vuser finishes running after one iteration.

NV Scenario groups web http.png

Running the additional Vusers for NV Insights doesn’t affect the scenario run with emulation – as we can see, nothing changes.

average latency.png

 

The emulation runs with 300ms and the average latency measures ~300ms as expected.

Also, packet loss is ~3 percent as expected.

Packet loss.png

 

At the end of the run, data collection is activated and .zip files with data are collected to the results folder. This may take a few minutes.

Summary Data Processing.png

 After the NV Insights data is processed, the extra Vusers are removed from the ‘Run’ tab.

NV Scenario remove run tab.png

 

When there are files to be shown and no error is reported, the ‘NV Insights’ button is enabled.

NV Scenario Diagnostics tools.png

You can also activate it from the Results menu.

NV insights results.png

 

After clicking ‘NV Insights’, a message tells us that the report is being generated.

 

 Then a new window opens with the report. Here we see part of the dashboard.

NV Analytics Report Default.png

 

Only thing left to do is dig in…

NV Insights is an exciting feature that reveals problems and provides optimizations for the scenario being run.

Remember:

  1. NV Insights Vusers do not consume a license – they’re free of charge.
  2. Unique parameters that are part of the script should take into account the additional 2 Vusers in your scenario design. For example, if you defined 10 parameters and there are 10 Vusers, the first baseline Vuser consumes a parameter, so when you arrive at the 9th regular Vuser, it will fail.

Hope this blog was clear enough. NV Insights is definitely worth using. It has lots of benefits for performance engineers.

Interested in more information about NV Insights report in LoadRunner?, Visit the LoadRunner Help Center.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

  • Load Testing
About the Author

hilale

Comments
Occasional Visitor

Nice post Dan!

Regular Contributor.

I think I know more about NV insight feature.

Acclaimed Contributor

Great info on the new feature... loking forward to use it.

//Add this to "OnDomLoad" event