Knowledge Base

[#1]

CloudTest provides collection charts for standard deviation and 90%, 95%, and 98% percentile. These charts assume a normal distribution in calculations. Additionally, CloudTest calculates a 1 tailed confidence interval, meaning that the outliers removed to obtain the 90th percentile are the slow response times but not the really fast ones. For percentile charts, the user can select from among the default percentile values (e.g. 90%, 95%, or 98%). For each of the percentile selections, the corresponding Z-Value is also shown. A new Z-Value can be entered here for any of the drop-down percentile values. Selecting a new percentile will result in a reset to the default z-value.
To display settings for percentile or any other charts, click the Toggle Edit Mode button on the dashboard toolbar while a given chart is selected (or select the chart while in Edit Mode). Standard deviation charts include the same chart settings as other collection-based charts, with the option to include Stopped Collections or Failed Collections, which are not included by default.
Collection Completion Time Percentile This chart shows the requested percentile of collection completion time for each period with a separate series for each collection.
Collection Completion Time Standard Deviation This chart shows the standard deviation of collection completion time for each period with a separate series for each collection.
Top N Collections by Percentile This chart presents the top n collections by the selected percentile. As in prior releases, five is the default number shown for n.
Top N Collections by Standard Deviation This chart presents the top n collections by the standard deviation. As in prior releases, five is the default number shown for n.
Standard Deviation and Percentile Columns in the Collection Analysis Widget The Collection Analysis widget displays both Standard Deviation and Percentile columns. To view these columns, it may be necessary to scroll to the right (depending on your dashboard layout and screen resolution). CloudTest currently supports 90%, 95%, and 98% percentile data for the Percentile column. It is possible to view other percentile data when exporting CSV and Excel spreadsheets.
Standard Deviation/Percentile Columns in Exported Collection Aggregate Data The Standard Deviation and Percentile columns are also viewable in data exported from a given test result to both the CSV and XML Spreadsheet format. Select the result in either the Compositions or Results list in Central. Right click and then choose Export. In the Export dialog box, Export format drop-down, select either CSV or Excel Spreadsheet.
In the Data Source drop-down, select Collection Aggregate.
When the download prompt appears, select a download folder or choose to open the file in an application. The new columns appear in the exported file as (shown right).