F5 Logo MyF5
Search
  1. MyF5 Home
  2. BIG-IP Analytics: Implementations
  3. Examining and Exporting Application Statistics
Manual Chapter : Examining and Exporting Application Statistics

Applies To:

Show Versions Show Versions

BIG-IP AAM

  • 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP APM

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP Analytics

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP Link Controller

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP LTM

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP PEM

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP AFM

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP DNS

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0

BIG-IP ASM

  • 17.1.0, 17.0.0, 16.1.5, 16.1.4, 16.1.3, 16.1.2, 16.1.1, 16.1.0, 16.0.1, 16.0.0, 15.1.10, 15.1.9, 15.1.8, 15.1.7, 15.1.6, 15.1.5, 15.1.4, 15.1.3, 15.1.2, 15.1.1, 15.1.0
Manual Chapter

Examining and Exporting Application Statistics

Overview: Examining and exporting application statistics

This implementation describes how to view application statistics on the BIG-IP system. It describes how you can examine the statistics in the Analytics charts when Application Visibility and Reporting (AVR) is provisioned. Analytics charts display statistical information about traffic on your system. The system updates the information every five minutes.
The Overview screen shows all of the HTTP statistics in one place, including averages for transactions per second (TPS), request and response throughput, server latency, page load time, concurrent sessions, and new sessions. You can filter, drill down, and view selected information by different metrics, such as by application, virtual server, URL, country, and so on.
The Analytics Custom screen provides a summary of the most frequent recent types of application traffic, such as the most accessed virtual servers, URLs, pool members, and so on. You can design the Analytics Custom screen so that it shows the specific types of data you are interested in.
You can schedule the reports to be sent to email addresses periodically. From any of the displayed reports, you can also export them to a PDF file, or send the report to one or more email addresses.
The displayed Analytics statistics are rounded up to two digits.

Examining application statistics

Before you can look at the application statistics, you need to have created an HTTP Analytics profile so that the system is capturing the application statistics internally on the BIG-IP system. You must associate the Analytics profile with one or more virtual servers (in the HTTP Analytics profile or in the virtual server). If you created an iApp application service, you can use the provided template to associate the virtual server.
You can review, filter, and compare HTTP statistics for traffic on the BIG-IP system. The HTTP Overview screen provides visibility into application behavior, user experience and client activity, transactions, data center resource usage, and more.
  1. On the Main tab, click
    Statistics
    Analytics
    HTTP
    .
    The Overview screen opens and displays current HTTP statistics averaged over the last hour. On the screen, you can see time controls on the top, charts on the left, and a list of dimensions on the right.
  2. Use the time settings at the top of the screen to set a time range or refresh the information on screen.
    To immediately update the statistics on screen, adjust the time range or refresh settings.
    Time range settings are persistent when navigating between the DoS Dashboard and Analysis screens.
    Time Focus
    Select the time range of the displayed data.
    Additional time options become available as your system gathers more data.
    Currently Selected Time Range
    Displays the current time range of the displayed data.
    Auto-Refresh Interval Selector
    Select how frequently the data on this screen is refreshed.
    Real Time
    Activates the real time option to reflect the most current traffic status in the Charts area
    Manual Refresh
    Click
    Refresh
     to trigger an immediate refresh of the displayed data.
    Manual Time Adjustment Handles
    Set the data to a specific window of time within the currently selected time range. Use the handles at either end of the time line to define the specific time you want to examine. Use the handle above the time line to display data that is outside the selected time range.
    Adjusting the time range to display previous data stops the auto-refresh so you can focus on a specific data point.
    You can zoom into a specific time range within a chart. Select an area within the chart and then click the magnifying glass icon.
    Selecting a time range within the chart stops the screen's auto-refresh settings.
  3. Review the HTTP Activity area for application traffic activity, and to evaluate your system's traffic performance.
    • Use the Transaction Outcomes (Average TPS) chart to analyze the outcome assigned by the BIG-IP system to the application request and response exchange.
    • Use the Avg Throughput (bps) chart to determine the average number of bytes per second processed by the BIG-IP system during application requests and responses.
    • Use the Server Latency (ms) chart to determine the time required for a server response once the BIG-IP system sends a request.
    • Use the Page Load Time (ms) chart to determine the time required for a client to receive a server response after sending a request via the BIG-IP system.
  4. Review the Virtual Server Activity area to evaluate the traffic processing performance of each virtual server.
    Selecting a single virtual server displays the charts in the panel. Ensure that you have cleared all other filters when selecting a virtual server.
    • Use the Avg & Max TPS (tps) chart to evaluate the highest and median transaction processing per second for your selected virtual server.
    • Use the Max Throughput (bps) chart to evaluate the maximum number of bytes per request or response that was processed by the selected virtual server.
    • Use the Concurrent User Sessions chart to evaluate the average number of concurrent session that were open at the same time for the selected virtual server.
You can continue to review system statistics on the entire system. As a result, you become more familiar with the system, applications, resource utilization, and more. You can focus on the specific data you need using the filters and comparison chart option provided in the Dimensions pane.
You can save the statistics in a file, and send the file to select users by email. You can also set up schedules to send specific reports to specific users (go to the Scheduled Reports screen,
Analytics
Scheduled Reports
).

Filter statistics data using the Dimensions pane

By default, the charts and dimensions tables display unfiltered data that is relevant to all monitored BIG-IP system aspects. You can filter the displayed data by selecting entities within dimensions in the Dimensions pane.
Applying filters in the Dimensions pane updates all statistics displayed on screen with data that corresponds to your selection.
  1. On the
    Monitoring
     tab, go to
    DASHBOARDS
     and select an overview page in
    Device
    ,
    DNS
    , or
    Local Traffic
    .
    On the
    Monitoring
     tab, select an overview page in
    HTTP
    ,
    Device
    ,
    Local Traffic
    , or
    Events
    .
    On the Main tab, click
    Statistics
    Analytics
    HTTP
    .
    On the Main tab, click
    Security
    Reporting
    DoS
    Analysis
    .
  2. Locate the Dimensions pane on the right side of the screen.
  3. Review data according to pre-configured device group, and filter the displayed data according to a specific configuration by selecting an option from
    Device Group
    .
  4. Review dimension entities and their statistics in table form by expanding a dimension widget. To filter by dimension entities, select one or more entities from that dimension.
    For example: You can filter by selecting individual Virtual Servers or Applications to display statistics in the charts that are specific to your selection. You can select entities from multiple dimensions that have corresponding data.
  5. You can adjust the table view by selecting the Dimensions pane handle and dragging it to the left side of the screen.
    You can expand the pane to full screen view by double-clicking the Dimensions pane handle.
  6. Clear all filter selections or those for a dimension:
    • To clear all selections, click the gear icon at the top of the Dimensions pane and select
      Clear All
      .
    • To clear selections for a dimension, click the options icon (three horizontal lines to the left of the title), and select
      Clear Selection
      .
About comparison charts
The AVR charts display aggregated statistics for your entire BIG-IP system. You can create customized charts based on specific, compatible data of interest, with a comparison chart. You create comparison charts using dimension entities to highlight specific data metrics, or to compare multiple entities in one chart.
Create a comparison chart using the Dimensions pane
You can create new charts that present statistic information about your BIG-IP system for selected entities from a dimension in the Dimensions pane. Once a new chart is created, you can adjust the metric value that is presented. You can create multiple comparison charts per screen.
  1. On the
    Monitoring
     tab, go to
    DASHBOARDS
     and select an overview page in
    Device
    ,
    DNS
    , or
    Local Traffic
    .
    On the
    Monitoring
     tab, select an overview page in
    HTTP
    ,
    Device
    ,
    Local Traffic
    , or
    Events
    .
    On the Main tab, click
    Statistics
    Analytics
    HTTP
    .
    On the Main tab, click
    Security
    Reporting
    DoS
    Analysis
    .
  2. In the Dimensions pane, expand a dimension widget to view its entity list.
  3. Select one or more dimension entities for the comparison chart by clicking the entity title. You can also select entities in other dimensions that have compatible data.
    Selecting entities automatically filters information in the Charts pane and compatible data in other dimensions. You can remove these filters once the comparison chart is created.
  4. Click the dimension's menu icon and select
    Add Comparison Chart
    .
    You can right click one of the selected entities to view the dimension widget menu.
    A comparison chart displays in the Charts pane.
  5. Adjust the displayed metric unit by selecting a different metric from the list next to the comparison chart title.
    By default, the chart displays data by the selected Sort By metric for the entity's dimension.
    Comparison charts persist in the Charts pane until they are removed. You can remove a comparison chart by selecting the
    X
     icon in the top right corner of the chart.
The new comparison chart displays data for the selected entities in the Charts pane over the selected time period.

About the reporting interval for charts and reports

The system aggregated data over time based on time intervals. This allows for more data accumulation over time, with a lower requirement for data storage resources. These aggregation intervals include: minutes, hours, days, weeks and months. When viewing data in the middle of an aggregation cycle, data is displayed based on the most recent aggregation point, resulting in a possible delay in the most recent data.

Short reporting interval

The system updates the statistics for charts and reports at five minute intervals: at five minutes after the hour, ten minutes after the hour, and so on. Each five-minute mark includes data from the previous five minutes; so 12:45 includes data starting from 12:40:01 to 12:45:00.
Charts and data that you export from charts reflect the publishing interval of five minutes. For example, if you request data for the time period 12:40-13:40, the data in the chart or in the file that you export is for that time period. But if there is a request for data from 12:42-13:42, the data in the chart is from 12:45-13:45. By default, the BIG-IP system displays one hour of data.

Longer reporting interval

As with short reporting intervals, charts that display data at longer intervals (e.g.
Last 4 hours
 or longer), the system updates statistics up to the most recent aggregation cycle. This can result in longer delays in the current data in display. For example, if you are viewing a chart that displays several hours of data, there may be a delay of up to one hour when viewing statistics at the top of an aggregation cycle. As more data is collected over that hour, the data delay is reduced.

Saving or emailing report files

To send reports by email, the default
analytics
 profile must specify an SMTP configuration (
Local Traffic
Profiles
Analytics
).
You can export or email any of the Analytics charts including those which display statistics for HTTP, TCP, memory, disk, virtual servers, and other charts available on your system.
  1. On the main tab, click
    Statistics
    Analytics
    and select the type of chart to display.
  2. Adjust the chart so that it shows the information you want, adjusting the content as needed.
  3. On the upper right of the charts screen, click
    Export
    .
    To send the report to others by email, go to
    Statistics
    Analytics
    Scheduled Reports
    .
  4. Click
    Export
    .

Customizing your statistics view

Before you can view HTTP application statistics, you need to have created an Analytics profile so that the system is capturing the application statistics internally on the BIG-IP system. You must associate the Analytics profile with one or more virtual servers (in the Analytics profile or in the virtual server). If you created an iApp application service, you can use the provided template to associate the virtual server.
You can customize how you view statistics by displaying the information you want, organized as you want to see it into data-specific
widgets
. A set of default widgets is provided showing HTTP statistics for the top URLs, pool members, virtual servers, client subnets, and countries. You can create additional widgets or reorganize what's there.
  1. On the Main tab, click
    Statistics
    Analytics
    HTTP
    Custom Page
    .
    The Custom Page opens showing current HTTP statistics. By default, there are five widgets organized in two columns.
  2. To view statistics for a particular device group, from the
    Device Group
     list, select the one you want.
  3. To adjust the time range for all widgets, from
    Override time range to
    , select a new time frame for which to view statistics.
    If you select
    (per widget)
    , you can specify different time ranges for each widget.
  4. For each widget you want to change, click the gear icon and select
    Settings
    .
    The Modify Widget Properties popup opens where you can change what the widget shows and the format used.
  5. To change the order of the widgets, drag them up or down within the column.
  6. To delete a widget if you do not need that information, click the gear icon and select
    Delete
    .
  7. To focus in on the specific details you want more information about in any widget, click an item in the chart.
    The system refreshes the charts and displays information about the item. Click Back to return to the Custom Page.
  8. To create a new widget in either column, click
    Add Widget
     at the bottom of the column.
    1. Fill in the Add New Widget popup screen to define the widget.
    2. From the
      Available Measurements
      , select the measurement to use.
    3. If there is a choice, select the data visualization.
    4. Click
      Done
      .
    The new widget displays in the column.
  9. Click
    Export
     to create a report of this information.
    The timestamp on the report reflects a publishing interval of five minutes; therefore, a time period request of 12:40-13:40 actually displays data between 12:35-13:35. By default, the BIG-IP system displays one hour of data.
You can continue to adjust the Custom Page so that it displays the information you want in the order you want it.

Categorizing and merging URI statistics by file extensions

You can classify and categorize your URL resources to display merged statistics based on the file extensions of a URI type. This allows you to configure resources based on a common URI suffix, which then displays statics by a single resource group, rather than each one individually. For example, you can group all of your image resources to displayed merged data for all image file extensions. The single category displays merged data for a defined file extension within the
URLs
 dimension, allowing you to consolidate URL data that is not critical for individual data analysis. When
To access additional help and instructions, you can log in to the command line for the BIG-IP system and type the type:
tmsh help analytics uri-type
.

Terminology for categorizing URI statistics by file extension

You can categorize certain resources by file extension to merge URL statistics and organize URI types that do not require in-depth data analysis. The following defines the terminology, limitations and general guidelines for configuration URI statistics by file extension.
Terminology
Term
Definition
uri-type
The URI category. An object mcp class that defines the URI file associations. Each uri-type can be assigned a unique name to identify the designated category of resources, e.g. IMAGE.
file-extension
A string that contains the name of the file extension, e.g. jpg, gif, png.
file-extensions
A vector that contains the file extensions included in the uri-type.
General guidelines
uri-type name
  • Each name must be unique.
  • Name must start with an alphanumeric character
  • Name can consist of the following characters:
    • Alphanumeric (A-Z, a-z, 0-9)
    • Hyphen (-)
    • Underscore (_)
uri-type file extension
  • Each file extension can consist of the following characters:
    • Lower case letters (a-z)
    • Numbers (0-9)
    • Hyphen (-)
    • Underscore ( _ )
File extensions are lower case by definition, but they are not case sensitive for file extension recognition.
Limitations
Limitation
Value
Maximum number of uri-types
100
Maximum file-extensions for all uri-types
1000
Minimum character length for uri-type name
3
Maximum character length for uri-type name
20
Minimum character length for file extension
1
Maximum character length for file extension
8

Define URI statistics categories by file extension

Ensure that Application Visibility and Reporting (AVR) is provisioned on your BIG-IP system.
You can merge certain URL data that does not require in-depth data analysis, by categorizing URI types by file extensions. This is done by defining URI types and assigning file extensions to these URI types. Use the TMOS shell (
tmsh
) to create these URI types and define, or modify, their file extensions.
All uri-types can only be defined under the
Common
 partition. The uri-types are applied to all analytics profiles.
  1. Log into the command line interface for the BIG-IP system.
  2. At the
    tmsh
     prompt, type
    tmsh create analytics uri-type <uri-type value> file_extensions add {<file_extension1> <file_extension2>}
     to specify the uri-type and file extensions.
    Sample addition of three different URI types and their defined file extensions:
    "tmsh create analytics uri-type IMAGE file_extensions add { gif png }"
"tmsh create analytics uri-type STYLES file_extensions add { css sass less }"
"tmsh create analytics uri-type FONTS file_extensions add { woff ttf wfc }"
    1. To add a file extension to an existing uri-type, type
      tmsh modify analytics uri-type <uri-type value> file-extensions add { <value> }
      .
      Sample addition of file extension to existing uri-type:
      "tmsh modify analytics uri-type IMAGE file-extensions add { jpg }"
    2. To delete a file extension from an existing uri-type, type
      tmsh modify analytics uri-type <uri-type value> file-extensions delete { <value> }
      .
      Sample deletion of file extension to existing uri-type:
      "tmsh modify analytics uri-type IMAGE file-extensions delete { jpg }"
  3. To save changes, type
    tmsh save sys config
    .
Contact Support Contact Support

Have a Question?

Support and Sales >

About F5

Education

F5 Sites

Support Tasks




©2023 F5, Inc. All rights reserved.


Trademarks Policies Privacy California Privacy Do Not Sell My Personal Information