Document toolboxDocument toolbox

Stat count

 

Feature not enabled by default

Note that this feature is only enabled in certain domains by default. If you need to use it and is not enabled in your domain, contact the Devo support team.

Overview

When you want to analyze the statistical distribution of the unique column values in a data table, it's important to take into account the percentage of data you have downloaded to your browser. Note that Devo does not download all the events in your search automatically to avoid overloading the browser memory. You can check the percentage of events downloaded to your browser at the top left corner of the search window. Learn more about how to control event loading preferences in this article.

 

When you click the arrow icon in a table column in your search, you will see the percentage of the top 10 unique values. However, these stats only consider the data that has been loaded into the browser so far.

 

If you need to analyze the statistical distribution of all your data, you can use the Stat count tool: an analysis tool that allows users to easily analyze the distinct values of each of their table columns considering all the data in your search time range. That means you will get more accurate statistics as all the available data will be considered.

You can access this tool by clicking on the gear icon at the top right of the search window, and then clicking Tools → Stat count.

Which permissions do I need?

To see the Stat count option in the menu, your user must belong to a role that has the Stat count of searches permission. In case you don't see the option in the menu, ask your Admin to include this permission in your assigned role in the Administration → Roles → Permissions tab. The permission is under the Data search → Search window category.

Learn more about roles and permissions in Role permissions.

How does Stat count work?

When you first open the Stat count tool in a search, all the events to be analyzed will be loaded. You will see a progress bar indicating the percentage and number of events loaded so far. You can cancel the process anytime by clicking the X button next to the bar.

If you activate real-time data flow in your search, the Stat count tool will load all the events from the moment you open it until now. A refresh button will appear next to the progress bar so you can load new events to be analyzed. However, if you are working with a specific time period in your search, only the events in that period will be loaded.

Using the Stat count tool

There are several actions that you can take using the Stat count tool:

Generate a column report

To access the report of a specific column, click its name on the list of fields. The corresponding report will appear on the right. In case you have a large number of fields, you can use the search box at the top to search for specific columns by their names.

These are the actions that you can perform in a report and the information it displays:

 

 

 

1

Name, data type, and amount of distinct values of the selected column. If the field includes numeric values, you will see some additional info (maximum and minimum values, average and standard deviation)

2

Select the type of report you want to generate and the maximum number of unique values to be displayed. There are 2 reports available:

  • Estimated - This will show an estimated count of the values in the selected column, calculated by an algorithm. You can choose to display the top 10, 50, or 100 values.

  • Exact - This will show the exact number of the top 10 distinct values in the selected column. Note that you won't be able to access this option while your events are being loaded.

Exact vs estimated values

Note that the Estimated report may also show exact values after they are calculated. You may find both exact and estimated values together in an Estimated report. Notice the ~ symbol, which indicates the estimated values calculated by the algorithm.

3

Activate this option to exclude null values from the list.

4

List of unique values in the selected column. Click a value to filter the data in your search and show only events with that value.

Next to each value, you can check the count of occurrences and their percentage over the total amount of events.

5

Use these icons to perform the following actions:

  • Edit - Click this button to add a filter by this value to your query.

  • Open in a new browser tab - Click this button to open your query in a new browser tab.

For a more convenient workflow, you can edit your query and then open it in a new tab to keep working in parallel.

6

Check this option to add this column to the favorites list.

Set columns as favorites

You can add fields as favorites by checking the Add to Favorites button in the column report. Favorite fields appear grouped at the top of the column list and show a couple of bars under them, which allow you to analyze the percentage of the different values in the field at a glance.

 

 

 

Magenta

Represents the top 10 distinct values with the highest count of occurrences. The bar will appear only with this color for columns that have 10 or fewer unique values.

Blue

Represents the 100 distinct values (except the top 10) with the highest count of occurrences.

Orange

Represents the rest of non-null values.

Gray

Represents the count of null values.

  • The left bar represents the percentage of specific groups of events with respect to the total amount of events. Hover over each color fragment in the bar to check the percentage of those values. Each color represents a different group of events:

  • The right bar represents the distribution of each of the top 10 distinct values with the highest count of occurrences. The lightest gray tone represents the value with the highest count of occurrences, and the darkest tone represents the value with the lowest count. Hover over each color fragment in the bar to check the percentage of those values.

Edit the column configuration

Click the Edit list button to choose the fields you want to show on the list. All the fields are shown by default. To hide a field, simply uncheck the box next to it. Click Save to apply the changes.

Generate a bulk report

Click the Bulk report button to load multiple columns at the same time. Choose the required values by checking their boxes and clicking Generate. You can use the search box on top to locate the specific fields you want to load

Save and reset column configurations

Click the ellipsis button next to the search box to access the following options:

Save fields configuration

Save the current field configuration for future searches over the current data table. You can choose Only for me to save the layout only for your user, or Whole domain if you want to save the configuration for all the users in the domain.

Reset fields configuration

Reset the field configuration to the default values for future searches over the current data table. You can choose Only for me to reset the layout only for your user, or Whole domain if you want to reset the configuration for all the users in the domain.

Â