Document toolboxDocument toolbox

Shannon entropy (shannonentropy)

Description

Adds a new column that returns the Shannon entropy of a given string.

How does it work in the search window?

Select Create column in the search window toolbar, then select the Shannon entropy operation. You need to specify one argument:

Argument

Data type

Argument

Data type

String mandatory

string

The data type of the values in the new column is float.

Example

In the demo.ecommerce.data table, we want to create a new column that calculates the Shannon entropy of the strings in our uri column. To do it, we will create a new column using the Shannon entropy operation.

The arguments needed to create the new column are:

  • String - uri column

Click Create column and you will see the following result:

How does it work in LINQ?

Use the operator select... as...  and add the operation syntax to create the new column. This is the syntax for the Shannon entropy operation:

  • shannonentropy(string)

Example

You can copy the following LINQ script and try the above example on the demo.ecommerce.data table. 

from demo.ecommerce.data select shannonentropy(uri) as uri_shannonentropy