Shannon entropy (shannonentropy)

[ 1 Description ] [ 2 How does it work in the search window? ] [ 3 How does it work in LINQ? ]

Description

Adds a new column that returns the Shannon entropy of a given string.

How does it work in the search window?

Select Create column in the search window toolbar, then select the Shannon entropy operation. You need to specify one argument:

Argument	Data type

Argument	Data type
String ^mandatory	string

The data type of the values in the new column is float.

Example

In the demo.ecommerce.data table, we want to create a new column that calculates the Shannon entropy of the strings in our uri column. To do it, we will create a new column using the Shannon entropy operation.

The arguments needed to create the new column are:

String - uri column

Click Create column and you will see the following result:

How does it work in LINQ?

Use the operator select... as... and add the operation syntax to create the new column. This is the syntax for the Shannon entropy operation:

shannonentropy(string)

Example

You can copy the following LINQ script and try the above example on the demo.ecommerce.data table.

from demo.ecommerce.data
  select shannonentropy(uri) as uri_shannonentropy