Shannon entropy (shannonentropy)

Description

Adds a new column that returns the Shannon entropy of a given string.

How does it work in the search window?

Select Create field in the search window toolbar, then select the Shannon entropy operation. You need to specify one argument:

The data type of the values in the new field is float.

Example

In the demo.ecommerce.data table, we want to create a new field that calculates the Shannon entropy of the strings in our uri field. To do this, we will create a new field using the Shannon entropy operation.

The arguments needed to create the new column are:

• String - uri field

Click Create field and you will see the following result:

How does it work in LINQ?

Use the operator select... as...  and add the operation syntax to create the new column. This is the syntax for the Shannon entropy operation:

• shannonentropy(string)

Example

You can copy the following LINQ script and try the above example on the demo.ecommerce.data table. 

from demo.ecommerce.data
  select shannonentropy(uri) as uri_shannonentropy