Document toolboxDocument toolbox

mail.all.messages

Introduction

This union table collects information from a set of tables email information from different services.

Source tables

The information displayed is extracted from the following tables:

  • mail.mimecast.siem

  • mail.proofpoint.tapsiem

  • mail.proofpoint.tapsiem_v2

  • mail.trend_micro.email_security.mail_tracking

Table structure

This is the set of columns displayed by this union table, which is the result of the collection of columns present in all source tables: 

Extra columns

Fields marked as Extra in the table below are not shown by default in data tables and need to be explicitly requested in the query. You can find them marked as Extra when you perform a query so they can be easily identified. Learn more about this in Selecting unrevealed columns.

Field

Type

Extra fields

Field

Type

Extra fields

eventdate

timestamp

 

source

str

 

sender

str

 

source_ip

str

 

recipient

str

 

mail_id

str

 

subject

str

 

size

int8

 

hostchain

str

✓

tag

str

✓

Field transformations

Even though all source tables have several features in common, they have some particularities that make it necessary to undergo a set of transformations to harmonize them for the union table. The most common transformations comprise changes in the data type or the application of rules when several columns in the source table feed a single column in the union table. You can find below the detailed list of transformations in each source table. 

mail.mimecast.siem

Field in union table

Field in source table

Field transformation

Type

Extra fields

Field in union table

Field in source table

Field transformation

Type

Extra fields

eventdate

eventdate

 

timestamp

 

source

-

"mail.mimecast.siem"

str

 

sender

sender

 

str

 

source_ip

ip

str(ip)

str

 

recipient

rcpt

 

str

 

mail_id

msgId

 

str

 

subject

subject

 

str

 

size

attSize

int8(attSize)

int8

 

hostchain

hostchain

 

str

✓

tag

tag

 

str

✓

mail.proofpoint.tapsiem

Field in union table

Field in source table

Field transformation

Type

Extra fields

Field in union table

Field in source table

Field transformation

Type

Extra fields

eventdate

eventdate

 

timestamp

 

source

-

str

 

sender

sender

 

str

 

source_ip

senderIP

 

str

 

recipient

recipient

 

str

 

mail_id

messageID

 

str

 

subject

subject

 

str

 

size

messageSize

 

int8

 

hostchain

hostchain

 

str

✓

tag

tag

 

str

✓

mail.proofpoint.tapsiem_v2

Field in union table

Field in source table

Field transformation

Type

Extra fields

Field in union table

Field in source table

Field transformation

Type

Extra fields

eventdate

eventdate

 

timestamp

 

source

-

str

 

sender

sender

 

str

 

source_ip

senderIP

 

str

 

recipient

recipient

 

str

 

mail_id

messageID

 

str

 

subject

subject

 

str

 

size

messageSize

 

int8

 

hostchain

hostchain

 

str

✓

tag

tag

 

str

✓

mail.trend_micro.email_security.mail_tracking

Field in union table

Field in source table

Field transformation

Type

Extra fields

Field in union table

Field in source table

Field transformation

Type

Extra fields

eventdate

eventdate

 

timestamp

 

source

-

str

 

sender

sender

 

str

 

source_ip

sender_ip

 

str

 

recipient

recipient

 

str

 

mail_id

mail_id

 

str

 

subject

subject

 

str

 

size

size

int8

 

hostchain

hostchain

 

str

✓

tag

tag

 

str

✓