social.twitter

[ 1 Introduction ] [ 2 Valid tags and data tables ] [ 3 Table structure ]

Introduction

The tags beginning with social.twitter identify events generated by Twitter.

Valid tags and data tables

The full tag must have 4 levels. The first two are fixed as social.twitter. The third level identifies the type of events sent. The fourth level indicates the event subtype.

These are the valid tags and corresponding data tables that will receive the parsers' data:

Product / Service	Tags	Data tables

Product / Service	Tags	Data tables
Twitter	`social.twitter.tweets.common`	`social.twitter.tweets.common`
	`social.twitter.tweets.common.country.europe`
	`social.twitter.tweets.common.tag1.tag2`
	`social.twitter.tweets.complete.lt.demo`	`social.twitter.tweets.complete`
	`social.twitter.tweets.trace`	`social.twitter.tweets.trace`

For more information, read more About Devo tags.

Table structure

These are the fields displayed in these tables:

social.twitter.tweets.common
social.twitter.tweets.complete
social.twitter.tweets.trace

social.twitter.tweets.common

Field	Type	Field transformation	Source field name	Extra fields

Field	Type	Field transformation	Source field name	Extra fields
eventdate	`timestamp`
machine	`str`		vmachine
level	`str`
tag1	`str`
tag2	`str`
user	`str`
text	`str`
lat	`float8`
lon	`float8`
place	`str`
lang	`str`
source	`str`	`subs(sourceRaw, "^[^>]+>([^<]+)<.*$", "\\1")`	sourceRaw
tweetdate	`str`
tracks	`str`
sentiment	`str`
favCount	`int4`
mediaEntities	`str`
rtCount	`int4`
hashtagEntities	`str`
hostchain	`str`			✓
tag	`str`			✓

social.twitter.tweets.complete

Field	Type	Source field name	Extra fields

Field	Type	Source field name	Extra fields
eventdate	`timestamp`
machine	`str`	vmachine
text	`str`
annotations	`str`
longitude	`float8`
latitude	`float8`
created_at	`str`
timestamp_ms	`str`
lang	`str`
current_user_retweet_id_str	`str`
favorite_count	`int4`
favorited	`bool`
is_quote_status	`bool`
filter_level	`str`
geo	`str`
id	`int8`
id_str	`str`
in_reply_to_screen_name	`str`
in_reply_to_status_id	`int8`
in_reply_to_user_id	`int8`
in_reply_to_user_id_str	`str`
place_attributes	`str`
place_bounding_box	`str`
place_country	`str`
place_country_code	`str`
place_full_name	`str`
place_id	`str`
place_name	`str`
place_type	`str`
place_url	`str`
possibly_sensitive	`bool`
quoted_status_id	`int8`
quoted_status_id_str	`str`
quoted_status	`str`
scopes_followers	`bool`
retweet_count	`int4`
retweeted	`bool`
source	`str`
truncated	`bool`
user_contributors_enabled	`bool`
user_created_at	`str`
user_default_profile	`bool`
user_description	`str`
user_entities	`str`
user_favourites_count	`int4`
user_follow_request_sent	`bool`
user_following	`bool`
user_followers_count	`int4`
user_friends_count	`int4`
user_geo_enabled	`bool`
user_id	`int8`
user_id_str	`str`
user_is_translator	`bool`
user_lang	`str`
user_listed_count	`int4`
user_location	`str`
user_name	`str`
user_profile_background_color	`str`
user_profile_background_image_url	`str`
user_profile_background_image_url_https	`str`
user_profile_background_tile	`bool`
user_profile_banner_url	`str`
user_profile_image_url	`str`
user_profile_image_url_https	`str`
user_profile_link_color	`str`
user_profile_sidebar_border_color	`str`
user_profile_sidebar_fill_color	`str`
user_profile_text_color	`str`
user_profile_use_background_image	`bool`
user_protected	`bool`
user_screen_name	`str`
user_status	`str`
user_statuses_count	`int4`
user_time_zone	`str`
user_url	`str`
user_utc_offset	`int4`
user_verified	`bool`
user_withheld_in_countries	`str`
user_withheld_scope	`str`
user_notifications	`bool`
user_default_profile_image	`bool`
withheld_copyright	`bool`
withheld_in_countries	`str`
hostchain	`str`		✓
tag	`str`		✓

social.twitter.tweets.trace

Field	Type	Source field name	Extra fields

Field	Type	Source field name	Extra fields
eventdate	`timestamp`
traceLevel	`str`
traceBody	`str`
hostchain	`str`		✓
tag	`str`		✓
rawMessage	`str`	rawSource	✓