...
One of the biggest challenges faced by facing big data solutions isn't how to collect and store large amounts of data, but rather how to quickly find the "needles in the haystack". To accelerate searches for very specific information, Devo uses a unique a unique two-level system for indexing data.
...
This second index contains all tokens identified in the data saved across all data nodes. An An internal indexing task runs regularly to scan the recently ingested events to identify all tokens and add them to this index. This is an inverted index, which means that every token is mapped to the individual events in which the token has been found.
...
| Operation name | Case sensitivity | Description |
|---|---|---|
Case-sensitive | This operation assumes that the string to search for is a token and therefore always uses the token index. It is a case-sensitive operation, however, so searching for Banana is not the same as searching for banana. For example, However, if the optional left-extended and right-extended Boolean arguments are used,
will return events where a token ends with | |
Case-sensitive | This operation assumes that the string to search for is the beginning of a token and therefore always uses the token index. Like This returns events that contain containing tokens that start with the specified string. | |
Case-sensitive | This operation assumes that the string to search for is the end of a token and therefore always uses the token index. Like This returns events that contain containing tokens that end with the specified string. | |
Case-sensitive | Since these operations look for an exact match of the string to search for, they always use the token index. While These return events containing tokens that contain tokens exactly match the specified string (either regarding or disregarding case). | |
Case-insensitive |
...