Expand | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||
|
...
While Devo is designed to receive real-time data feeds, it's sometimes useful to upload static files if you want historical log data to be accessible in Devo for querying and analysis. These static files will always be stored in tables starting with the my.upload
tag levels. If you need to send event files to a table other than a my.upload
, please contact us.
What permissions do I need?
To be able to upload files, you need to have the Manage version of the Data Uploadupload permission. If you do not have this permission, you will not be able to see the option in the navigation pane and thus you will not be able to access this area to upload files (know more about permissions here).
...
Upload a data file
You have the option of uploading Follow these steps to upload a file from your local machine or from a Dropbox account. to your Devo domain.
Note |
---|
Upload limits
|
...
Note |
---|
|
Rw ui steps macro | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Once inside the Data upload area, select either Dropbox or Local files. If you select Dropbox, you will be prompted to grant Devo access to your Dropbox files, then log into Dropbox. Navigate to the folder and select the file you want to upload. , you can either drag and drop the file or navigate to the necessary folder and select it for upload. You can try the process using this file:
When you have selected the file, click the Upload FileSettings button. The settings page appears. This page contains a couple of fields that will determine how the data will be saved in Devo.
Click the Confirm Settings Summary button.
|
...
To work with the new data, go to Data search and use the finder to locate the my.upload
table that you just created. This table will always be created with the following three columns:
eventdate | This is the date in which the data arrives into Devo or the one specified using a log field. |
---|---|
uploadid | This is the coding that identifies the data according to the moment it is uploaded. Each new upload will have a unique uploadid. |
message | Use the Split (split) function to manually parse the message of the column. |
...
Note |
---|
Working with JSON files? Please bear in mind that if you are uploading a file in JSON format, it will show as string data type in the search window. To parse this string to JSON data type, use the to json operation. |
Anchor | ||||
---|---|---|---|---|
|
...
Devo is capable of recognizing a wide range of date formats in the files you upload and you can use regular expressions to find them and use them.
Format | Sample | Regular expression |
---|---|---|
DD/MM/YYYY | 30/05/2017 |
|
DD/MM/YYYY HH:mm:ss | 30/05/2017 18:00:00 |
|
DD:MM:YYYY | 30:05:2017 |
|
DD:MM:YYYY-HH:mm:ss | 30:05:2017-18:00:00 |
|
ddd MMM DD HH:mm:ss YYYY | Tue May 30 18:00:00 2017 |
|
DD-MMM-YYYY HH:mm:ss.SSS | 30-May-2017 18:00:00.123 |
|
DD-MM-YYYY | 30-05-2017 |
|
MMM dd HH:mm:ss | May 30 18:00:00 |
|
x (epoch milliseconds with dot separator) | 1496167200 |
|
YYYY/MM/DD | 2017/05/30 |
|
YYYY/MM/DD HH:mm:ss | 2017/05/30 18:00:00 |
|
YYYY/MM/DD hh:mm:ss | 2017/09/14 15:10:23 |
|
YYYY:MM:DD | 2017:05:30 |
|
YYYY:MM:DD-HH:mm:ss | 2017:05:30-18:00:00 |
|
YYYY-MM-DD | 2017-05-30 |
|
YYYY-MM-DD hh:mm:ss | 2017-09-14 15:10:23 |
|
YYYY-MM-DD HH:mm:ss.SSS | 2017-05-30 18:00:00.123 |
|
YYYY-MM-DD HH:mm:ss.SSSSSS | 2013-01-17 00:54:01.744909 |
|
YYYY-MM-DDThh:mm:ss | 2017-09-13T19:01:15 |
|
YYYY-MM-DDThh:mm:ss.SSSZ | 2017-09-13T19:01:15.000Z |
|
YYYY-MM-DDThh:mm:ssZ | 2017-09-13T19:01:15Z |
|