...
...
...
...
...
...
Table of Contents | |||||
---|---|---|---|---|---|
|
...
|
Overview
Note |
---|
Validate destination first Before sending data to HDFS, contact Devo customer support to validate the destination. |
Using the destination
object in a query request, you can have query responses forwarded to your organization's data storage services, including Hadoop Distributed File System (HDFS)-type systems.
To send your response to HDFS, include the destination
object in your request and set type
to hdfs
like this:
Code Block |
---|
"destination": { "type":"hdfs" } |
Parameters
With the destination.type
set to hdfs
, you need to specify some additional parameters specific to HDFS to identify where and how to save the data contained in the response:
Parameter | Description |
---|---|
| Specifies where the HDFS server is listening (for example, |
| Specifies the path where the data will be written (for example, |
| Specifies the file to which the data will be saved. Data files have the following format: |
| Defines the default block replication factor. The actual number of replications can be specified when the file is created. |
Query using QueryID and forwarding to HDFS
Code Block |
---|
{ "queryId": "Query_Id_from_web_app", "from": 1481471880, "to": 1481558280, "destination": { "type":"hdfs", "params": { "fs.defaultFS":"hdfs://server:port", "dfs.replication":"1", "file":"/tmp/devo/test_05" ........... } } "mode": { "type":"json" } } |
Query using LINQ and forwarding to HDFS
Code Block |
---|
{ "query": "LinQ_Query", "from": 1481471880, "to": 1481558280, "destination": { "type":"hdfs", "params": { "fs.defaultFS":"hdfs://server:port", "dfs.replication":"1", "file":"/tmp/devo/test_05" ........... } } "mode": { "type":"json" } } |
Info |
---|
More about HDFS Learn more about HDFS by reviewing the Hadoop HDFS Architecture Guide. |