cloud.cloud_foundry

Introduction

The tags beginning with cloud.cloud_foundry identify events generated by Cloud Foundry.

Tag structure

The full tag must have three levels. The first two are fixed as cloud.cloud_foundry. The third level identifies the type of events sent.

Technology	Brand	Type
cloud	cloud_foundry	application uaa credhub bosh

Therefore, the valid tags and tables include:

cloud.cloud_foundry.application
cloud.cloud_foundry.uaa
cloud.cloud_foundry.credhub
cloud.cloud_foundry.bosh

How is the data sent to Devo?

You can forward logs generated by Cloud Foundry using any Syslog drain (for example, Syslog-ng). Learn more about how to send Cloud Foundry logs and their structure here.

Log samples

The following are sample logs sent to each of the cloud.cloud_foundry tags. Also, find how the information will be parsed in your data table under each sample log.

Extra columns

Fields marked as Extra in the table below are not shown by default in data tables and need to be explicitly requested in the query. You can find them marked as Extra when you perform a query so they can be easily identified. Learn more about this in Selecting unrevealed columns.

cloud.cloud_foundry.application

<12>2021-01-01 01:00:30.000 localhost=127.0.0.1 cloud.cloud_foundry.application: {"ENV": "pcf_cacpreview", "cf_app_id": "c2a00a27-89de-4aa9-b7c4-5a9b9c6f26b2", "cf_app_name": "IdentityWorker", "cf_org_id": "91c076b0-1427-44ac-9895-21e092077733", "cf_org_name": "JHAS-CAC-TST", "cf_origin": "firehose", "cf_space_id": "20893759-0f36-4155-b8b0-f3069de893cf", "cf_space_name": "COIN-CAC-TST", "deployment": "cf-7a9f55bcbe0952a52206", "event_type": "LogMessage", "ip": "10.237.44.152", "job": "diego_cell", "job_index": "bafa76b3-7aa1-4330-8b28-ce38dfe114b3", "level": "info", "message_type": "OUT", "msg": "{\\"@timestamp\\":\\"2021-03-01T21:22:04.6209964Z\\",\\"severity\\":\\"Debug\\",\\"message\\":\\"Closing connection to database \'\\\\\\"coin_db_scheduling_tst2\\\\\\"\' on server \'\\\\\\"azugessqlpreview.database.windows.net\\\\\\"\'.\\",\\"messageTemplate\\":\\"Closing connection to database \'{database}\' on server \'{server}\'.\\",\\"database\\":\\"coin_db_scheduling_tst2\\",\\"server\\":\\"azugessqlpreview.database.windows.net\\",\\"EventId\\":{\\"Id\\":20002,\\"Name\\":\\"Microsoft.EntityFrameworkCore.Database.Connection.ConnectionClosing\\"},\\"SourceContext\\":\\"Microsoft.EntityFrameworkCore.Database.Connection\\",\\"@version\\":\\"1.0.0\\"}", "origin": "rep", "source_instance": "0", "source_type": "APP/PROC/WEB", "time": "2021-03-01T21:22:04Z", "timestamp": 1614633724621631072}

And this is how the log would be parsed:

Field	Value	Type	Extra fields
hostchain	`localhost=127.0.0.1`	`str`	✓
tag	`cloud.cloud_foundry.application`	`str`	✓
hostname	`localhost`	`str`
ENV	`pcf_cacpreview`	`str`
cf_app_id	`c2a00a27-89de-4aa9-b7c4-5a9b9c6f26b2`	`str`
cf_app_name	`IdentityWorker`	`str`
cf_org_id	`91c076b0-1427-44ac-9895-21e092077733`	`str`
cf_org_name	`JHAS-CAC-TST`	`str`
cf_origin	`firehose`	`str`
cf_space_id	`20893759-0f36-4155-b8b0-f3069de893cf`	`str`
cf_space_name	COIN-CAC-TST	`str`
deployment	`cf-7a9f55bcbe0952a52206`	`str`
event_type	`LogMessage`	`str`
ip	`10.237.44.152`	`ip4`
job	`diego_cell`	`str`
job_index	`bafa76b3-7aa1-4330-8b28-ce38dfe114b3`	`str`
level2	`info`	`str`
message_type	`OUT`	`str`
msg	{"@timestamp":"2021-03-01T21:22:04.6209964Z","severity":"Debug","message":"Closing connection to database \'\\"coin_db_scheduling_tst2\\"\' on server \'\\"azugessqlpreview.database.windows.net\\"\'.","messageTemplate":"Closing connection to database \'{database}\' on server \'{server}\'.","database":"coin_db_scheduling_tst2","server":"azugessqlpreview.database.windows.net","EventId":{"Id":20002,"Name":"Microsoft.EntityFrameworkCore.Database.Connection.ConnectionClosing"},"SourceContext":"Microsoft.EntityFrameworkCore.Database.Connection","@version":"1.0.0"}	`str`
origin	`rep`	`str`
source_instance	`0`	`str`
source_type	`APP/PROC/WEB`	`str`
time	`2021-03-01 21:22:04.000`	`timestamp`
timestamp	`1614633724621631072L`	`int8`
rawMessage	{"ENV": "pcf_cacpreview", "cf_app_id": "c2a00a27-89de-4aa9-b7c4-5a9b9c6f26b2", "cf_app_name": "IdentityWorker", "cf_org_id": "91c076b0-1427-44ac-9895-21e092077733", "cf_org_name": "JHAS-CAC-TST", "cf_origin": "firehose", "cf_space_id": "20893759-0f36-4155-b8b0-f3069de893cf", "cf_space_name": "COIN-CAC-TST", "deployment": "cf-7a9f55bcbe0952a52206", "event_type": "LogMessage", "ip": "10.237.44.152", "job": "diego_cell", "job_index": "bafa76b3-7aa1-4330-8b28-ce38dfe114b3", "level": "info", "message_type": "OUT", "msg": "{\\"@timestamp\\":\\"2021-03-01T21:22:04.6209964Z\\",\\"severity\\":\\"Debug\\",\\"message\\":\\"Closing connection to database \'\\\\\\"coin_db_scheduling_tst2\\\\\\"\' on server \'\\\\\\"azugessqlpreview.database.windows.net\\\\\\"\'.\\",\\"messageTemplate\\":\\"Closing connection to database \'{database}\' on server \'{server}\'.\\",\\"database\\":\\"coin_db_scheduling_tst2\\",\\"server\\":\\"azugessqlpreview.database.windows.net\\",\\"EventId\\":{\\"Id\\":20002,\\"Name\\":\\"Microsoft.EntityFrameworkCore.Database.Connection.ConnectionClosing\\"},\\"SourceContext\\":\\"Microsoft.EntityFrameworkCore.Database.Connection\\",\\"@version\\":\\"1.0.0\\"}", "origin": "rep", "source_instance": "0", "source_type": "APP/PROC/WEB", "time": "2021-03-01T21:22:04Z", "timestamp": 1614633724621631072}	`str`	✓

cloud.cloud_foundry.uaa

2021-03-08 16:23:12.824 localhost=127.0.0.1 cloud.cloud_foundry.uaa: <14>1 2021-03-01T21:22:04.407858Z 10.237.44.37 uaa rs2 - [instance@47450 director="" deployment="cf-7a9f55bcbe0952a52206" group="uaa" az="null" id="2cc61fc4-cd6e-4e99-a123-538fe14898a5"] [2021-03-01 21:22:03.988] uaa - 15 [https-jsse-nio-8443-exec-113] .... INFO --- Audit: UserAuthenticationSuccess (\'GEESPP\'): principal=4813ce76-03ab-4013-b7fe-f0880aca6e97, origin=[remoteAddress=10.237.40.6, sessionId=<SESSION>], identityZoneId=[uaa]

And this is how the log wouldbe parsed:

Field	Value	Type	Extra fields
hostchain	`localhost=127.0.0.1`	`str`	✓
tag	`cloud.cloud_foundry.uaa`	`str`	✓
hostname	`localhost`	`str`
eventType	`UserAuthenticationSuccess`	`str`
eventInfo	`GEESPP`	`str`
principal	`4813ce76-03ab-4013-b7fe-f0880aca6e97`	`str`
remoteAddress	`10.237.40.6`	`str`
sessionId	`<SESSION>`	`str`
identityZoneId	`[uaa]`	`str`
origin	`remoteAddress=10.237.40.6, sessionId=<SESSION>`	`str`
rawMessage	`<14>1 2021-03-01T21:22:04.407858Z 10.237.44.37 uaa rs2 - [instance@47450 director="" deployment="cf-7a9f55bcbe0952a52206" group="uaa" az="null" id="2cc61fc4-cd6e-4e99-a123-538fe14898a5"] [2021-03-01 21:22:03.988] uaa - 15 [https-jsse-nio-8443-exec-113] .... INFO --- Audit: UserAuthenticationSuccess (\'GEESPP\'): principal=4813ce76-03ab-4013-b7fe-f0880aca6e97, origin=[remoteAddress=10.237.40.6, sessionId=<SESSION>], identityZoneId=[uaa]`	`str`	✓

cloud.cloud_foundry.credhub

2021-03-09 11:34:16.258 localhost=127.0.0.1 cloud.cloud_foundry.credhub: <14>1 2021-03-01T20:16:55.330046Z 10.237.44.124 credhub rs2 - [instance@47450 director="" deployment="cf-7a9f55bcbe0952a52206" group="credhub" az="null" id="3db198c9-5911-49c3-9f78-7eca92ee0f90"] 2021-03-01T20:16:54.905Z: CEF:0|cloud_foundry|credhub|2.9.0|DELETE /api/v1/data|DELETE /api/v1/data|0|rt=1614629814860 suser=services_credhub_client suid=uaa-client:services_credhub_client cs1Label=userAuthenticationMechanism cs1=uaa request=/api/v1/data?name=%2Fc%2F13560975-3F2C-44E8-B1F4-FDADF89CCB93%2F3ad3956f-43ee-4791-a714-c852e7823590%2Fc20f51ab-56f8-4733-a339-efbab18fd3f0%2Fcredentials requestMethod=DELETE cs3Label=versionUuid cs3=null cs4Label=httpStatusCode cs4=204 src=10.237.253.153 dst=credhub.service.cf.internal cs2Label=resourceName cs2=/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials cs5Label=resourceUuid cs5=1bb2c0cd-a1d8-4a59-8ff4-a752e97d0bf5 deviceAction=DELETE cs6Label=requestDetails cs6={"name":"/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials"}

And this is how the log would be parsed:

Field	Value	Type	Extra fields
hostchain	`localhost=127.0.0.1`	`str`	✓
tag	`cloud.cloud_foundry.credhub`	`str`	✓
hostname	`localhost`	`str`
cefVersion	`0`	`str`
embDeviceVendor	`cloud_foundry`	`str`
embDeviceProduct	`credhub`	`str`
deviceVersion	`2.9.0`	`str`
signatureID	`DELETE /api/v1/data`	`str`
name	`DELETE /api/v1/data`	`str`
severity	`0`	`str`
extension	rt=1614629814860 suser=services_credhub_client suid=uaa-client:services_credhub_client cs1Label=userAuthenticationMechanism cs1=uaa request=/api/v1/data?name=%2Fc%2F13560975-3F2C-44E8-B1F4-FDADF89CCB93%2F3ad3956f-43ee-4791-a714-c852e7823590%2Fc20f51ab-56f8-4733-a339-efbab18fd3f0%2Fcredentials requestMethod=DELETE cs3Label=versionUuid cs3=null cs4Label=httpStatusCode cs4=204 src=10.237.253.153 dst=credhub.service.cf.internal cs2Label=resourceName cs2=/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials cs5Label=resourceUuid cs5=1bb2c0cd-a1d8-4a59-8ff4-a752e97d0bf5 deviceAction=DELETE cs6Label=requestDetails cs6={"name":"/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials"}	`str`
rawMessage	<14>1 2021-03-01T20:16:55.330046Z 10.237.44.124 credhub rs2 - [instance@47450 director="" deployment="cf-7a9f55bcbe0952a52206" group="credhub" az="null" id="3db198c9-5911-49c3-9f78-7eca92ee0f90"] 2021-03-01T20:16:54.905Z: CEF:0\|cloud_foundry\|credhub\|2.9.0\|DELETE /api/v1/data\|DELETE /api/v1/data\|0\|rt=1614629814860 suser=services_credhub_client suid=uaa-client:services_credhub_client cs1Label=userAuthenticationMechanism cs1=uaa request=/api/v1/data?name=%2Fc%2F13560975-3F2C-44E8-B1F4-FDADF89CCB93%2F3ad3956f-43ee-4791-a714-c852e7823590%2Fc20f51ab-56f8-4733-a339-efbab18fd3f0%2Fcredentials requestMethod=DELETE cs3Label=versionUuid cs3=null cs4Label=httpStatusCode cs4=204 src=10.237.253.153 dst=credhub.service.cf.internal cs2Label=resourceName cs2=/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials cs5Label=resourceUuid cs5=1bb2c0cd-a1d8-4a59-8ff4-a752e97d0bf5 deviceAction=DELETE cs6Label=requestDetails cs6={"name":"/c/13560975-3F2C-44E8-B1F4-FDADF89CCB93/3ad3956f-43ee-4791-a714-c852e7823590/c20f51ab-56f8-4733-a339-efbab18fd3f0/credentials"}	`str`	✓

cloud.cloud_foundry.bosh

2021-03-09 11:34:16.258 localhost=127.0.0.1 cloud.cloud_foundry.bosh: CEF:0|CloudFoundry|BOSH|-|blobstore_api|/74/5e60a8e2-14f2-4a04-924b-dd37aa7141f5|1|requestClientApplication=blobstore requestMethod=GET src=10.237.72.69 spt=33100 cs1=Basic cs1Label=authType cs2=200 cs2Label=responseStatus

And this is how the log would be parsed:

Field	Value	Type	Extra fields
`hostchain`	`localhost=127.0.0.1`	`str`	✓
`tag`	`cloud.cloud_foundry.bosh`	`str`	✓
`hostname`	`localhost`	`str`
`cefVersion`	`0`	`str`
`embDeviceVendor`	`CloudFoundry`	`str`
`embDeviceProduct`	`BOSH`	`str`
`deviceVersion`	`-`	`str`
`signatureID`	`blobstore_api`	`str`
`name`	`/74/5e60a8e2-14f2-4a04-924b-dd37aa7141f5`	`str`
`severity`	`1`	`str`
`extension`	`requestClientApplication=blobstore requestMethod=GET src=10.237.72.69 spt=33100 cs1=Basic cs1Label=authType cs2=200 cs2Label=responseStatus`	`str`
`requestClientApplication`	`blobstore`	`str`
`requestMethod`	`GET`	`str`
`src`	`10.237.72.69`	`ip4`
`spt`	`33100`	`int4`
`cs1Label`	`authType`	`str`
`cs1`	`Basic`	`str`
`cs2Label`	`responseStatus`	`str`
`cs2`	`200`	`str`