Table of Contents | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Purpose
An analyst wants to detect <adjective> behavior in <data source>unauthorized changes in Azure or Entra ID. Using the <name> Azure Event Hub collector to send <type> identity and access logs to Devo, the analyst will find <outcome>privilege escalation events. As a result, the analyst will <verb> the <entity>, preventing them from <tactic>remove malicious accounts, preventing them from disabling or modifying Azure resources.
The Azure Event Hub collector gets data from:
Azure Monitor, which includes auditing, metrics, and logs of all Azure cloud computing services.
Entra ID, which includes authentication and role threats.
Any other kind of JSON data, which can be sent using a simple script.
Example tables
Table | Description |
---|
Authorize It
In Azure Portal, search for Entra ID.
...
Click App registrations in the left menu and click the app (or Service Principal) that you are going to use.
Register the application
open Storage accounts.
...
On the Storage accounts page, select Create and name the account.
...
Click “Review + Create” then “Create”
After the storage account is created, select it from the list of storage accounts and click on Access keys in the left menu.
Copy the connection string.
...
Role assignment
Alternatively, users can grant the necessary permissions to the registered application to access the Event Hub without using the RootManageSharedAccessKey
. Roles can be assigned in a variety of ways (e.g. inherited from the subscription group), but the following steps will show how to assign the necessary roles directly to the Storage Account.
Repeat steps 1-2 from the Connection String section to create the Storage Account.
In the Storage Account, click Access control (IAM) in the left menu, click + Add, and click Add Role Assignment.
...
...
Search for either the Storage Blob Data Contributor or Storage Blob Data Owner ??Storage Blob Data Reader?? role and select it and then click Next.
...
Click + Select members and search for the event hub application, select it, click Next.
...
Click Review + Assign.
Connection string
Users can either obtain a connection string or use Role Assignments to allow the collector to access the Event Hub.
...
Data from Event Hubs, VM Metrics, Entra ID, and other sources. | |
cloud.azure.service.type | For most Azure services, there is a separate table for each type of log associated with that service. |
cloud.azure.ad.* | Entra ID identity and access management logs. |
cloud.azure.ad.signin_all | This union table combines all the different Entra ID authentication logs. |
Authentication logs, including Entra ID and Azure SQL authentication. | |
Web activity, including Azure Application Gateway. | |
Firewall activity, including Azure Firewall | |
DNS activity, including Azure Firewall DNS Proxy. |
Authorize It
To perform the authorization, the Entra Security Administrator role is required.
Items required before authorizing an Event Hub:
Subscription containing your Azure resources.
Resource group containing your Azure resources.
Name of the region containing Azure resources. Example: East US
Entra directory.
If you have more than one set of these items, then authorize an Event Hub for each set.
Items created or used during the authorization process:
Event hub namespace
Event hub policy
In Azure Portal, search for Entra ID.
Click App registrations in the left menu and click new registration.
Register the application.
Search for the Event Hubs service and click on it.
Create an Event Hub resource per region (repeat the steps below for each region):
- Click Add
Click Create.
- Fill the mandatory fields keeping in mind that the Event Hub must be in the same region as the resources that you are going to monitor
Select the subscription and resource group corresponding to the resources that must be monitored.
Enter a name.
In the Location field, select the region containing the resources that must be monitored.
To capture Blob or Data Lake, see How Event Hubs Capture is charged to select a tier. Otherwise, select the cheapest tier and one throughput unit. If you need more resources, they can be added later.
Select “Review+Create,” then “Create.”
- The previous steps create an EventHub namespace; now go
Return to Event Hubs
, search the created one and click on it.Now click on the + Event Hub button and create a new Event Hub
Add a name.
One partition count is usually enough.
Select the maximum retention time.
Once the Event Hub is created in the namespace, click it and select Consumer Group in the left menu. Note that a dedicated Consumer Group for Devo needs to be created if the existing consumer groups are already in use.
Here you will see the Event Hub consumer groups. This will be used by the collector (or other applications) for reading data from the Event Hub. Write down the Consumer group name that you will use later in the configuration file.
Now, in the Event Hub Namespace, click on Shared access policies, search the default policy named RootManageSharedAccessKey and click it.
Copy and write down the primary (or secondary) connection string to be used later in the configuration file.
Role assignment
Alternatively, users can grant the necessary permissions to the registered application to access the Event Hub without using the RootManageSharedAccessKey
. Roles can be assigned in a variety of ways (e.g. inherited from the subscription group), but the following steps will show how to assign the necessary roles directly to the Event Hub Namespace.
Repeat all steps except the last one from the previous section to create the Event Hub.
In the Event Hub Namespace, click and open the namespace created in the previous steps.
Select Access control (IAM) in the left menu, click + Add, and click Add Access Role Assignment.
...
Search for
...
the Azure Event Hubs Data Receiver
...
role and select it and then click Next.
...
Click
...
Select members and search for the previously created App registration
...
.
Select the Application by clicking its name.
Once the application is already listed as a selected member, click Select.
Click Review + Assign.
...
Now, search the Monitor service and click on it.
...
Click the Diagnostic Settings option in the left area.
A list of the deployed resources will be shown. Search for the resources that you want to monitor, select them, and click Add diagnostic setting.
...
Type a name for the rule and check the required category details (logs will be sent to the cloud.azure.eh.events table, and metrics will be sent to the cloud.azure.eh.metrics table).
...
Check Stream to an Event Hub, and select the corresponding Event hub namespace, Event hub name, and Event hub policy name.
...
Click Save to finish the process.
...
In the namespace, create a shared access policy for sending data to the event hub.
Create a second shared access policy for listening to the event hub.
Open the listen policy and copy the primary connection string.
Return to the event hub and check the list of consumer groups. The Devo collector must have a dedicated consumer group. Devo recommends using the
$Default
consumer group for the collector without allowing other entities to use the event hub. If the consumer group is shared with other entities, data will be lost.
Send Data
Enable Monitor to get audit, reliability, metrics, and Microsoft recommendation data.
Enable Entra ID to get authentication data.
Use an SDK to send JSON data from your custom applications.
Use HTTPs to send JSON data.
Run It
In the Cloud Collector App, create an Azure Collector instance using this parameters template, replacing the values enclosed in < >
. The region name for each event hub will be logged in the region field of cloud.azure. It is not required to be your Azure region.
Code Block |
---|
{
"inputs": {
"azure_event_hub": {
"enabled": true,
"id": "<UNIQUE VALUE>",
"services": {
"event_hubs": {
"queues": {
"<REGION>": {
"consumer_group": "$Default",
"event_hub_connection_string": "<CONNECTION STRING>",
"event_hub_name": "<EVENT HUB>",
"namespace": "<NAMESPACE OF EVENT HUB>"
}
}
}
}
}
}
}
|
For each event hub, the consumer group should only be used by one collector. If the consumer group is shared with other entities, data will be lost. To check if your collector has been enabled successfully, validate it.
Secure It
Devo Exchange provides an Azure alert pack. The Authentication alert pack works with Entra ID data. The Collective Defense alert pack works with Azure Application Gateway and Azure Firewall. The DNS alert pack works with Azure Firewall DNS proxy.
Entra ID
See Entra ID collector.
Azure Storage
IP address 1.1.1.1 has been identified as an indicator of compromise. Identify storage actions taken by this IP to determine how many storage resources have been modified. Use the results to assess if the IP should be blocked.
Code Block |
---|
from cloud.azure.storage.administrative
where eq(callerIpAddress,1.1.1.1)
group by operationName
select length(collectdistinct(resourceId)) as resources |
Azure App Service
Malicious principals have been stopping applications. Before reenabling the applications, identify the principals and revoke their access so they cannot stop the applications again.
Code Block |
---|
from cloud.azure.appservice.administrative
where eq(operationName,"MICROSOFT.WEB/SITES/STOP/ACTION")
group by identity__authorization__evidence__principalId as principal, resultType
select length(collectdistinct(resourceId)) as applications_stopped |
Monitor It
Create an inactivity alert to detect interruptions of transfer of data from the source to the SQS queue event hub using the query
Code Block |
---|
from TABLEcloud.azure where toktains(hostchain,"collector-") select split(hostchain,"-",1) as collector_id |
Set the inactivity alert to keep track of the collector_id
.
Select values of the product
field can also be monitored for inactivity.