/
Microsoft Azure Blob Storage Integration
Document toolboxDocument toolbox

Microsoft Azure Blob Storage Integration

Owned by Virginia Camuñas Núñez
Last updated: Mar 19, 2025
4 min read
[ 1 Purpose ] [ 2 Configure and Run the Azure Function App ]

Purpose

An analyst wants to store massive amounts of unstructured data, such as text or binary data by using an Azure Blob storage, and send the data to Devo.

Blob Storage allows:

  • Storing files for distributed access.

  • Storing data for analysis by an on-premises or Azure-hosted service.

Configure and Run the Azure Function App

This guide will walk you through the process of setting up, configuring, and running an Azure Function App that processes files from Azure Blob Storage and sends data to Devo.

1. Unzip the Project Folder

  • Action: Unzip the provided project folder to a desired location on your local machine.

  • Purpose: This folder contains all the necessary files, including the Azure Function App code, configuration files, and certificates.

    function-vs-code-python

2. Add Certificates and Keys

  • Location: Place the following files in the config/credentials directory:

    • Certificate: integrations_factory.crt

    • Private Key: integrations_factory.key

    • Chain CA: chain.crt

  • Source: These files can be obtained from Devo by navigating to Administration → Credentials → X.509 Certificates.

10_Micrsoft azure blob storage integration app.png

3. Run the Function App Locally Using Visual Studio Code

  • Requirements: Ensure you have Visual Studio Code installed with the Azure Functions extension and Python environment configured.

  • Steps:

    • Open the unzipped folder in Visual Studio Code.

    • Install the required Python packages by running pip install -r requirements.txt in the terminal.

    • Start the Function App locally by pressing F5 or using the Run option.

4. Update devo.settings.json Configuration File

  • File Location: The file is located in the project root directory.

  • Instructions:

    • Open devo.settings.json.

    • Update the paths for the certificates as follows:

{ "DevoCert": "config/credentials/integrations_factory.crt", "DevoKey": "config/credentials/integrations_factory.key", "DevoCA": "config/credentials/chain.crt" }

  • Purpose: This configuration ensures that the Function App can securely connect to Devo using the provided certificates.

5. Update local.settings.json for Local Execution

  • File Location: Located in the project root directory.

  • Instructions:

    • Open local.settings.json.

    • Update the storage account connection strings:

      { "AzureWebJobsStorage": "<Your_Storage_Account_Connection_String>", "devostorage1_STORAGE": "<Your_Storage_Account_Connection_String>" }

6. Update function.json for Deployment on Azure Portal

  • File Location: Located within the respective function directory.

  • Instructions:

    • Open function.json.

    • Update the path and connection settings for Azure Blob Storage:

{ "path": "container_name/{file}" }

  • Example:

{ "path": "devo-container/{name}", "connection": "storagemssaoc_STORAGE" }

Use Visual Studio Code to create and deploy Azure Function App (v1 method).

7. Update tags_mapper.json

20_Microsoft azure blob storage integration app.png

  • You can update inside tags_mapper.json:

    • Update list of companies.

    • Update list of services.

    • Update list of logs.

  • Tag would be a combination of company_name.service_type.log_type. Make sure you add all possible lists.

8. Create a Function App on Azure

  • Steps:

    • Log in to the Azure Portal.

    • Navigate to Create a Resource → Compute → Function App.

    • Choose your Subscription, Resource Group, and Function App Name.

    • Select Runtime Stack as Python, Version as 3.8 or 3.9, and Region closest to your data source.

    • Click Review + Create and then Create.

9. Deploy the Function App Using Visual Studio Code

  • Steps:

    • Use the Azure Functions extension in Visual Studio Code.

    • Right-click the local Project and select Deploy to Azure Function App.

30_Microsoft azure blob storage integration app.png

  • Choose the created Function App in Azure.

40_Microsoft azure blob storage integration app.png

  • Wait for the deployment to complete.

10. Update application settings after deployment

  • Steps:

    • In Azure left side menu in Azure Functions extension.

    • Select your function app.

    • Inside functions need to update the application setting.

50_Microsoft azure blob storage integration app.png

  • Update Methods:

    • If you already updated local.settings.json, right-click on Application settings and choose upload local settings.

    • Or add settings manually one by one:

      • AzureWebJobsSecretStorageType = File

      • AzureWebJobsStorage = <Your_Storage_Account_Connection_String>

      • devostorage1_STORAGE = <Your_Storage_Account_Connection_String>

      • WEBSITE_CONTENTAZUREFILECONNECTIONSTRING = <Your_Storage_Account_Connection_String>

  • Ensure all Storage_Account_Connection_String values are the same.

11. Test and Execute the Function

  • Steps:

    • Once deployed, navigate to the Azure Function App in the Azure Portal.

    • Select the function and click Test/Run to execute it.

    • Upload files to the configured Azure Blob Storage container.

  • Sub_folder or file should contain all three in name convention (company_name, service_name, log_type).

  • Example:

    • Folder name:

60_Microsoft azure blob storage integration app.png

  • File name :

70_Microsoft azure blob storage integration app.png

12. Verify Data Ingestion in Devo

  • Steps:

    • Log in to your Devo account.

    • Navigate to the relevant data stream and verify if the data from the Azure Blob Storage is being ingested correctly.

Multiple Blob Storage Containers:

 

Related content