Send your event data from RudderStack to Microsoft Azure Blob Storage.
4 minute read
Azure Blob Storage is Microsoft’s cloud-based object storage solution. It provides scalable and secure storage for high-performance workloads, cloud native apps, machine learning, and more.
RudderStack supports sending your event data from a variety of sources to your Azure Blob Storage container.
Find the open source transformer code for this destination in the GitHub repository.
Setting up Azure Blob Storage
Follow these steps to set up Azure Blob Storage before adding it as a destination in RudderStack:
Next, choose your storage account and click Containers under Data storage .
Create a new container. This is where RudderStack will store all your event data.
You also need to provide an access key to authorize RudderStack to write to your container. Under Security + networking, click Access keys. You can find your access keys here.
Note the storage account name, container as well as access key. This information is required to set up Azure Blob Storage as a destination in RudderStack.
If you wish to grant limited access to your Azure Storage resources, you can use the Shared Access Signatures (SAS) instead of your access key. To generate a SAS token, go to Security + networking > Shared Access Signature.
SAS token permissions
You can use the shared access signatures (SAS) to delegate specific permissions to your storage account resources. This gives you granular control over how users can access your data.
For more information on shared access signatures (SAS) and how to use them, refer to this Azure documentation.
For your Blob Storage destination, RudderStack requires the Write permission to write to your container. Make sure it is checked in the Allowed permissions setting. An example is shown below:
If you’re using Blob Storage as an intermediate object storage for your data warehouse destinations, you need to assign the following permissions for your SAS token:
Warehouse destination
Minimum required permissions
Azure Data Lake
Read, Write
Azure Synapse
Read, Write
Clickhouse
Read, Write
Databricks Delta Lake
Read, Write
Microsoft SQL Server
Read, Write
PostgreSQL
Read, Write
Snowflake
Read, Write
Configuring Azure Blob Storage in RudderStack
To enable dumping data to Microsoft Azure Blob Storage, you will first need to add it as a destination in RudderStack. Once the destination is configured and enabled, events from RudderStack will start flowing to your Azure Blob Storage container.
Follow these steps to add Blob Storage as a destination in RudderStack:
From your RudderStack dashboard, add a source. Then, from the list of destinations, select Azure Blob Storage.
Assign a name to the destination and click Continue.
Connection settings
To successfully configure Azure Blob Storage as a destination, you will need to configure the following settings:
Azure Blob Storage Container Name: Enter the name of your Blob Storage container used to store the data.
Prefix: If specified, RudderStack will create a folder in the bucket with this prefix and push all data within that folder. For example, https://<account_name>.blob.core.windows.net/<container_name>/<prefix>/
Azure Blob Storage Account Name: Enter your Azure Blob Storage account name that you copied in the Setting up Azure Blob Storage section above.
Azure Blob Storage Account Key: This option is only applicable if Use shared access signature (SAS) Tokens is disabled. In that case, enter the access key associated with your Blob Storage account.
Use shared access signature (SAS) Tokens: Enable this setting to use a shared access signature (SAS) token to grant limited access to your Azure storage resources.
Azure Blob Storage SAS Token: If Use shared access signature (SAS) Tokens is enabled, enter your Blob Storage SAS token generated in the Step 7 of the Setting up Azure Blob Storage section above.
Microsoft Azure Blob Storage is successfully added as a destination in RudderStack. Once you send an event from your source, RudderStack will send it to your specified Blob Storage container.
This site uses cookies to improve your experience while you navigate through the website. Out of
these
cookies, the cookies that are categorized as necessary are stored on your browser as they are as
essential
for the working of basic functionalities of the website. We also use third-party cookies that
help
us
analyze and understand how you use this website. These cookies will be stored in your browser
only
with
your
consent. You also have the option to opt-out of these cookies. But opting out of some of these
cookies
may
have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This
category only includes cookies that ensures basic functionalities and security
features of the website. These cookies do not store any personal information.
This site uses cookies to improve your experience. If you want to
learn more about cookies and why we use them, visit our cookie
policy. We'll assume you're ok with this, but you can opt-out if you wish Cookie Settings.