Azure Blob Storage

Azure Blob Storage helps you create data lakes for your analytics needs, and provides storage to build powerful cloud-native and mobile apps. Optimize costs with tiered storage for your long-term data, and flexibly scale up for high-performance computing and machine learning workloads.

View Azure Blob Storage's documentation and status page.

Overview

Hightouch lets you pull data from CSV and JSON files stored in Azure Blob Storage and push them to downstream destinations. To get started, you need an Azure Blob Storage account and container.

Azure credential setup

See the guide for configuring Azure credentials to learn how you can set up a service account and use its credentials. The IAM user whose credentials you use must have programmatic access enabled and permission to read from the Blob Storage path you want to use.

Connection configuration

To get started, go to the Sources overview page and click the Add source button. Select Azure Blob Storage and follow the steps below.

Configure your service account

Select the credentials you previously created or click Create new to set them up now.

Configure your source

Enter your Blob Storage Account name and Container name.

Test your connection

When setting up Azure Blob Storage as a source for the first time, Hightouch validates your Azure credentials and access to your Blob Storage. Once the test passes, click Continue to finish setup.

Next steps

Once your source configuration has passed the necessary validation, your source setup is complete. Next, you can set up models to define which data you want to pull from your Blob Storage. The file must have either a .csv or .json extension.

CSV requirements

CSV files must meet the following requirements:

• They must have a header row. The values in the header row are automatically available as column names when you set up a sync.
• They must use comma-separated values; tabs and other delimiters aren't supported.
• They must use double quotes (") for quoted values.

JSON requirements

JSON files must meet the following requirements:

• The input file must contain an array at the top level.
• Each element in the input file must be an object with the same keys.

The keys of the array elements are automatically available as column names when you set up a sync.

Model setup

1. In Hightouch, go to the Models overview page.
2. Click Add model.
3. Select the Azure Blob Storage source you previously created.
4. Enter the relative path to the CSV or JSON file that you want to sync data from.
5. Preview your model's query results.
6. Click Continue.
7. Name your model and select its primary key. Hightouch uses the primary key to determine which rows have been added, changed, or removed since the last sync.

Tips and troubleshooting

To date, our customers haven't experienced any errors while using this source. If you run into any issues, please don't hesitate to reach out. We're here to help.