Overview

You can import CSV or Parquet files from your connected cloud storage partner into CleverTap to keep user profiles and event data up to date. The import job defines the file name convention that CleverTap uses to identify and process files on each run.

This document covers the following:

• Prerequisites
• Create Import
• FAQs
• Next Steps

Prerequisites

Before you create an import, ensure that a connected storage bucket and correctly formatted files are available.

• A connected storage bucket from a supported cloud storage partner. For more information, refer to the configuration document for your partner: AWS S3, Google Cloud Platform, or Microsoft Azure.
• Files in CSV or Parquet format that meet the requirements in Review File Requirements

Review File Requirements

To import data from your cloud storage bucket, files in CSV or Parquet format must meet the following formatting requirements.

Create Import

Creating an import defines the bucket, the file name format, and the nickname that CleverTap uses to find and process your files.

Configure Import

Configuring the import involves selecting a cloud storage partner and entering the import details.

1. Go to Settings > Partners > Import Center and click Create Import.

2. Select a cloud storage partner from the Create Import popup.

   

3. Under Configure Import, add the details in the following table:

   

   Field	Description
   Nickname	A unique name that identifies the import job in CleverTap. Choose a name that reflects the purpose of the import, for example, Events Daily.
   Storage Bucket	Select a connected storage bucket from the dropdown. CleverTap populates the storage URL automatically based on the selected bucket. For more information about setting up a connection, refer to the partner-specific configuration document.
   File Name	Define the file name format that CleverTap processes. The file name is case-sensitive. CleverTap imports only files whose names exactly match the specified file name, timestamp, and format. For more information, refer to Define File Name Format.

4. (Optional) Click Preview Results to validate your configuration.

5. Click Next to open the Select and Map Data page, where you set the mapping preference, configure identity mapping, and map your file columns to CleverTap fields. For more information, refer to Map Data for Import.

Define File Name Format

CleverTap recognizes and processes only files that use the following name format:

<File Prefix><Date Time Format>.<File Format>

• File Prefix: Enter the exact leading portion of the file name in the text field.
• Date-Time Format: Select the timestamp format used in your file names. CleverTap uses this format to parse the timestamp and determine which files to process on each run. For more information, refer to Review Supported Date-Time Formats.
• File Format: Select CSV or Parquet to match the format of your files.

Review File Selection for Each Run

CleverTap selects files whose names begin with the configured file prefix, end with a timestamp, and use the selected format (.csv or .parquet). On the first run, CleverTap processes all matching files in the bucket. On each subsequent run, CleverTap processes only files with a timestamp newer than the previous run.

Review Supported Date-Time Formats

CleverTap supports the following timestamp formats for file name matching, and you select the format that matches your files from the Date-time format dropdown.

FAQs

What happens if my file exceeds the maximum file size?

CleverTap marks files that exceed the maximum file size (5 GB for CSV and 1 GB for Parquet) as failed and does not process them. Ensure that your files stay within the limit before you upload them to your cloud storage bucket.

Next Steps

After you configure the import, CleverTap saves the import job, and you can view and manage all import jobs from the Import Center.

• Map your file columns to CleverTap fields. For more information, refer to Map Data for Import.
• Schedule the import. For more information, refer to Schedule Import.