Guides

Create Scheduled Export Tasks

In this page we will learn how to create a scheduled export task.

To access this area, expand the Data menu item and click in Scheduled Tasks:

menu

To start creating a new task, from the list of scheduled tasks, click in the New Task button:

new task button

In this page you will need to provide a name for this task:

name

You will also have to provide the frequency at which it should run. You can choose between Hourly and Daily in the following field:

frequency

If you choose hourly, you will have to provide the minute of each hour when this task should run:

frequency hourly

If you choose daily, you will have to provide the time of the day when this task should run:

frequency time

Then you will need to select the source of your data. You can choose between Amazon's S3, Microsoft's Azure Blob, Google Cloud Storage and any FTP or SFTP server:

storage source

Amazon Web Services S3

To use a AWS S3 bucket select Amazon Web Services S3 from the Storage selector:

source s3

Then you will need to provide the bucket name:

s3 bucket

You will also have to provide the AWS Key:

s3 key

And the AWS Secret:

s3 secret

You will also have to provide the region where your S3 bucket is located:

s3 region

Microsoft Azure Blob Storage

To use a Microsoft Azure Blob Storage container select Microsoft Azure Blob from the Storage selector:

source azure

Then you will need to provide the account name:

azure account

After that you will need to provide the container name:

azure container

You will also have to provide the Azure Blob Storage access key:

azure key

Google Cloud Storage

To use Google Cloud Storage as the source of your scheduled tasks select Google Cloud Storage from the Storage selector:

source google cloud

Then you can either use the configuration file (a JSON file that you can download from Google Cloud's interface) to quickly setup all the definitions needed to configure this service:

gcs config file

Or you can manually insert all those settings in each field, starting with the project identifier:

gcs project id

The client email used to authenticate:

gcs client email

And the private key:

gcs private key

You should also insert the name of the bucket you wish to use:

gcs bucket

FTP Server

If you would like to use a FTP server, please select FTP (File Transfer Protocol) from the Storage selector:

source ftp

For an FTP server you must provide the host name and port number:

ftp host port

You must also provide the username:

ftp username

And the password:

ftp password

If you server supports TLS (recommended), please check the following box:

ftp tls

And if it uses a self-signed certificate, please check the following box:

ftp self signed certificate

SFTP Server

If you would like to use a SFTP server, please select SFTP (SSH File Transfer Protocol) from the Storage selector:

source sftp

For this type of storage, you have two authentication options. You can choose between the Using a Password or Using a Private Key options from Authentication Type selector:

sftp auth type

You must provide the host name and port number:

sftp host port

And you must also provide the username:

sftp username

If you choose the option Using a Password, you must provide the password:

sftp password

If you've selected Using a Private Key instead, please provide the private key:

sftp private key

And optionally, a passphrase (if applicable):

sftp passphrase

Then you should define if an export job should overwrite the previous file by toggling the following option:

overwrite previous

You can also define if the resulting export file should be prefixed (in object based storage types) or put in a folder (FTP or SFTP):

export prefix

And you can also define if the resulting file should have a specific name:

export file name

And finally, if you left the previous field blank, you can define a specific format for the resulting file (e.g.: export_{EPOCH}.csv):

export file name format

When you are done configuring the source of your data, you should select which type of export job this scheduled task should perform:

job type

To learn more about export jobs, please read our guides located here.

Once you've provided all the data required, you can quickly test if everything is correct by hitting the Test Task button before actually creating the task:

test button

If everything is OK, you will see something like this:

test ok

If there's something wrong, you will see an error like the one below:

test error

Once you're ready to create your scheduled task, click in the Create Task button to save it:

create button

Keep reading our guides and learn how to edit a task.