Enter a Name for your destination. This is only for your reference – it can be anything that makes sense to you.
Enter authentication details for your SFTP server. Host and Username are always required. If your server requires a password instead of an SSH key, enter the Password. If your server uses SSH keys, you can leave the Password blank.
Click Save Connection.
If you're using SSH keys to authenticate your server, download the SFTP Public Key from this screen and upload it to your server. Then, click Test to verify that the connection works.
Your end state should look something like this: 👇
Connections page with SFTP server set up
Step 2: Connect your data warehouse
The steps for connecting your data warehouse will depend on your technology. See the following guides:
After setting up your warehouse, your Connections page should look something like this: 👇
Connections page with data warehouse and SFTP server
Step 3: Create your model
When defining models, you'll write SQL queries to select the data you want to sync. This can be as simple as selecting everything in a specific database table or as complex as creating new calculated values.
From inside your Census account, navigate to the Models page.
Enter a name for your model. You'll use this to select the model later.
Enter your SQL query. If you want to test the query, use the Preview button.
Click Save Model.
Basic SQL query for a new model
Step 4: Create your first sync
The sync will move data from your warehouse to a new or existing CSV file on your SFTP server. In this step, you'll define how that will work.
From inside your Census account, navigate to the Syncs page and click Add Sync.
Under What data do you want to sync?, choose your data warehouse as the Connection and your model as the Source.
Under Where do you want to sync data to?, choose the name you assigned in Step 1 (we used SFTP) as the Connection. Enter the File Path for the CSV file where data will sync. The path can accept variables that will populate when the sync runs. See File Path Variables. Confirm the file path in the Template Preview field.
Under How should changes to the source be synced?, Mirror will be automatically selected. This is the only supported sync behavior for SFTP.
Under Which properties should be updated?, choose whether to sync only Selected Properties or Sync All Properties. Syncing all properties will add new properties to the sync if the model changes.
To test your sync without actually syncing data, click Run Test and verify the results.
Click Next. This will open the Confirm Details page where you can see a recap of your setup.
If you want to start a sync immediately, set the Run a sync now? checkbox.
Click Create Sync.
When configuring your sync, the page should look something like this: 👇
Setting up a sync to an SFTP server
Step 5: Confirm the synced data
Once your sync is complete, it's time to check your data. Go to the specified path on your SFTP server and check that the file updated correctly.
If everything went well, that's it! You've started syncing data from your warehouse to your SFTP server! 🥳️
When defining the File Path for an S3 sync, you can use variables that will be set when the sync runs. This allows you to create and sync to new CSV files in the S3 bucket that reflect the date and time of the sync.