Stitch Documentation
has moved!

Please update your bookmarks to https://www.stitchdata.com/docs

If you're not automatically redirected after 5 seconds, click here.

Syncing Data from a Database Integration

After you initially connect a database integration to Stitch, we'll perform a structure sync to detect the schemas, tables, and columns in your database. Once this sync is complete, you'll be able to to select the data you want to sync, set table Replication Methods, and choose a Replication Frequency for the integration.

Your data will begin replicating as soon as you complete the setup process.

In this article, we'll cover:

Syncing Databases, Tables, & Columns

Missing & Unsupported Databases/Tables
If you're missing databases and/or tables, verify that you gave the Stitch user all the required permissions. Only the databases and tables that our user has access to will display in the Stitch app for syncing.

If a table has a Sync Status of Unsupported, try these troubleshooting tips.

Database integrations give you the ability to sync down to the columnar level.

  1. Click into the integration from the Stitch Dashboard page.
  2. In the databases list for the integration, click the icon next to the Status column to sync the database.
  3. The icon will turn green and the status will change to Syncing.
  4. The next step is to select tables to sync. Click on the database name and a list of tables in the database will display.
  5. Click the icon next to the Status column to sync a table.
  6. At this point, you'll be prompted to select a Replication Method for the table:
    1. Select the appropriate replication method: Incremental or Full Table.
    2. If using Incremental Replication, set the Replication Key.
    3. Click Update Settings to save the replication method.
  7. To sync individual columns in the table, click on the table name. A list of columns in the table will display.
  8. In the list of columns, click the icon next to the Status column to sync the column. Be sure to sync the Primary and Replication Key (if using Incremental Replication) columns!
  9. You can sync all columns by clicking the grey icon above the Syncing Icon column and selecting Start Syncing All Columns.

Here's a look at syncing a new table and assigning a replication method:

Syncing data in a database integration.
Click for a closer look.

Unyncing Databases, Tables, & Columns

You can unsync databases, tables, and/or columns, individually or en masse with just a few clicks.

Unsyncing Individual Components

Want to stop syncing an entire integration? Use the pause integration feature.

Unsyncing individual databases, tables, and columns is done exactly the opposite of syncing.

  1. Click into the integration and navigate to the database, table, or column.
  2. Click the icon next to the Status column. The icon will turn grey and the status will change to Not Syncing.

Unsyncing En Masse

You can unsync all databases, tables, and/or columns by clicking the grey icon above the Syncing Icon column and selecting Stop Syncing All:

The Stop Syncing All feature.
Click for a closer look.

You can also click into the database/table and then click the Stop Syncing button located above the schema section.

Note: if you want to resync a previously unsynced table, you'll need to set the table's replication method again.

When will my data be in my data warehouse?

A few factors can play into how quickly you'll see the new data or changes take effect in your data warehouse. The volume of data in your tables, the replication method, and the integration's replication frequency setting can all impact how long it takes for your data to replicate.

If your data hasn't shown up after a reasonable amount of time, please reach out to our support team. We'll help you get to the bottom of it.

What's next?

If you haven't already, the next step is to set replication methods and the replication frequency for your integration.

We recommend that you check out the articles linked below in the Related section. These resources will help you understand how your data will appear in your data warehouse, how Redshift handles schema changes, why some tables/columns have hashed names, and more.

Related:

Was this article helpful?
0 out of 0 found this helpful

Comments

Questions or suggestions? If something in our documentation is unclear, let us know in the comments!