Stitch Documentation
has moved!

Please update your bookmarks to https://www.stitchdata.com/docs

If you're not automatically redirected after 5 seconds, click here.

Syncing New Columns On an Already-Syncing Table

When a new column is added to a table you're already syncing, what happens? In this doc, we'll cover:

Syncing a New Column

How new columns are surfaced in Stitch varies depending on the integration type: database or SaaS.

Database Integrations

For database integrations, it may take some time after you add a new column to a table for it to show up inside Stitch.

Here's what happens when new columns are added to database integrations:

  1. During a replication attempt, a structure sync is performed
  2. The new column is detected
  3. Structure sync completes
  4. New column displays in the Integration Details page
  5. Column is automatically selected to sync
  6. Data for the column will replicate based on the Replication Method for the table

Note that this is only applicable to tables that are already syncing. If the table isn't currently selected to sync, the new column will display inside Stitch but will have to be manually synced just like any other column.

SaaS Integrations

For SaaS integrations, you won't actually see the new column inside the Stitch app, even for those integrations that support greylisting, or syncing at the table level.

Here's what happens when new columns are added to SaaS integrations:

  1. New column is added - for example: a custom field in NetSuite
  2. During a replication attempt, a structure sync is performed
  3. The new column is detected
  4. Structure sync completes
  5. Column is automatically selected to sync
  6. Data for the column will replicate based on the Replication Method for the table

For more info on the Replication Methods used by specific SaaS integration tables, refer to the Expected SaaS Data docs.

Impact on Row Count

Because billing is based on row count, it's important to keep in mind how syncing additional columns on tables can affect your usage. How Stitch handles the syncing of additional columns depends on the table's Replication Method.

Full Table Replication

For tables using Full Table Replication, data in the new column will be available for all rows - including new and existing - after the next replication job successfully completes.

Incremental Replication

For tables using Incremental Replication, data in the new column will be available for new rows added after the column is synced. By default, data from new columns isn't available for existing rows.

Getting new column data into existing rows requires a full resync of the table. Because this can significantly impact your row count and we don't want to re-replicate data without your say-so, we leave inserting new column data into existing rows up to you.

Adding New Column Data to Existing Rows 

Important!
The process in this section only applies to database integrations.

To request a full resync of a SaaS integration table, please reach out to support.

To add new column data to existing rows in tables using Incremental Replication, you can temporarily change the Replication Method for the table.

Changing the Replication Method will kick off a full resync of the table and re-replicate all existing rows to capture data from the newly added column.

  1. Navigate to the desired table in the Integration Details page and open the Table Settings
  2. Toggle the Replication Method from Incremental to Full Table.
  3. After you've verified that the update is complete and the data from the new column is available in all rows, change the Replication Method back to Incremental.

Related

Was this article helpful?
0 out of 0 found this helpful

Comments

Questions or suggestions? If something in our documentation is unclear, let us know in the comments!