The Transform Data module lets you build multi-step templates to clean, standardize, and reformat field values across your CRM records. This article answers common questions about how Transform Data functions behave, including function execution order, template organization, standardizing fields with many variations, troubleshooting Map function results, working with the Preview CSV, filtering records before running an operation, and formatting addresses, names, and phone numbers.
Frequently Asked Questions
Does the order of Functions matter when mapping values?
Yes, the order of functions matters when mapping values. Functions in the Transform Data and Magical Import modules run in the order they are listed, from top to bottom.
In the example below, placing the cleanup functions before the Map: Values functions ensures the field is already standardized when the mapping function runs, producing more reliable results than mapping first.
The image above shows the same Job Title field in step 2 of the Transform Data module with four cleanup functions applied before the Map: Values functions, in this order: Remove: Leading/trailing whitespace, Remove: Successive whitespace, Remove: Non-letters, and Format: Proper case person, followed by the Map: Values functions mapping the cleaned values to standardized text.
Should I build a separate template for each field I want to format?
Yes. Best practice is to build separate templates for each field you want to format. This helps you to keep things organized and troubleshoot issues if they arise. If you end up with several related templates you'd like to run together automatically, you can create a Recipe.
What should I do if a field has too many variations to standardize at once?
In the Transform Data module, when a field has many variations, setting up functions to catch every variation in a single template can be hard to manage and error-prone. Trying to account for all variations in one pass makes it harder to track which variations have already been handled.
To reduce the number of variations before building functions in the Transform Data module, first analyze the field and use the Cleanse Data module to standardize the data and reduce the total number of variations. Once you've reduced the number of variations, you can use the Transform Data module to standardize the remaining values in bulk and automate the process going forward.
The image above shows step 2 of the Transform Data module, with three functions applied to the Company Name field: Format: Proper case company, Remove: Terms with a parameter of "llc|inc|inc.|llp," and Remove: Leading/trailing whitespace.
Why aren't my mapped values being standardized?
In the Transform Data and Magical Import modules, mapped values aren't standardized when the Existing Text field in a Map: Values function doesn't account for every variation in the field, including small differences like extra whitespace or errant keystrokes. The Map: Values function only matches the exact variations listed in the Existing Text field, so any variation not listed passes through the function unchanged.
The image above shows three Map: Values functions applied to the Job Title field in the Transform Data module under step 2, each listing raw variations in the Existing Text column (such as "vp sales" and "vp of sales") mapped to a single standardized value in the New Text column (such as "VP Sales"), with no cleanup functions applied before the mapping functions.
To ensure that all variations in a field are captured before applying a Map: Values function, you can use either of the following approaches:
- Use the Cleanse Data module to identify the variations that should be included in the Existing Text field of the Map: Values function.
- Add other Transform Data functions before the Map: Values function to reduce the number of variations. Removing non-letters, removing whitespace, or formatting the field in bulk before mapping can automatically consolidate small inconsistencies, so you need to list fewer variations manually.
Functions run in the order listed, so it works best to include cleanup functions before mapping ones.
The image above shows the same Job Title field in step 2 of the Transform Data module with four cleanup functions applied before the Map: Values functions, in this order: Remove: Leading/trailing whitespace, Remove: Successive whitespace, Remove: Non-letters, and Format: Proper case person, followed by the Map: Values functions mapping the cleaned values to standardized text.
Why aren't the fields I added to my layout showing up in the Preview CSV?
In the Transform Data module, fields added to your Layout and Record Viewer do not appear in the Preview CSV because the CSV file always includes a fixed set of fields, regardless of what is in your Layout. The Preview CSV includes only record identifiers, a deeplink to the record in the CRM, and the Before and After values for the fields being transformed. You can't add or remove any other fields from the Preview CSV.
To see all the fields that are in your Layout and Record Viewer in the Transform Data module, use the Export button under step 1 instead of the Preview CSV. This exports the current data, including all Layout fields, without applying the transform updates, so you can review the full record data before the transformation runs.
The image above shows the Step 1 Filter tab of the Transform Data module, with a Street Address filter set to "contains" and values including "street," "st.," "drive," "dr.," "avenue," and "av," and an arrow pointing to the Export button located next to the Search button below the filter fields.
Why do I need to filter my data?
Filtering data before running an operation ensures Insycle analyzes only the records you want to focus on. Otherwise, Insycle will look at all records of the selected record type in your CRM.
There are a few reasons filtering is important:
- You only want to change a segment of records that meet certain criteria.
- If you have thousands of records, the operations can take a very long time. It is more efficient and manageable to filter your data into chunks and use multiple templates than to run operations on your entire database.
- There may be an overwhelming number of results. If you are trying to analyze your data, adding a filter or narrowing filter criteria lets you work with a relevant, reasonably sized subset of data.
Can I format phone numbers with country codes?
Yes, Insycle can help you format phone numbers with country codes. For more information, see the Format Phone Numbers for Country Codes article.
Can you help me build a custom template to format a specific field in my database?
Yes. If you are having trouble figuring out how to format a specific field, contact customer support via live chat for help building your template.
Which functions can I use to format addresses?
| Function Name | Description |
|---|---|
| Standardize: US States and CA Provinces | Format the full names of US states and Canadian provinces. |
| Standardize: Country name to Codes or vice versa | Format country names to the ISO alpha-2, two-character, or ISO alpha-3, three-character abbreviations. Or convert codes to the full name. |
| Map: US Zip Postal Code to US State | Use the zip/postal code value to write the two-character US state into a specified field. |
See the Function Catalog for more details.
Which functions can I use to format names?
| Function Name | Description |
|---|---|
Format: Proper case person |
Format name field values with proper case. |
| Format: Proper case company | Format company names to title case. This function can also format addresses properly. |
Split: By space and pick just the 1st term |
Configure this to use the first name from the full name field. |
| Split: By space and pick just the 2nd term | Configure this to use the last name from the full name field. |
See the Function Catalog for more details.
Which functions can I use to format phone numbers?
| Function Name | Description |
|---|---|
Format: Phone E.164 Standard +xxxxxxxxxx |
Formats numbers in E.164 format for international phone number formatting. |
Format: Phone USA (xxx) xxx-xxxx |
Format US phone numbers to the (xxx) xxx-xxxx standard. |
Format: Phone Custom Separator |
Use a custom separator, such as a dash "-" or a period "." between integers, and set the pattern. For example, the Phone value "442012345678" could be formatted as "44-20-1234-5678." |
See the Function Catalog for more details.
Additional Resources
Related Help Articles