Module Overview: Magical Import

merge-duplicates-assembly-line.png

 

Your team is spending valuable time in Excel cleaning and standardizing your data before importing it into your CRM. Even with this effort, details are being missed, formatting is often inconsistent, and some duplicates are being created in your CRM. Though the CRM has a built-in import tool, the features are limited.

Insycle's Magical Import module lets you import data flexibly and efficiently, ensuring that clean, non-duplicate data is entered into your CRM. You can explore, format, standardize, associate, and cleanse the data before importing it into the CRM (instead of using Excel or other tools).

Key Use Cases

How It Works

When you select a CSV in Insycle, it doesn't immediately import into the CRM. Instead, it loads your CSV into Insycle for preprocessing.

If AI is enabled for your selected object type, Insycle will automatically analyze your CSV columns and suggest suitable CRM field mappings and matching criteria. You can then review and adjust these AI suggestions as needed or map fields manually if AI isn't enabled or can't determine appropriate matches.

You'll choose how to use the data on a field-by-field basis and can manage your data in various ways, including cleansing, formatting, standardizing, appending data, and creating relationships before importing it into your database.

Insycle also helps prevent duplicates during import by using unique identifiers and comparing CSV rows to existing CRM data.

With the Magical Import module, you can also:

  • Look for duplicates between your CRM and the CSV, and compare values
  • Delete listed items from your database
  • Export CRM data side-by-side with CSV values

You can save the import configuration as a template so future imports can be set up with just a couple of clicks.

Step-by-Step Instructions

1. Select the CSV File for Import and a Template

Navigate to Data ManagementMagical Import. Then select the database and the record type in the top menu.  

Select the CSV 

Choose the CSV file that you would like to import.

magic-import-choose-csv.png

The Preview panel will open and load the CSV rows, with a column for each field. Initially, you may see warning icons icon-red-warning-19x17.png next to columns that don't exactly match field names in your CRM database.

magical-import-contacts-preview-646w.png

AI-Powered Automatic Mapping

If you have AI enabled for this object type (with at least "Meta" level access configured in your AI settings), Insycle will automatically use AI to analyze your CSV column names and suggest appropriate CRM field mappings and matching criteria. This process happens in the background after your CSV loads.

The AI only accesses metadata such as column names and field labels—no actual record data is shared with AI service providers during this mapping process.

Select a Template 

Select a template if you or someone on your team has already saved one that can handle importing from the same source. Templates streamline and standardize the import process, enabling the entire team to import data reliably and uniformly each time.

magical-import-template-import-format-assoc.png

Magical Import templates load configurations that will affect the Data Mapping, Preparation, Validation, and Operations settings. When settings are loaded from a template, a blue number indicates where settings are applied.

magical-import-headings-w-numbers-646w.png

AI vs. Template Priority

If you select a template after AI has processed your CSV, the template settings will take precedence over AI suggestions. For the best results, consider selecting your template first, then reviewing any additional AI suggestions for unmapped fields.

2. Map CSV Columns to CRM Fields and Select Matching Criteria

If AI is enabled for your selected object type, the Data Mapping section will automatically expand after processing your CSV. If AI is not enabled, click the Data Mapping heading to expand the section manually.

AI-Generated Suggestions

When AI is enabled, Insycle analyzes your CSV column names and automatically suggests:

  • Field mappings - Which CRM fields correspond to your CSV columns
  • Matching criteria - Which fields to use for identifying existing records

Always review these AI suggestions carefully before proceeding, as they may not be perfect for your specific use case.

Review and Adjust Field Mappings

After AI processing (or when setting up manually), review how your CSV columns are mapped to CRM fields. AI will automatically map fields that it can identify with confidence. Any fields that still show a warning icon icon-red-warning-19x17.png require your attention—either AI couldn't determine the appropriate mapping, or AI is not enabled for this object type.

For unmapped fields, click the Not Mapped dropdown and search for the corresponding CRM field. You can also adjust any AI-suggested mappings if they don't match your intended use.

magical-import-contacts-map-owner-646w.png

Specify How to Use the Values for Each Column

Next, tell Insycle how to handle data for each field by choosing the Field Logic for each column. AI suggestions do not affect Field Logic settings; you'll need to configure these based on your specific requirements.

There are four Field Logic options:

  • Update: Import CSV values into your CRM, overwriting existing CRM values (will skip empty CSV values).
  • Fill: Import CSV values only when there is no existing value in CRM (will not overwrite existing CRM values).
  • Overwrite: Import CSV values, including empty CSV values, into your CRM (will overwrite existing CRM values).
  • Append: Add CSV values to existing values in your CRM. For example, append notes from a CSV to existing notes, or add values on multi-select fields (checkboxes or picklists). When using Append on multi-select fields, you do not need to include the record's existing field values in your CSV — Insycle will add the new values alongside the existing values without overwriting them.

magical-import-contacts-mapping-import-mode-highlighted-646w.png

Review and Confirm Matching Criteria

If AI is enabled, it will automatically suggest Matching Criteria based on your CSV columns and CRM fields. Review these suggestions carefully, as Matching Criteria determine how Insycle compares your CSV data with existing CRM records to identify matches for the same entity.

Matching Criteria are the unique identifiers that typically belong to only one entity, such as:

  • Email address
  • Company domain (for business records)
  • Phone number
  • ID number
  • Street address

magical-import-contacts-mapping-import-match-criteria-email.png

You can modify AI suggestions or set multiple matching rules that are evaluated in order from top to bottom. This allows you to find matches based on multiple criteria in a single step.

For example, you could use the following criteria to match contact records:

  1. Email address
  2. First Name + Last Name + Company Name
  3. First Name + Last Name + Phone Number

magical-import-step-2-matching-criteria-610x269.png

Insycle attempts to match each CSV record using the first rule. If no match is found, it proceeds to the next rule, continuing until either a match is found or all rules are exhausted (in which case the CSV record is considered new or unique).

For best results, place your most precise matching criteria at the top of your rule list. Additionally, keep in mind that while names can be included as part of the matching criteria, they should be used in conjunction with other identifiers, as multiple individuals may have the same name.

Validating AI Suggestions

While AI can provide excellent starting points for field mapping and Matching Criteria, always verify that:

  • Mapped fields actually contain the type of data you expect
  • Matching Criteria use truly unique identifiers for your use case

Set Format for Dates from CSV

The Date Format tab allows you to reformat dates before importing them into your CRM.

Learn more about reformatting dates before importing data into your CRM.

magical-import-contacts-mapping-date-format.png

3. Standardize, Format, or Bulk Update Values Before Import (Optional)

Click the Data Preparation heading to expand the section.

Under Data Preparation in Magical Import, you can perform bulk edits to the CSV data before uploading it to your CRM. The options you select and apply here will be reflected in the Preview, not directly in your CRM.

Select fields from your CSV and apply formatting and transformation changes to the data. You can clean up, format, add or remove text, copy values to other fields, or make bulk updates before uploading to your CRM. These are the same functions found in the Transform Data module, which you can learn more about here.

As you add functions, you can click Apply after each one to see the changes in the Preview. magical-import-contacts-preparation-first-last-phone-country-646w.png

4. Exclude Data That Doesn’t Meet Validation Criteria (Optional)

Use Data Validation to filter out records that don't meet your quality standards, or to target a segment before importing them into your CRM with Magical Import. This feature helps ensure only clean, properly formatted data enters your system.

To set up data validation rules:

Click the Data Validation heading to expand the section.

Configure your validation criteria:

  • Select one or more fields from the Column Name(s) dropdown
  • Choose Include or Exclude from the Type dropdown:
    • Include: Only import rows that match this rule
    • Exclude: Skip rows that match this rule during import
  • Set the Condition that values must meet (such as "Contains text" or "Contains digits")
  • Enter any other text or parameters, if applicable

To add multiple rules, click Add Rule. Records must meet all validation criteria to pass—there is no prioritization of rules.

Click Apply to refresh the Preview with your validation rules applied.

magical-import-contacts-validation-2-email-name-country-646w.png

After applying validation rules, the Preview will update to show which records will be excluded. Any rows that don't meet your criteria will display a warning icon. Hover over the icon to see specific details about why the record will be excluded.

  Data validation rules apply to the Preview data rather than the CRM database or CSV file. If you've modified data using Data Preparation or other bulk updates, the validation rules will check against those updated values in the Preview.

magical-import-contacts-preview-warnings-email-country-646w.png

Picklist Validation

When a CSV column is mapped to a CRM picklist field, validation happens automatically. No rules need to be set up. If the CSV value isn't one of the valid options, a warning will appear. 

5. Make Updates to Matching CRM Records or Create Relationships (Optional)

Use Data Operations to modify records in your CRM, whether by updating values on existing records or creating relationships between the CSV and CRM records. 

Click the Data Operations heading to expand the section.

Make Bulk Changes to a Field 

On the Bulk Update tab, you can add a value to CRM fields even if you don't have the field in the CSV. This will add the same value for all of the imported records.

magical-import-contacts-operations-bulk-update-lifecycle-646w.png

Associate/Link Imported Rows to Records in Your CRM

The Associate tab (which may be called the Link tab, depending on your CRM's naming convention) allows you to create relationships between CSV records and existing records in your database during import. 

Learn more about creating relationships when importing.

magical-import-hubspot-contacts-operations-associate-w-companies-646w.png

6. Define the Action to Perform With the CSV

By default, Insycle will perform your chosen action on all of your CSV data. If you only want to process a few records, return to the table under Preview and check the boxes beside the selected records.

magical-import-contacts-preview-checkboxes-646w.png

At the bottom of the Magical Import page, there are four actions to choose from: Import, Compare (Preview), Delete, and Export.  

Import CSV Data into Your CRM

The Import feature will enrich existing records or create new records from data you have in your CSV.

Select the Records Mode to instruct Insycle on how to handle the data during the import process.

  • Update existing and create net new – If Insycle is unable to find a corresponding record, a new record will be created in your CRM.
  • Only update existing – If a corresponding record is found, it will be updated with the data from your CSV import. Data that is not matched with an existing CRM record will not be imported.
  • Only create net new – Only records that can not be matched with an existing record in your database will be imported. Records that already exist in your CRM will not be updated.

Please note that Intercom users only have the 'Only update existing' option.

When you click the Import button, you'll be prompted to confirm.

⚠️ Note that there is no preview step. Once you confirm, the changes will be applied to your CRM immediately.

magical-import-contacts-only-new-646w.png

Optionally, Add Records to Lists (HubSpot Only)

When importing HubSpot contacts, the Add to List setting will appear. From here, you can add the imported contacts to a new or existing list.

Type to search existing lists in HubSpot or use the button to Create a new list. If you select an existing list, the Show link will let you open it in HubSpot for a preview.

magical-import-hubspot-contacts-import+add-list-646w.png

Optionally, Add Records to Campaigns (Salesforce Only)

When importing Salesforce contacts or leads, the Add to Campaign setting will appear. From here, you can add the imported data to an existing campaign from Salesforce.

Type to search campaigns and make a selection, then select the Campaign Member Status. Use the Show link to open the campaign in Salesforce for a preview.

magical-import-salesforce-contacts-import-add-campaign.png

Look for Duplicates and Compare Values

Use the Compare (Preview) feature when you want a side-by-side comparison of CSV data against matching items in your CRM.

Compare features: 

  • Create a new CSV report comparing your import CSV values to your CRM.
  • See how many contacts from a file are net-new versus already existing in your database.
  • Show CSV data side by side with CRM data so you can preview how your CSV import would update data for existing records.
  • Check unsubscribes against your CRM database.

This is a read-only operation.

Learn more about using Magical Import to compare CSV data to existing records in your CRM.

magical-import-contacts-compare.png

Delete Listed Items from Your CRM

Use the Delete feature when you have a CSV containing records you know need to be deleted. You can match the CSV rows to CRM records and easily delete the data in bulk.

⚠️ Note that there is no preview step for this delete action. Once you click the Yes button to confirm, the records will be removed from your CRM.

Learn more about using a CSV to specify records to delete from your CRM.

magical-import-contacts-delete.png

Export CRM Data Side-by-Side with CSV Values

Use the Export feature when you want more information from your CRM about items you have in an external list. Put the items you want to look up in a CSV—you really only need the Matching Criteria used to look for matches in your database. Then select the CRM fields you want to export for the matching records.

Export features:

  • Create a new CSV report comparing your import CSV values to your CRM.
  • Add any CRM field values to include in the export using the Fields to Export.
  • See how many contacts from a file are net-new versus already existing in your database.

This is a read-only operation.

Learn more about exporting CRM data for CSV comparison or enrichment.

magical-import-contacts-export-646w.png

7. Review the Results

After the import runs, the Import Result breaks down the import information—how many records you tried to import and how many succeeded, failed, were updated, deleted, or unmodified. Click the Run ID to open a CSV record of the import. Insycle will also send a CSV report of these changes to your email. 

add-to-multi-select-import-result.png

Open the CSV file, and review the Result column to see how each row of your import was handled.

The Result column may show:

  • Created - A new record was created in your CRM
  • Updated - An existing record was found and updated with data from the CSV
  • Failed - If there is an issue, the Message field will give you details so you can troubleshoot

You can also see the (Before) and (After Update) values side-by-side for each field in your import.

magical-import-salesforce-contacts-csv.png

8. Create a Template to Streamline Future Imports (Optional)

After reviewing the results in the CRM and being satisfied with how the import works, you can save all the configurations as a template for future use when importing a CSV with the same source and format. With a template, all your settings are stored, including field mapping, cleanup and standardization, validation, and more, so you will have minimal work for future imports. This can also provide consistency when several team members are responsible for data tasks.

Return to the Template menu at the top of the page and click the disk icon to save this as a new template, making sure to give it an informative name.

magical-import-save-template-646w.png

Tips for Importing from a CSV

  • It is best to save your CSV file in UTF-8 format. This ensures any special characters or symbols are recognized by Insycle during import.
  • While AI can provide an excellent starting point for column mapping and Matching Criteria, always verify that the suggestions are the best option for your specific use case and data quality standards.
  • You can experiment with how the Preparation, Validation, and Operations settings will work before updating your CRM. After you have set up functions to apply to your CSV data, click the Apply button. The Preview data will be modified per these configurations. If you don’t like how a function played out, make adjustments and reapply them. If you don't want to use a function at all, delete the setting. When you click Apply again, the affected data will revert to its original state.
  • Importing a large dataset can take some time to process, and Insycle handles this process in the background. Once you click Import, there is no need to keep the page open; you can move on to other tasks. To check the status of your import, go to the Activity Tracker.

Advanced How-Tos

Selecting Matching Criteria

Insycle uses Matching Criteria to compare your CSV to your CRM data. Matching Criteria must be "unique identifiers." These are data points that could only belong to a single entity—such as email addresses, phone numbers, street addresses, or ID numbers.

Additionally, when using an email field, Insycle will automatically cross-reference any additional email fields in the records for a match. If using a domain field, Insycle will check additional domain fields.

magical-import-contacts-mapping-import-match-criteria-email.png

When you configure your Matching Criteria rules, the Preview refreshes, showing which records are already in your CRM. The records Insycle found will appear as blue links that open the record in your CRM.

magical-import-contacts-preview-existing-blue-links-646w.png

You can set multiple matching rules that are evaluated in order from top to bottom. Insycle attempts to match each CSV record using the first rule. If no match is found, it proceeds to the next rule, continuing until either a match is found or all rules are exhausted—at which point the CSV record is considered new or unique.

For example, you could use the following criteria to match contact records:

  1. Email address
  2. First Name + Last Name + Company Name
  3. First Name + Last Name + Phone Number

magical-import-step-2-matching-criteria-610x269.png

For best results, place your most precise matching criteria at the top of your rule list. Keep in mind that while names can be included in matching criteria, they should always be combined with other identifiers, since multiple individuals may share the same name.

Important Note

You can select more than one field in each Matching Criteria rule; however, ALL of the fields must match, not just one or some of them. If you include five fields and four of them match, but one doesn't, Insycle will not consider the rule a match.

magical-import-contacts-mapping-too-many-criteria.png

In this scenario, if you import using either the 'Update existing and create net new' or 'Only create net new' Record Modes, Insycle will create a new record for any CSV row that doesn't meet all 5 criteria.

If you use the 'Only Update Existing' mode, there will likely be few records that match all your criteria, and much of your CSV data will not be imported because Insycle will not be able to find the correct record to update.

magical-import-contacts-only-new-646w.png

Typically, it is best to use a single field for your first Matching Criteria to improve the likelihood of finding existing records in your CRM. You can then add additional rules to match multiple fields.

Standardize URL Formats before Importing Data

If you rely on URLs to match imported data with records in your CRM, the formatting of those values can be key. The data in your CRM may be inconsistent, with different representatives entering URLs in varying formats, or website addresses may be formatted differently in an external data source.

For example:

  • https://www.acme.com
  • http://acme.com
  • acme.com
  • www.acme.com

When importing, a CSV with varied URL formats might look like this:

magical-import-companies-preview-website-URLs-mixed-up.png

Insycle lets you easily clean and format values from a CSV before import. All the cleanup occurs on the Insycle side, ensuring the import contains standardized data.

By using the Functions under Data Preparation, you can make bulk changes to the CSV data before it is uploaded. The options selected and applied here will be reflected in the Preview rather than directly applied to your CRM.

To eliminate format variants, you can isolate the second-level domain. Under Data Preparation, select the website or URL column, then select the Extract: Domain from URL function. This will retain only the second-level and top-level domains (acme.com). If you need to take it a step further and remove the top-level domain (keeping "acme"), add a second function to the column: Remove Top-level Domain

magical-import-preparation-functions-extract-domain-remove-TLD.png

Click Apply, then review the column data changes in the Preview to verify that the column data matches the required format. In this example, the domain has been extracted from the URL, leaving only the second-level and top-level domains. These are the values that will be imported into your CRM.

Learn more about cleaning data before vs. after importing it into your CRM.

Edit CSV data on the fly

Before importing, you can correct or update any value directly in the Preview — without modifying your original CSV file.

To edit a value, hover over it in the Preview table. A pencil icon will appear to the right of the value. Click the icon to open the Edit popup.

magical-import-contacts-preview-edit-pencil-w-arrow.png

In the Edit popup, type the updated value and click Save. To remove the value entirely, click Clear. To discard your change, click Cancel.

magical-import-contacts-preview-edit-popup.png

The updated value will be used when Insycle runs the import. The value in your original CSV file is not changed.

Use Validation Rules to Filter Out Rows in Your CSV

You can use the Data Validation feature to limit the rows from your CSV that are imported based on the criteria you set. You might use this to import in segments that are handled differently or to exclude unwanted rows.

For example, if your CSV contains data from multiple countries but you want to import only records for Poland, add a validation rule that checks whether the Country field contains "Poland."

magical-import-validation-country-poland-646w.png

When you click Apply, the Preview will update to show which records will be excluded. Any rows that don't meet your validation criteria will display a warning icon.

magical-import-contacts-preview-poland-validation-applied-646w.png

Date Format Matching

When date values are detected in a CSV, Insycle determines the format being used and makes the values consistent during import. 

Insycle will recognize the following date formats, all of which will work with or without the - or / symbols:

  1. Date time with timezone: 2018-07-19T23:25:45.671-0400
  2. Date time in UTC timezone: 2018-07-19T10:15:30Z 
  3. YYYY-MM-DD HH:MM:SS
  4. Date (YYYY-MM-DD): 2018-07-19 or 2018/07/09
  5. Date (M-D-YYYY): 07-19-2018 or 7/19/2018

You can override this automatic standardizing under Data Mapping using the Date Format tab. This allows you to reformat dates before importing the data into your CRM.

magical-import-contacts-mapping-date-format.png

Learn more about reformatting dates before importing data into your CRM.

Associate HubSpot Companies or Contacts to Meetings on Import

If your team's calendars are integrated with HubSpot, you can import contacts or companies and associate them with meetings in HubSpot to help track engagement. Multiple contacts or companies (meeting attendees) can link to the same meeting.

Your CSV file must include the contact or company's Matching Criteria and the Meeting IDs from your calendar system. 

Suggested Matching Criteria

Options for companies Options for contacts
  • Domain
  • Account Name
  • Account ID
  • Email
  • Contact ID
  • First + Last Name

magic-import-hubspot-contacts-meeting-IDs-import-csv.png

Under Data Mapping, ensure the attendee identifier correctly points to the relevant HubSpot field. In this example, the Attendee email maps to the contact Email field. There's no need to map the Meeting ID field, as it will only be used for association purposes and not written to a field. 

magical-import-hubspot-contacts-mapping-meeting-ID-attendee.png

Next, under Data Operations on the Associate tab, configure the association to make using the following settings:

  • Action: Add
  • Associate: Contact to Meeting ID or Company to Meeting ID
  • Labels: Unlabeled
  • CSV Column: Meeting ID

magical-import-hubspot-contacts-operations-associate-meeting-ID.png

In HubSpot, you'll see the newly added contact or company associations on the meeting activity.

hubspot-contact-meeting-associations.png

  Note that there is no need to add Meetings as an object type to the account.

Using Activity Tracker to View Audit Trail and History

With the Activity Tracker, you have a complete audit trail and history of changes made through Insycle. At any time, you can download a CSV report that lets you see all of the changes that were made during an import operation.

Navigate to Operations > Activity Tracker, enter "import" to search for the Magic Import module, or look for a template name, then click the Run ID for the operation.

activity-tracker-hubspot-magical-import-run-id-w-arrow.png

If you've configured the Insycle Run ID property in your CRM, you can cross-reference these operations in your CRM records.

Viewing the Insycle Run ID Property in Your CRM

If you have set up the Insycle Run ID property in your CRM, every Insycle operation that updates or creates a record will update the Run ID in the record. This can be used to look up process reports in the Activity Tracker or to get help from support.

hubspot-contact-property-history-insycle-run-ID.png

When using an Insycle Recipe that includes templates for multiple object types, such as companies and contacts, the same Run ID will appear in both CRM records.

Learn how to set up the Insycle Run ID custom field for each object type in your CRM.

Additional Resources

Troubleshooting

Frequently Asked Questions

  • Check out the Magical Import FAQs for a complete list of questions about importing data into HubSpot using the Magical Import module.

Related Help Articles