purge CRM data

How to Identify Purgeable Data and Delete Records in Bulk

Clutter in your database is ballooning CRM costs, lowering email open rates, and harming your sender and brand reputation. It's also making it difficult for your team to filter, analyze, and utilize your CRM data.

With Insycle, there are several easy ways you can declutter your CRM and purge low-quality data in bulk:

  • The Health Assessment can identify invalid and missing data in your database and guide you to the module and template to use for cleanup.
  • The Bulk Operations module can surface junk records and then bulk delete them.
  • Use the Group & Update module to group field values and unearth low-value records and garbage data.

 

Identify Purgeable Data from the Health Assessment

Process Summary

  1. Review health issue categories for potential clutter.
  2. Analyze the problem records and follow the next steps to purge.

Step-by-Step Instructions

Review Health Issues to Find Low-Quality Data

Your best tool for quickly identifying low-quality and purgeable data is the Health Assessment.

In the left navigation, go to Dashboards > Health Assessment.

View the Summary of Data Health Issues that were found in your database. The Incomplete Data and Invalid Data issue categories are the most helpful for surfacing purgeable data. Click a Grouping name to see the issue types found. 

mceclip0.png

The Incomplete Data category tracks records that are missing critical field data. For instance, in some digital-first companies, a contact that does not have an email address may not be a contact worth keeping in the system. 

health-assessment-incomplete-data-trimmed.png

The Invalid Data category highlights issues like names with invalid characters, US zip codes with less than 5 digits, invalid phone numbers, or SPAM email addresses.

health-assessment-invalid-data-trimmed.png

Open Decluttering Solution and Delete Records

Click the Description link or Review button for an issue type to take the next step. Each type of issue might require a different solution, so when you click Review, Insycle will load the appropriate module and template for fixing the issue.

For example, under Invalid Data, click the Review button in the row, Invalid zip code (less than 5 digits)

health-assessment-invalid-data-trimmed.png

The Grid Edit module will open with the Invalid zip code template loaded, showing the 6 results that were identified in the Health Assessment. 

From here, you can follow the Grid Edit steps to correct or purge the invalid data.

Grid Edit module with Invalid zip code template loaded

Learn more about what the Health Assessment can do.

Troubleshooting: Why don't I see changes from today reflected here?

The Health Assessment reflects data from Insycle's overnight sync, it's not up-to-the-minute data. The date in the first heading bar indicates when it was captured.

mceclip0.png

If you're looking for reports reflecting changes made to your CRM today, you can click the Recalculate button to temporarily update the data. When you leave the Health Assessment page the reports will revert to the previous night’s snapshot.

To temporarily update all of the Health Assessment reports, click the Recalculate button in the first heading bar.

Health Assessment refresh button

Or, to temporarily update today’s data for a single issue, use the Recalculate button at the right end of an issue row.

Invalid Data Issues

 

Purge Low-Quality Records with the Bulk Operations Module

  1. Apply filter to view purgeable records.
  2. Preview the records that will be deleted.
  3. Make the deletions in the CRM.

Step-by-Step Instructions

Step 1: Surface Low-Quality Records

To purge records from your database, go to the Bulk Operations module, then select the database and record type from the top menu. Then explore the templates for an existing solution that may be close to what you need.

When you're looking to clean up specific values, use the filter to work only with an appropriate subset of your data. You can filter your data using any field in your database.

In this example, we'll walk through deleting contact records that do not have an email listed.

In Step 1, set up a Filter to identify Contact records that do NOT have an Email address. 

Bulk Operations Step 1

Click Search to see the records that match these criteria at the bottom of the page in the Record Viewer. If you make changes to the filter, click the Search button again to reload the Viewer.

Record Viewer

Step 2: Choose Records to Delete

Under Step 2, select the Delete tab.

Bulk Operations Step 2 Delete

There are no further configurations or settings for the Delete tab. You already filtered the records you want to delete in Step 1. When run on your database, this will delete all records that match your filter and appear in the Record Viewer.

To select individual records to delete from the database, in the Record Viewer click the checkbox for a record row.

Select individual records

Step 3: Preview then Delete Records from Your CRM

Preview Changes in a CSV Report

With the filters and delete option set, you should review the deletions that will be made to verify only the expected records will be purged before making the change to your live database.

Under Step 3, click the Review button. Then, in the Bulk Delete popup, select Preview and click Next.

Bulk Delete Preview mode

On the Notify tab, add any additional recipients who should receive the CSV (and make sure to hit Enter after each address). You can add colleagues and additional context here.

On the When tab, click Run Now and select which records to apply the change to (in most cases this will be All), then click the Run Now button.

Bulk Delete Run Now tab

Open the CSV file from your email in a spreadsheet application and review the list of records that will be deleted. If any records are appearing that you didn't expect and don't want to delete, return to Step 1 and make adjustments to the Filter, then Preview again.

Preview Delete CSV

Apply Changes to Your CRM

If everything in your CSV preview looks correct, return to Insycle and move forward with purging the CRM records.

Under Step 3, click the Review button, and this time, select Update mode.

On the When tab, you should use Run Now the first time you apply these changes to the CRM.

Once you confirm the change, the update will be applied to your CRM. The Bulk Delete Result popup will list all of the deleted records.

Bulk Delete Result

Save Template and Set Up Automation

After you've seen the results in the CRM and are satisfied with how the operation runs, you can save all of the configurations as a template. This will save you time and provide consistent results in the future.

Then, you can set up automation so this delete operation runs on a set schedule. 

Bulk Delete Automate tab

Pro Tip: Create a Backup Export of Your Data Before Deleting

When you use the Bulk Operations delete action, the entire record is permanently removed from your CRM. If there's any chance you'll need to refer to this data or restore it later, you may want to export a Preview report that could act as a backup.

The CSV only includes fields that are visible in the Record Viewer. Use the Layout tab under Step 1 to add more fields and preserve all the data that might be needed.

Step 1 Layout

If you are doing a large data cleanup effort and deleting a large volume of records, best practice is to do a data export directly from the CRM. This will be more comprehensive than what the Insycle report provides.

 

Purge Low-Quality Records with the Group & Update Module 

Process Summary

  1. Select a field that you would like to analyze.
  2. Review the results in the Record Viewer.
  3. Add an additional field to create sub-groups.

Step-by-Step Instructions

Select the Field to Analyze

In the Group & Update module, select the database and record type. Then explore the templates for an existing solution that may be close to what you need.

Under Step 1, select the Field you want to group by and analyze. In this example, we've chosen the Free Email Provider Domain field. This is a unique Insycle field that looks at the Email field values for free email addresses such as Gmail, Hotmail, Yahoo, etc. This helps surface less valuable contact records.

Group & Update Step 1 select field

Click the Analyze button, and a preview of the value groups that match this criterion will load in the Record Viewer at the bottom of the page.

The Record Viewer lists the unique values contained in the field with a count of how many times each value is found. Here, the Free Email Provider Domain field has found 4 contacts using a free email provider (shown as True). 

Record Viewer results

Click the checkbox by a value to expand the group. This opens up a secondary Viewer below the first, where you can review the individual records.

Secondary viewer

Select Records and Delete

Decide if you want to delete all of the records in the group, or individual ones. To delete all, click the checkbox next to the group in the main Record Viewer (in this example, the True group).

To delete only specific records, click the checkboxes in the secondary viewer.

Individually selected records

Under Step 2, click the Delete tab.  Make sure the number on the Delete X Contacts button matches the number you want to remove. There is no preview for this step. 

When ready, click the Delete X Contacts button, then confirm the deletion in the popup.

⚠️ Note that there is no preview step here. Once confirmed, the records will be deleted from your CRM.

Group & Update Step 2 Delete

When completed, the affected records will be shown in the Bulk Update Result popup.

Results popup

You can download the CSV report from the Activity Tracker.

Pro Tip: Add Extra Fields to the Layout as a Backup

When you use the Group & Update delete action, the entire record is permanently removed from your CRM. If there's any chance you'll need to refer to this data or restore it later, you may want to add additional fields that could act as a backup. The CSV report can be downloaded any time from the Activity Tracker

The CSV only includes fields that are visible in the Record Viewer, so use the Layout tab under Step 1 to add more fields and preserve all the data that might be needed.

Step 1 Layout

If you are doing a large data cleanup effort and deleting a large volume of records, best practice is to do a data export directly from the CRM. This will be more comprehensive than what the Insycle report provides.

Tips for Purging Data

This same process can be used to purge records that meet (or don't meet) various criteria, such as:

  • Contacts with undelivered emails
  • Invalid form inputs
  • Clearly fake data
  • Low-quality data (such as business contacts using free email providers)
  • Outdated and decayed records (last update before a certain point)
  • Incomplete records

Frequently Asked Questions

Is the old data from the field deleted when I run the bulk update?

Yes, the pre-existing data in the record will be deleted by the bulk operation. If you need this data for reference or restoration, it will be available in the CSV in the Activity Tracker.

Can I restore deleted data?

Yes, but not directly. Not all fields for every deleted record will be available, just those included in the Layout settings. See the Pro Tip: Add Extra Fields to the Layout as a Backup above for details.

You can access the deleted data in the Activity Tracker and re-import the partial records if needed. 

How can I identify bad data to purge?

The Health Assessment tracks many types of invalid and low-quality data that make great candidates for purgeable data.

Additional Resources

Related Help Articles

Related Blog Posts