Remove records

In this article, you will learn how to remove records (also referred to as data parts) that were created from a specific data source. For more information about records, data parts, and golden records, see Data life cycle.

If you no longer need specific records, you can easily remove them. If a record is not merged during processing, it becomes a golden record. Removing such a record also removes the golden record. However, if a record is merged into the golden record, removing it doesn’t remove the entire golden record; only the specific part represented by that record is removed. Keep in mind that when you remove records from CluedIn, the count of billable records will decrease when it is recalculated.

After removing records, you’ll notice that the Data tab disappears from the data set. Additionally, the Process tab won’t contain any information about previous processing. However, the incoming records on the Preview tab remain intact; and the mapping configuration on the Map tab is preserved, so you can edit, reset, or reuse it for other data sets.

Removing records can be useful in the following cases:

  • If you notice an error in the mapping configuration. Although the mapping configuration is preserved after removing records, you can reset the mapping and start again.

  • If you processed a subset of data to test the mapping configuration and you don’t need the test data anymore. Since the mapping configuration is preserved, you can reuse it for other data sets.

Prerequisites

Go to Administration > Feature Flags, and then enable the Remove Golden Records feature.

remove-golden-records-1.png

To remove records

  1. On the navigation pane, go to Integrations > Data Sources.

  2. Find and open the data source that contains records that you want to remove.

  3. Near the upper-right corner of the data source details page, select Remove records.

    The Remove processed records dialog opens where you can view the number of records that will be removed as well as the data set containing those records.

  4. Confirm that you want to remove records by entering REMOVE. Then, select Remove records.

    remove-golden-records-2.gif

The process of removing records might take some time. After records are removed, you can make changes in the data set (edit mapping, add or remove property or pre-process rules) or process the data set again.