Dedupe

<< Click to Display Table of Contents >>

Navigation:  Reference > Transforms >

Dedupe

Description

Remove duplicate rows.

 

Inputs

1.

 

Options

Check the column(s) you wish to look for duplicate values in.

 

Notes

Rows are considered duplicates if they have exactly the same value in all the columns selected.

Comparisons are case and whitespace sensitive. You can use Case to change the case and Trim to remove whitespace before deduping.

When several rows are duplicates, only the top one is retained.

 

Example

If you are cleaning up a mailing list, you might want to dedupe on the 'email' column, after converting all the emails to lower case.