Excel users frequently want to remove rows that have duplicate values. For example to remove the rows with duplicate emails in:
This is very easy to do in Easy Data Transform:
A blue transform item is added and selected.
In the Right pane set what you want to do with each column. You should set at least 1 column to Keep unique.
The transformation is carried out as you don’t modify anything for a few seconds. No need to ‘run’ anything.
Note that duplicate checking is sensitive to case and whitespace. You can use Case and Whitespace transforms before the Unique to modify case and whitespace, e.g. to set all the emails to lower case. You can also use the Sort transform to change the row order before the Unique.
The Unique transform is very powerful. For example, you can do the following:
For more information on Unique options see the Unique documentation.
Note that there is also a Dedupe transform that is simpler, but less powerful, than the Unique transform.
When you are happy with the results you can output the transformed data to a new file in a range of file formats. Ensuring that the blue transform item is selected, click the To File button at the bottom of the Left pane to create a new output file (you might have to scroll down to see the button).
If you need to remove duplicates from lots of Excel sheets, you can do it in a single operation using the batch processing feature.
Easy Data Transform allows you to combine 65 different transforms to quickly and easily manipulate your data. You can also use it to show duplicates in Excel. Easy Data Transform can process millions of rows and input and output in multiple formats.
v1.45.0 for Windows 11 / 10 / 8 / 7 (47 MB)
v1.45.0 for Mac 14.x to 10.13 (79 MB)
Questions or problems?