How to verify data

Easy Data Transform has powerful features for verifying datasets in various formats, including Excel, CSV, JSON and XML. It can easily handle datasets with millions of rows and thousands of columns.

Drag the data file you wish to verify, onto Easy Data Transform. An input item will be added.

With the input item selected, scroll to the bottom of the transforms and click the Verify transform button.

A Verify transform should appear.

If the Verify transform button is not shown, check Show advanced in the left pane.

In the right pane, check the data verification rules you want to use for the dataset:

You can also check verification rules you want to use for each column. Click the expand arrow for each column, to show the rule items.

The following data verification rules are available:

• At least 1 non-empty
• Contains
• Don’t allow listed values
• Ends with
• Integer except listed
• Is local file
• Is local folder
• Is lower case
• Is sentence case
• Is title case
• Is upper case
• Is valid EAN13
• Is valid email
• Is valid telephone number
• Is valid UPC-A
• Match column name
• Matches regex
• Maximum characters
• Maximum number of cols
• Maximum number of rows
• Maximum value
• Minimum characters
• Minimum number of cols
• Minimum number of rows
• Minimum value
• No blank values
• No Carriage Returns
• No currency
• No digits
• No double spaces
• No duplicate col names
• No duplicate values
• No empty rows
• No empty values
• No gaps in values
• No leading/trailing whitespace
• No Line Feeds
• No non-ASCII
• No non-printable
• No punctuation
• No symbols
• No Tab characters
• No whitespace
• Numeric except listed
• Only allow listed values
• Require listed values
• Starts with
• Valid date in format

The verification rules available for each column depend on the column type:

You can set the severity of each fail to Information, Warning or Error:

Verification fails are shown color-coded in the data table. Hover over a column header or cell for more details:

A summary of all the verification rules and whether they passed or failed is output to the Info tab.

A summary of failed verification rules with Severity level Warning or Error is output to the Warnings tab.

You can filter the data to keep or remove rows by verification fail severity.

If you want to verify the relationship between 2 columns (e.g. the value in column A is always greater than the value in column B for the same row) use a transform, such as Compare Cols or If to create a new column with the result, and then use Verify on the new column.

See the video above for more details.

As well as data verification, Easy Data Transform can help with cleaning, filtering, blending and analysing your data. All without coding. Download the free trial in a few clicks and try it yourself.