Handle large datasets

<< Click to Display Table of Contents >>

Navigation:  How do I? >

Handle large datasets

Large datasets (e.g. a million data points or more) can slow down processing. So we recommend you add a sample transform straight after the input and set Rows to pass through only the first 100 or so rows. Once you have completed all your transforms you can then change the sample transform to pass through all rows.

 

Easy Data Transform exists in 32 bit and 64 bit versions for Windows. You can see which you have installed in the About window. The 32 bit version cannot address more than 4GB of memory. Which version of Easy Data Transform is installed depends on whether you have a 32 bit or 64 bit version of the Windows operating system. So, if you want to tackle really large datasets, you should use Easy Data Transform on a 64 bit versions of Windows.