Handle large datasets

<< Click to Display Table of Contents >>

Navigation:  How do I? >

Handle large datasets

Large datasets (e.g. a million data points or more) can slow down processing. If slow processing is a problem you can:

Add a sample transform straight after the input and set Rows to pass through only the first 100 or so rows. Once you have completed all your transforms you can then Disable sampling to pass through all rows.

Set Right pane processing delay in the Preferences window to a longer time (say 5 seconds) to ensure that that changes aren't processed until you have finished making the changes.

Set Write mode to Disabled in output files, until you are ready to write them.