Java heap space error at tUniqRow in Talend
- To Optimise this component ,Try to get the unique records by using min number columns in uniq condition.
- var-char(max) ,text data type columns in unique condition will decrease the performance of the component If you are using tuniqrow component with huge data we may get java heap space Exception.
(By storing the data on disk while getting unique record from huge data)
Below are the steps to resolve the issue.
- Click on tunique
- Go to component window
- Select you unique condition columns
- Go to Advanced Settings
- Click on Use of Disk Option
- Then select Directory For temp files. (This Directory Structure must be already available in the System. If it is not available the it wouldn't create any directory. This will give you Error )
- Then Execute the jobBut this will be slow with compared to the speed of the job with out Use of Disk Option for small amount of data.
Great Wiki by Raja..! Keep it Up..!
ReplyDelete