if the source is database means we can delete the duplicate records by enabling the option select distinct in source qualifier t/r properties or by writing the following query in source qualifier filter
delete from emp where rowid not in (select min(rowid) from emp group by empno);
if the source is flat file means by enabling the option distinct in sorter t/r we can delete the duplicate records