I am using free Jitterbit to load files (.csv) from SFTP into Salesforce (custom object). In FTP, xls files are fed and is converted into .csv file (via php) and that csv file is inserted into Salesforce. During this process, duplicate records are being inserted. For example, if that xls file has got 100 records, then number of records being inserted into Salesforce are 200.

I did manual testing, wherein, I took the xls fiel and converted it into csv file and kept in FTP. Apparently, there are no duplicates found.

Would like to know what could be happening during this process.

closed as off-topic by Matt Lacey Jan 11 '15 at 6:30

  • This question does not appear to be about Salesforce within the scope defined in the help center.
If this question can be reworded to fit the rules in the help center, please edit the question.

  • Responding to a flag from the community. This question appears to be off-topic because it is about a very specific scenario, and the chances of someone searching the web, finding this question and then finding the answer helpful are slim to none! – Matt Lacey Jan 11 '15 at 6:30

Make sure you set the maximum number of threads to 1.

Document Link: http://www.jitterbit.com/Docs/WebHelp/Operations/Operation_Options.htm

  • Thanks Eric for the reply. I figured out the problem which was scheduling running every 15 mins and because I have multiple triggers running and for which I set the chunk size as 1. Since the file size is large and chunk size is 1, loading is exceeding 15 minutes and when the job is running again, it is finding the same file in the FTP. Hence, duplicates are being inserted. – Sapthagiri Jan 10 '15 at 15:01

Not the answer you're looking for? Browse other questions tagged or ask your own question.