Requirement - To fetch data in 5 objects in Salesforce from a DB through CSV approach. Data will be stored in remote folder/ http.

Data size - 2000 records per table.

What would be the possible approaches for doing that ? 1.Batch job? 2.Cron job 3.Manual

Any other considerations which needs to be made?


You can use a cron job to call the Salesforce Data Loader from the command line and load the data from the files. Each object will require a separate job as the Data Loader only supports a single object being loaded at a time, this also means that the sequence of the jobs needs to take into account any dependencies in the data between the objects.

The data that you want to load would need to be stored in a folder that is accessible by the user that is used to run the Salesforce data loader.

Data Loader command line interface

Data Loader guide

It is good practice to have a separate user account used for this with just the permissions needed for the objects in integration not a System Administrator account as that would be able to modify user permissions.

Alternatively Data Loader can be used manually by a user with permissions on the objects (if this includes custom objects then they are likely to need Modify All Data and API permissions)

  • Can you please elaborate on the folder where the data needs to be stored intermediately? – SFDCRookie May 11 '16 at 12:43
  • It would only need to be a standard folder in the file system that you are using that the user running the Data Loader has read permissions on. – Dave Humm May 11 '16 at 19:07
  • @David - You mean Notes & Attachment in Salesforce? – SFDCRookie May 19 '16 at 7:44
  • No I meant where the data was held before loading to Salesforce. Can you just clarify is the data going out from Salesforce or coming in from the external database? – Dave Humm May 19 '16 at 7:51
  • @Data will be placed in a server instance of AWS . Will mentioning the url as data source suffice ? or do I need to put extra validations? regarding LOGIN – SFDCRookie May 20 '16 at 7:21

I think this can be possible via Data Loader with Bulk Data Load Job.

  • I assume you are saying writing a GET/POST jobs and run Dataloader from Command line? Where will the intermediate data be stored? – SFDCRookie May 11 '16 at 7:38

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.