9

After a Data Export has completed there can be a large number of zip files to download.

If there are 80+ files at 130 MB (In Summer 12 the limit has been increased to 512 MB) each and each file takes several minutes to download it can be a time consuming process to do manually.

Is there a way to automate the retrieval of these zip files?

10

One approach is to use the SOAP API to automatically establish a session using securely stored credentials. Once the session is established you can use the Session ID and Server URL to send a web request to the page that contains the Data Export, parse out the download links, and then pull the zip files down and store them locally. Depending on the duration of the transfer you may need to recover from a lost session.

The usual caveat applies to this approach as some of the steps aren't using the provided APIs. Salesforce may at their whim break the ability to extract the zip paths.


Based on the above solution we have made a free tool using .NET here at work that can automatically download the Data Export from the command line and/or the included GUI app.

This can be useful when the number of zips to retrieve grows large or you want to automate the download process.

See FuseIT SFDC Data Export.


You might also like to vote for the idea: Weekly Data Export - Ability to automate file transfer via web service

  • should an answer to your question not primarly be more on how to technically do it ? (what api/processes to use) Part of your answer could be to mention existing tools/apps, but if an answer is limited to that, I would usually downvote it. – Samuel De Rycke Aug 10 '12 at 10:05
  • A fair point. I'll expand the answer with how it works. I'm vaguely aware of other possible solutions to this problem too and would be interested to see what others come up with. – Daniel Ballinger Aug 10 '12 at 10:13
3

I used a Firefox plug-in called DownThemAll: https://addons.mozilla.org/en-US/firefox/addon/downthemall/ It isn't quite as elegant, but it works.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.