1

I am using Data Extract -> File Transfer -> Import via an automation to upload my synchronized data extensions to All Subscribers in Marketing Cloud.

Currently everything seems to work fine, however I am interested to know is there any limitations such as row count, data size, etc via importing from enhanced FTP?

4

File Imports are the most tried and true method of getting large amounts of data into SMFC. As for limitations -- most of the issues I've seen with imports haven't been with size or row counts -- it's been with bad data, like extra CR/LFs, bad delimiters or improper text qualification. Importing structured data like XML is possible, but not recommended. The functionality is too limited.

As for file size, I've worked in some accounts that import 3 gigabyte files every day.

If you're having issues with File Imports and you have an older account (more than 3 years old), check with SFMC Support to see if you have the latest version of the importer.

There are also several business rules that modify file import behavior -- like importing empty files without error, etc.

There are also several options for handling encrypted files, the Safehouse, and file-drop triggered automations.

| improve this answer | |
  • Hey thanks for the detailed explanation! So far I have not faced any issues with import and I am glad to know that they are able to import huge file sizes up to GB. Thanks a lot! :D – Valarie Simmons Nov 22 '17 at 16:00
  • @Adam , do you know remember how much time does it take to load the 3GB file into a DE ? – AshBringer Feb 12 '19 at 11:11
  • It depends on the file, but off the cuff I'd say around 1-2 hours. – Adam Spriggs Feb 12 '19 at 12:57
  • Hi @AdamSpriggs How is that possible if there is a timeout limitation of 30 minutes? – Mrquestion Jul 2 at 14:17
  • The 30-minute timeout period only applies to Query and Script Activities. – Adam Spriggs Jul 2 at 15:17

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.