I work for an organization with a very decentralized model, and we have 25-30 departments/teams sending out of SFMC. Each of these teams has their own set of filtered DEs (probably 30-50 per team), which they are supposed to refresh before sending, but frequently fail to do, causing no end of consternation when customers start complaining about, e.g., receiving e-mails from which they have already unsubscribed.
Our data is pulled in from SF CRM nightly, and a series of SQL automations update our core data model; the filtered DEs are built off of this data.
Because of the above, our CIO has made it our (read: my) highest priority to get all of the filtered DEs refreshing automatically every night. My research shows that there are two ways to do this:
- Create data filters for each of the filtered DEs, and then create automations, etc. which run nightly and refresh the data. The obvious problem here is that there are hundreds of DEs for which this will need to be done, and future maintenance will be needed every time a new DE is added.
- Use the undocumented endpoint (POST /email/v1/filteredCustomObjects/{{myObjectID}}/refresh) and write a script that iterates through the directory tree containing all the DEs and refreshes them.
Does anyone have any particular experience that would be useful to do this? Anything I should be considering for one (or both) options? Any other solutions? Any reason that one, or both, solutions might not work? My boss indicated that I can, for the purpose of this question, ignore the inherent risk of using an undocumented endpoint.
Thanks in advance!