I have scrolled through these pages but can't seem to find a solution. Here's hoping someone can help me out :)
I am using the below SSJS in an Automation to remove rows with IsDeleted = 'True' from a DE that has over 45 millions rows in total.
The scrip works successfully with my test DE which I have been able to get up to 24 million rows, but as soon as I run the same script, the same way on a DE with 25M rows or higher, the process does not complete as expected.
Basically, the deletion action is performed, and the IsDeleted = 'True' rows are deleted (and quite quickly, in about 2 minutes I can delete over 12M rows) but the automation seems to hang for a couple more minutes. The automation then is marked green as being successful, but a couple of minutes later the changes are reverted in the DE and the deletion process is undone.
Does anyone have an idea of how I can perform this same action on my live DE with 45M rows? Or an easy solution to remove the unwanted rows?
Thanks, Mitch
<script runat="server" >
Platform.Load("Core","1.1.1");
try
{
var DeleteIsDeleted = Variable.GetValue("@IsDeleted");
var DeletedResult = Platform.Function.DeleteData('LargeRowDeTest',['IsDeleted'],['1']);
}
catch (e)
{
Write("<br><br>Error: " + Stringify(e));
}
</script>