Apex Batch Job ignores Records

Question

I have created a stateful Apex Batch Job which is processing Permission Sets defined by a Set of Ids. I want to process each Permission Set individually so the batch size is 1.

The batch job creates the correct number of batches and completes successfully, however not all Permission Sets retrieved in the "start" method get processed.

By debugging and logging processed Ids I can see that a certain number of Permission Sets actually never enter the "execute" method. Instead some Permission Set records get processed twice.

here is my code:

public class AnalyzePermissionSets implements Database.Batchable<SObject>, Database.Stateful {

private Set<Id> setIds;

//set to debug processed Permission Sets
private Set<Id> processedSets;


// CONSTRUCTOR
public AnalyzePermissionSets(Set<Id> incomingIds) {
    this.setIds = incomingIds;

    this.processedSets = new Set<Id>();
}


// BATCHABLE METHODS
public Database.QueryLocator start(Database.BatchableContext BC) {
    return Database.getQueryLocator([SELECT Id, Name, NameSpacePrefix, (SELECT Id FROM ObjectPerms)
                                     FROM PermissionSet 
                                     WHERE Id IN :setIds]);
}


public void execute(Database.BatchableContext BC, List<PermissionSet> scope) {
    PermissionSet pSet = scope.get(0);

    // Within this method i am manipulating the ObjectPermissions,
    //FieldPermissions and SetupEntityAccessItems of the Permission Set
    process(pSet);

    // logging Id to see which Sets actually have been processed
    processedSets.add(pSet.Id);
}


public void finish(Database.BatchableContext BC) {
    System.debug(setIds.size());
    System.debug(processedSets.size());
}
}

An example:

1. created 1 Batch job with 8 Batches total
2. batch job completes sucessfully
3. setIds.size() = 8 and processedSets.size() = 4

I found a kind of similar question here: Batch apex failling silently for some records

But I tested this in a Sandbox and Developer Edition and both times almost the exact same number of Permission Sets did not get processed (difference was one set). The Permission Sets are mostly part of a external managed Package but also custom.

Any ideas how to solve this? Let me know if you need further information.

Answer 1

I figured out what was the issue:

PermissionSet Object seem not to work as expected in batch jobs. Using Permission Sets the scope given to the execute method would contain rather random Permission Sets:

ATTEMPT 1: Using Sub-Query in Query Locator

Database.getQueryLocator([SELECT Id, Name, NameSpacePrefix, (SELECT Id FROM ObjectPerms) FROM PermissionSet WHERE Id IN :setIds]);

The content in the Iterator of the QueryLocator Object was incorrect. Some Permission Sets were present two or more times in the iterator. The execute block processed all Permission Sets in the iterator but because of duplicates, Permission Sets got processed twice.

ATTEMPT 2: No Sub-Query

Database.getQueryLocator([SELECT Id, Name, NameSpacePrefix FROM PermissionSet WHERE Id IN :setIds]);

The content in the iterator was correct but in the execute block scope some Permission Sets got processed which were never part of the iterator.

In both cases the number of batches was always correct.

My Solution was to create a Custom Object which stores exactly one Permission Set Id and loop through a collection of those records instead of the Permission Set records, querying the Permission Set in each execute block.