COUNT only returning a subset of a large population during full recalc.

[cdevelin]

Hi James,

I am doing some volume testing on parent records with large volumes of children, e.g. I have a batch of records with 10,000 children. When performing a full recalc, it is recalculated as 501. I presume this is somehow related to the Rollup Control "Batch Chunk Size" of 500.

The rollup is configured as follows:

The rollup control is configured as follows:

(I tried Batchable vs Queueable and it made no difference).

If I change the status of one of the children so it does not meet the 'where' clause, the total does recalculate from 501 to 9999, and when I change it back to meet the 'where' clause again, the total count is correctly reported as 10,000.

However, the reason I'm investigating this issue is because when bulk loading the children, the resulting total count is unreliable, sometimes less, sometimes more, and it doesn't work on Full Recalc. Very strange.

[jamessimone]

How many parents, total, do you have? There is a stateful calculation that relies on the "Max Lookup Rows Before Batching" to kick in - that's something that I intend to deprecate, however, since (as you're seeing) stateful full recalcs are needed sometimes even when the total number of parent records is lower than that.

[jamessimone]

That's odd. The state tracking - and its extensibility into the millions of records - was the reason for the minor version bump to 1.7. I'd have to take a look at logs and learn a bit more about your setup, most likely, to see what's going on.

One thing it would be great to verify - you should see Rollup State (RollupState__c) records getting inserted as a full recalc processes, yes?

[cdevelin]

Yes - I do see Rollup State records being inserted. However, I suspect the version of APEX rollup deployed to this org is not the most recent, I'll get it updated and re-test.

[cdevelin]

I can create a login for this org for you if you'd like to see it happening in real time.

[jamessimone]

That would be great!

[cdevelin]

You should receive a login invitation, plus I've sent you an email with links to the relevant test parent and explanations.