Failed test found in: IntegrationTests_3-artifacts/internal/venice-test-common/build/test-results/integrationTests_3/TEST-com.linkedin.venice.consumer.StatefulVeniceChangelogConsumerTest.xml internal/venice-test-common/build/test-results/integrationTests_3/TEST-com.linkedin.venice.consumer.StatefulVeniceChangelogConsumerTest.xml Error: org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.consumer.StatefulVeniceChangelogConsumerTest.testVeniceChangelogConsumerDaVinciRecordTransformerImpl() didn't finish within the time-out 240000

java.lang.AssertionError: Class KafkaKey has a memoryAllocatedPerInstance (81.94108) which is too far from the predictedUsage (40); delta: 1.049; maxAllowedDelta: 0.012. No more attempts left.

java.lang.AssertionError: Class KafkaKey has a memoryAllocatedPerInstance (81.94108) which is too far from the predictedUsage (40); delta: 1.049; maxAllowedDelta: 0.012. No more attempts left.

Failed test found in: IntegrationTests_2-artifacts/internal/venice-test-common/build/test-results/integrationTests_2/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml internal/venice-test-common/build/test-results/integrationTests_2/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml Error: java.lang.AssertionError: expected [400] but found [390]

Failed test found in: IntegrationTests_2-artifacts/internal/venice-test-common/build/test-results/integrationTests_2/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml internal/venice-test-common/build/test-results/integrationTests_2/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml Error: java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36743, route = /new_store, params = [owner=test_owner, key_schema={"type" : "string"}, cluster_name=venice-cluster0, hostname=localhost, store_name=rmdChunking_10d46e53418_375e3aad, value_schema={"type":"record","name":"SampleRecord","fields":[{"name":"name","type":"string","default":"default_name"},{"name":"floatArray","type":{"type":"array","items":"float"},"default":[]},{"name":"stringMap","type":{"type":"map","values":"string"},"default":{}}]}], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 404 - Store: venice_system_store_davinci_push_status_store_rmdChunking_10d46e53418_375e3aad does not exist. expected [false] but found [true]

Failed test found in: IntegrationTests_8-artifacts/internal/venice-test-common/build/test-results/integrationTests_8/TEST-com.linkedin.venice.consumer.TestChangelogConsumer.xml internal/venice-test-common/build/test-results/integrationTests_8/TEST-com.linkedin.venice.consumer.TestChangelogConsumer.xml Error: java.lang.AssertionError: expected [3] but found [2]

Failed test found in: IntegrationTests_5-artifacts/internal/venice-test-common/build/test-results/integrationTests_5/TEST-com.linkedin.venice.endToEnd.DaVinciClientRecordTransformerTest.xml internal/venice-test-common/build/test-results/integrationTests_5/TEST-com.linkedin.venice.endToEnd.DaVinciClientRecordTransformerTest.xml Error: org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.DaVinciClientRecordTransformerTest.testRecordTransformerDaVinciWithSeeking() didn't finish within the time-out 120000

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x32, (byte) 0x62, (byte) 0x62, (byte) 0x37, (byte) 0x30, (byte) 0x39, (byte) 0x32, (byte) 0x37, (byte) 0x36, (byte) 0x5F, (byte) 0x34, (byte) 0x37, (byte) 0x38, (byte) 0x32, (byte) 0x37, (byte) 0x61, (byte) 0x38, (byte) 0x36], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x32, (byte) 0x64, (byte) 0x31, (byte) 0x62, (byte) 0x66, (byte) 0x63, (byte) 0x32, (byte) 0x36, (byte) 0x62, (byte) 0x5F, (byte) 0x36, (byte) 0x33, (byte) 0x38, (byte) 0x34, (byte) 0x33, (byte) 0x33, (byte) 0x34, (byte) 0x30], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 222 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_475a85919a_18282dd3_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_475a85919a_18282dd3_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_475a85919a_18282dd3_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321206748}, Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_475a85919a_18282dd3_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321206748} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_475a85919a_18282dd3_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x32, (byte) 0x62, (byte) 0x62, (byte) 0x37, (byte) 0x30, (byte) 0x39, (byte) 0x32, (byte) 0x37, (byte) 0x36, (byte) 0x5F, (byte) 0x34, (byte) 0x37, (byte) 0x38, (byte) 0x32, (byte) 0x37, (byte) 0x61, (byte) 0x38, (byte) 0x36], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x32, (byte) 0x64, (byte) 0x31, (byte) 0x62, (byte) 0x66, (byte) 0x63, (byte) 0x32, (byte) 0x36, (byte) 0x62, (byte) 0x5F, (byte) 0x36, (byte) 0x33, (byte) 0x38, (byte) 0x34, (byte) 0x33, (byte) 0x33, (byte) 0x34, (byte) 0x30], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 222 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_475a85919a_18282dd3_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_475a85919a_18282dd3_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_475a85919a_18282dd3_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321206748}, Mock for Store, hashCode: 1480514413 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_475a85919a_18282dd3_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321206748} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_475a85919a_18282dd3_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

Failed test found in: IntegrationTests_20-artifacts/internal/venice-test-common/build/test-results/integrationTests_20/TEST-com.linkedin.venice.router.TestReadForApacheAsyncClient.xml internal/venice-test-common/build/test-results/integrationTests_20/TEST-com.linkedin.venice.router.TestReadForApacheAsyncClient.xml Error: java.util.concurrent.ExecutionException: com.linkedin.venice.client.exceptions.VeniceClientHttpException: http status: 502, StreamResponse[headers={content-length=110, content-type=text/plain, x-venice-compression-strategy=0, x-venice-rcu=1, x-venice-schema-id=-1},cookies=[],status=502]

com.linkedin.venice.exceptions.VeniceNoStoreException: Store: test-store-authorizer does not exist in cluster test-cluster

com.linkedin.venice.exceptions.VeniceNoStoreException: Store: test-store-authorizer does not exist in cluster test-cluster

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 296 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_38ee33b862_23fc770e_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_38ee33b862_23fc770e_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_38ee33b862_23fc770e_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321377862}, Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_38ee33b862_23fc770e_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321377862} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_38ee33b862_23fc770e_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestPr

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 256 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_50fed718f6_3bd25114_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_50fed718f6_3bd25114_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_50fed718f6_3bd25114_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321481260}, Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_50fed718f6_3bd25114_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321481260} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_50fed718f6_3bd25114_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestProce

org.mockito.exceptions.verification.TooFewActualInvocations: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); Wanted 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) But was 0 times.

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 296 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4578da929e_a1b2e97d_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4578da929e_a1b2e97d_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4578da929e_a1b2e97d_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321431732}, Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4578da929e_a1b2e97d_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321431732} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_4578da929e_a1b2e97d_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestPr

java.lang.AssertionError: expected [NaN] but found [0.0]

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 296 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4358e7c9c6_2b2bcbd6_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4358e7c9c6_2b2bcbd6_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 754959893 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 754959893 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4358e7c9c6_2b2bcbd6_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321422619}, Mock for Store, hashCode: 754959893 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4358e7c9c6_2b2bcbd6_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321422619} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_4358e7c9c6_2b2bcbd6_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestProce

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 296 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_38ee33b862_23fc770e_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_38ee33b862_23fc770e_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_38ee33b862_23fc770e_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321377862}, Mock for Store, hashCode: 1256184135 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_38ee33b862_23fc770e_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321377862} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_38ee33b862_23fc770e_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestPr

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 256 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_50fed718f6_3bd25114_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_50fed718f6_3bd25114_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_50fed718f6_3bd25114_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321481260}, Mock for Store, hashCode: 624790438 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_50fed718f6_3bd25114_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321481260} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_50fed718f6_3bd25114_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestProce

org.mockito.exceptions.verification.TooFewActualInvocations: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); Wanted 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) But was 0 times.

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 296 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4578da929e_a1b2e97d_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_4578da929e_a1b2e97d_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4578da929e_a1b2e97d_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321431732}, Mock for Store, hashCode: 1046892947 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_4578da929e_a1b2e97d_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321431732} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_4578da929e_a1b2e97d_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, latestPr

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x38, (byte) 0x33, (byte) 0x35, (byte) 0x38, (byte) 0x31, (byte) 0x66, (byte) 0x39, (byte) 0x34, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x34, (byte) 0x66, (byte) 0x36, (byte) 0x30, (byte) 0x32, (byte) 0x34, (byte) 0x65], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 182 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_61299c1e1b_1f88317a_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_61299c1e1b_1f88317a_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_61299c1e1b_1f88317a_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321535690}, Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_61299c1e1b_1f88317a_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321535690} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_61299c1e1b_1f88317a_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, late

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 252 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_5789a626e4_dd581f76_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_5789a626e4_dd581f76_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_5789a626e4_dd581f76_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321494316}, Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_5789a626e4_dd581f76_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321494316} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_5789a626e4_dd581f76_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}

org.mockito.exceptions.verification.TooFewActualInvocations: abstractStorageEngine.put( 1, [(byte) 0x01, (byte) 0x4B, (byte) 0x65, (byte) 0x79, (byte) 0x46, (byte) 0x6F, (byte) 0x72, (byte) 0x50, (byte) 0x61, (byte) 0x72, (byte) 0x74, (byte) 0x69, (byte) 0x74, (byte) 0x69, (byte) 0x6F, (byte) 0x6E, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x38, (byte) 0x33, (byte) 0x35, (byte) 0x38, (byte) 0x31, (byte) 0x66, (byte) 0x39, (byte) 0x34, (byte) 0x31, (byte) 0x5F, (byte) 0x32, (byte) 0x34, (byte) 0x66, (byte) 0x36, (byte) 0x30, (byte) 0x32, (byte) 0x34, (byte) 0x65], java.nio.HeapByteBuffer[pos=0 lim=17 cap=17] ); Wanted 2 times: -> at com.linkedin.davinci.store.AbstractStorageEngine.put(AbstractStorageEngine.java:478) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.DeepCopyStorageEngine.put(DeepCopyStorageEngine.java:39)

org.mockito.exceptions.verification.TooFewActualInvocations: hostLevelIngestionStats.recordTotalBytesConsumed( <any long> ); Wanted 2 times: -> at com.linkedin.davinci.stats.HostLevelIngestionStats.recordTotalBytesConsumed(HostLevelIngestionStats.java:523) But was 1 time: -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerRecord(StoreIngestionTask.java:2781)

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 182 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_61299c1e1b_1f88317a_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_61299c1e1b_1f88317a_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_61299c1e1b_1f88317a_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321535690}, Mock for Store, hashCode: 20224034 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_61299c1e1b_1f88317a_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321535690} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_61299c1e1b_1f88317a_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}, late

Wanted but not invoked: leaderFollowerStoreIngestionTask.reportIngestionNotifier( <any com.linkedin.davinci.kafka.consumer.PartitionConsumptionState>, <any com.linkedin.venice.exceptions.VeniceException> ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.reportIngestionNotifier(StoreIngestionTask.java:1612) However, there were exactly 252 interactions with this mock: leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_5789a626e4_dd581f76_v1-1, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTaskTest.runTest(StoreIngestionTaskTest.java:991) leaderFollowerStoreIngestionTask.subscribePartition( TestTopic_5789a626e4_dd581f76_v1-1, true, Optional.empty ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:755) leaderFollowerStoreIngestionTask.throwIfNotRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:802) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.throwIfNotRunning(StoreIngestionTask.java:712) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.nextSeqNum(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.subscribePartition(StoreIngestionTask.java:808) leaderFollowerStoreIngestionTask.run(); -> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) leaderFollowerStoreIngestionTask.isRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1778) leaderFollowerStoreIngestionTask.getIsRunning(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.isRunning(StoreIngestionTask.java:4528) leaderFollowerStoreIngestionTask.refreshIngestionContextIfChanged( Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1781) leaderFollowerStoreIngestionTask.maybeProcessResubscribeRequest(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1782) leaderFollowerStoreIngestionTask.getServerConfig(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5204) leaderFollowerStoreIngestionTask.getResubscribeRequestQueue(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.maybeProcessResubscribeRequest(StoreIngestionTask.java:5205) leaderFollowerStoreIngestionTask.processConsumerActions( Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.run(StoreIngestionTask.java:1783) leaderFollowerStoreIngestionTask.processConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_5789a626e4_dd581f76_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321494316}, Mock for Store, hashCode: 1973010528 ); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processConsumerActions(StoreIngestionTask.java:2122) leaderFollowerStoreIngestionTask.processCommonConsumerAction( KafkaTaskMessage{type=SUBSCRIBE, topicPartition=TestTopic_5789a626e4_dd581f76_v1-1, attempts=1, sequenceNumber=1, createdTimestampInMs=1770321494316} ); -> at com.linkedin.davinci.kafka.consumer.LeaderFollowerStoreIngestionTask.processConsumerAction(LeaderFollowerStoreIngestionTask.java:598) leaderFollowerStoreIngestionTask.getDataIntegrityValidator(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.processCommonConsumerAction(StoreIngestionTask.java:2312) leaderFollowerStoreIngestionTask.isGlobalRtDivEnabled(); -> at com.linkedin.davinci.kafka.consumer.StoreIngestionTask.getDataIntegrityValidator(StoreIngestionTask.java:5021) leaderFollowerStoreIngestionTask.checkFastReadyToServeForReplica( PCS{replica=TestTopic_5789a626e4_dd581f76_v1-1, hybrid=false, latestProcessedVtPosition=InMemoryPubSubPosition{2}

java.lang.AssertionError: expected [1] but found [0]

java.lang.AssertionError: expected [1] but found [0]

Failed test found in: IntegrationTests_12-artifacts/internal/venice-test-common/build/test-results/integrationTests_12/TEST-com.linkedin.venice.server.VeniceServerTest.xml internal/venice-test-common/build/test-results/integrationTests_12/TEST-com.linkedin.venice.server.VeniceServerTest.xml Error: java.util.concurrent.ExecutionException: RestException{_response=RestResponse[headers={content-length=134, Content-Type=text/plain, X-VENICE-COMPRESSION-STRATEGY=0, X-VENICE-RCU=1, X-VENICE-SCHEMA-ID=-1},cookies=[],status=403,entityLength=134]}

Failed test found in: IntegrationTests_11-artifacts/internal/venice-test-common/build/test-results/integrationTests_11/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml internal/venice-test-common/build/test-results/integrationTests_11/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml Error: java.lang.AssertionError: Store from new store-version should only have one version expected [1] but found [0]