[server] Fix spammy logging when reporting backup version's replica ingestion timeout (linkedin#2359)

This PR addresses a spammy log issue when replica bootstrap timeout happens.    
Previously, when a push timed out, SIT would throw an exception unconditionally
and stop consumption for all replicas.                                        

In a previous PR (linkedin#2284), when a backup or current version replica bootstrap   
times out, SIT no longer throws an exception but instead reports ERROR to PCS. 
For current version replicas, a reset feature may kick in to configure a      
Helix reset. For backup version replicas, such a feature is not triggered,    
and as a result, each check loop repeatedly reports the same log, which is    
not expected.                                                                  

We may consider extending the error reset feature to backup versions once it  
is stabilized, but this fix is still needed regardless. This PR resolves the  
issue by checking whether PCS has already reported ERROR. For replicas that   
have timed out and already reported ERROR, it will no longer log repeatedly.

Author: sixpluszero

clients/da-vinci-client/src/main/java/com/linkedin/davinci/kafka/consumer/LeaderFollowerStoreIngestionTask.java

@@ -622,8 +622,9 @@ protected void checkLongRunningTaskState() throws InterruptedException {
        * For current / backup version re-ingestion, it should report failure to the replica, but should keep other
        * online replica continue serving and do not close ingestion task.
        */
-      if (!partitionConsumptionState.isComplete() && LatencyUtils.getElapsedTimeFromMsToMs(
-          partitionConsumptionState.getConsumptionStartTimeInMs()) > getBootstrapTimeoutInMs()) {
+      if (!partitionConsumptionState.isComplete() && !partitionConsumptionState.isErrorReported()
+          && LatencyUtils.getElapsedTimeFromMsToMs(
+              partitionConsumptionState.getConsumptionStartTimeInMs()) > getBootstrapTimeoutInMs()) {
         if (!pushTimeout) {
           pushTimeout = true;
           timeoutPartitions = new HashSet<>();
@@ -785,12 +786,11 @@ protected void checkLongRunningTaskState() throws InterruptedException {
       // Timeout
       String errorMsg =
           "After waiting " + TimeUnit.MILLISECONDS.toHours(getBootstrapTimeoutInMs()) + " hours, resource:"
-              + getStoreName() + " partitions:" + timeoutPartitions + " still can not complete ingestion.";
+              + getKafkaVersionTopic() + " partitions:" + timeoutPartitions + " still can not complete ingestion.";
       LOGGER.error(errorMsg);
       VeniceException ex = new VeniceTimeoutException(errorMsg);
       Store store = getStoreRepository().getStoreOrThrow(getStoreName());
       int currentVersion = store.getCurrentVersion();
-      LOGGER.info("DEBUGGING: {} {}", currentVersion, getVersionNumber());
       if (getVersionNumber() <= currentVersion) {
         // For current / backup version, a replica's re-bootstrap timeout should not incur whole SIT closure.
         for (int partition: timeoutPartitions) {