[Feature]: Add tests for NIC monitor and make it production ready

[KaivalyaMDabhadkar]

Prerequisites

• I searched existing issues

Feature Summary

Add e2e and unit tests for NIC health monitor. Add appropriate configuration in the helm charts to make it prod ready.

Problem/Use Case

Refer to the NIC monitor design doc

Proposed Solution

Refer to the NIC monitor design doc

Component

Health Monitor