Mechanism to deduplicate messages

[RobinFrcd]

Hi,
After reviewing messages from multiple vehicles, I noticed that about 20% of the messages sent to Kafka are duplicates (based on value, ignoring the timestamp).
Would it be possible to implement a mechanism in the service to prevent pushing the same value twice in a row for a given field?

Here’s a sample from a two-day period showing the rate of duplicated values across several hundred vehicles:

Thanks !