In 2023 eight partners delivered 2,400 notice submissions into a defined ingestion review. Some repeated deliveries arose when a partner retried a transmission after failing to receive an acknowledgement. The proposed deduplication rule used customer and date as its main comparison. That would have removed obvious repeats, but it could also have collapsed separate notices from the same customer on the same day.
The operations sponsor wanted to clear the apparent duplication quickly because staff were spending time investigating repeated arrivals. I agreed that a retransmission should not quietly become another submission event. I did not agree that identical customer and date fields established retransmission. The record needed to preserve the partner reference, incident reference and relevant delivery evidence before a decision could be made about whether two arrivals represented the same submission.
A ₹54 lakh review confirmed 120 repeated deliveries using matching source identifiers and payload evidence. We retained 2,280 distinct submission events. Within that retained set, seventy shared a customer and date with another notice but carried different incident references, so they remained separate. The count of 2,280 did not represent unique policyholders, unique claims or unique underlying loss events. Operating colleagues retained the interpretation of the notices themselves.
We deferred the planned batch release by five weeks and preserved the original deliveries with their reconciliation links. The repeat deliveries could therefore be examined without contributing again to the defined submission count. This was an ingestion correction, not a statement that every retained notice was valid for insurance purposes or that the data team had resolved coverage. Nor did keeping two notices separate prevent later professional review from relating them to the same event.
The practical lesson was to name the object being counted before choosing the comparison rule. A delivery, submission, claim and person can legitimately have different totals. I would establish that vocabulary with the receiving team earlier next time, so that pressure to remove duplication does not erase real distinctions simply because two records happen to share convenient fields.