Skip to website

The journal · Source history and data products

The corrected score still needs the story of its correction

I explain why a results service can hold the right current value and still fail to account for what it supplied earlier, using an update decision I had to reverse.

I once approved a result-update approach that made our archive look cleaner while making it harder to explain. When an authorised competition source amended a result, the new value replaced the old one. The current display could therefore be correct. What disappeared was the supported path between the earlier account and the new one. In a review of 118 match records, seven had received amendments. A customer's question about an older extract exposed the weakness: the service could show the latest answer, but no longer held a sufficient account of why that answer differed from what it had supplied before. I had approved the simplification that created the problem.

The latest value was only part of the record

The product argument for one current result was reasonable. Many users wanted to know the latest supplied outcome without reading through a sequence of revisions. A compact display could serve that purpose well. My mistake was to allow a display choice to decide what the underlying service needed to preserve. The fact that a reader should see one prominent value did not mean the earlier supported values and amendment relationships had become irrelevant. Another reader might be reconciling an extract, examining a previous analysis or trying to understand when the account changed. Those uses required more than the latest visible answer.

Anita raised the issue through her work with authorised competition sources. The initial response proposed by the product sponsor was to retain the single-result model and explain exceptional changes manually. That would have kept the implementation simpler, but the explanation would then depend on a person remembering what happened outside the service. It also risked making the answer inconsistent across customers. I recommended restoring the supported histories, with ₹41 lakh committed to recovery, review and revised handling. The expense and delay belonged to the correction of a decision I had made, not to a new feature we could present as unrelated progress.

The reviewed set contained 111 unchanged records and seven with supported amendment histories. Those counts described the bounded review. They did not establish a rate of error across every competition or prove that every earlier value could be reconstructed. Where the evidence supported a version and its relationship to an amendment, we retained it. We did not invent a missing step merely because a complete sequence would look more satisfactory. A history is useful because it connects the account to evidence; a plausible sequence created after the fact would undermine the reason for preserving it in the first place.

A history needs an authorised source

Sports data carries a particular authority distinction. Our service could record and distribute a result, but it was not the body deciding the official outcome. An amendment from the responsible source needed to be represented accurately without turning the data team into an alternative adjudicator. That boundary matters when a user challenges a change. We could explain what the source supplied and how our service handled it. We could not resolve the underlying sporting dispute merely because we controlled the archive field. A record of an authorised decision and the authority to make that decision are different responsibilities.

The distinction also helped us describe what the repair achieved. We restored a more intelligible account of the supplied changes. We did not improve an athlete's performance, establish eligibility or demonstrate a customer loss. The value of the work was in the service's ability to explain itself. That can be commercially important without requiring an invented outcome measure. A customer comparing two extracts should not have to guess whether the difference came from an authorised amendment, a transformation in our handling or an unexplained defect. A supported history makes that question more answerable, even when the current visible result remains exactly the same.

I do not take this experience to mean that every data product should expose every internal version to every user. Presentation, access and retention need their own purpose and controls. The lesson is to decide those questions explicitly rather than let a convenient overwrite determine them by accident. Some users need a current view; others need a dated account or a controlled explanation of change. The service should understand those needs and the evidence required to support them. Keeping a history does not remove the responsibility to make it usable, proportionate and faithful to the source relationships it claims to preserve.

Make the change understandable to the next reader

The difficult part of the correction was accepting that a result can be right in one sense and inadequate in another. My original approval focused on the current answer. The customer's question concerned the relationship between answers over time. Neither question was unreasonable, but the service had been designed as though only the first mattered. I now try to identify the next reader's likely question before a transformation removes information that cannot easily be recovered. The person using an archive later may not know the operational context that made an update obvious to the team on the day it happened.

This has changed how I discuss data quality with executives. A completion measure or a count of current valid records may be useful, but it should not become the whole account of trustworthiness. The intended use determines which relationships matter. For one product, a current result may answer the question. For another, the timing and source of a change are central. A board does not need to inspect individual match records, but it should understand whether the enterprise has identified those different obligations and assigned responsibility for them. The commercial promise should match the account the service can actually sustain.

The seven restored histories remain a modest and specific example. Their value is not that they prove a universal architecture or a particular technology standard. They show a decision about what the product was prepared to explain. I want my leadership account to retain that distinction, including the original error, the ₹41 lakh cost and the authority that remained with competition sources. A current display should make the answer easy to read. It should not make the supported history impossible to understand. When those two aims are considered together, a correction can improve the record without pretending that it rewrites the event itself.