Skip to website
Joseph VemqashiChief Data Officer · Essays & perspective
← All essays

Music identity and data modelling5 min read

Fewer catalogue rows can mean that the model has lost the music

A consolidation I approved removed distinctions between recordings. The useful question was what survived the merge, not how much smaller the output became.

I found the reduction persuasive before I asked what had been reduced. A trial catalogue contained a hundred supplied recording records associated with forty works. The rule I approved retained one row per work and described the smaller output as successful cleaning. A catalogue colleague then demonstrated two different performances that our model had made indistinguishable. The project had met its chosen measure while failing the service's purpose. That was a decision problem for me, not simply an implementation error for the team to repair.

A relationship is not an identity test

The shared work reference was useful. It described a relationship we wanted the service to retain. The mistake was promoting that relationship into proof that the recording records were interchangeable. This is why I now ask a data proposal to state the object it intends to preserve before it describes the rule used to simplify the set. People can agree that records are related while disagreeing, correctly, about whether they describe the same thing. A model that cannot express that difference will force an answer even when the source evidence does not.

Our delivery sponsor proposed keeping the reduced output and putting the performance differences in a note. I understood the attraction. The display was already designed, the smaller set looked orderly and a structural change would cost time. A note could also preserve some human-readable detail. But the recording distinction was required by the service's handling of the data, not just by a reader patient enough to inspect supplementary prose. If downstream processing used the row as its object, the optional note would not undo the identity assertion already built into the model.

We stopped the trial output before customer delivery and funded a ₹72 lakh repair. The final set retained a hundred distinct recording records with their forty work relationships. That was not a multiplication of the underlying music or evidence that every supplied description was correct in every respect. It was a correction to the particular relationship our own rule had misrepresented. The faulty output remained in staging, so I did not describe the programme as recovery from a confirmed customer loss. Nor did I claim recovered royalties. Those would have been different claims requiring evidence we did not possess.

The distinction matters when leaders describe remedial work. A repair can be necessary without a dramatic external loss to justify it. In this case, stopping before delivery was the point. We still incurred the programme cost and delayed the planned release. It would have been misleading to invent a financial disaster avoided in order to make those consequences sound smaller. The defensible account was that we discovered a material model error, held the affected output and paid to preserve the objects the service had promised to represent.

Choose examples that can contradict the proposal

The original review had shown examples that fitted the rule comfortably. They were useful for explaining how the proposal worked, but weak evidence that it was appropriate. I now want a specialist to choose examples that would embarrass the model if its assumptions were wrong. Distinct performances associated with the same work were not an obscure corner of our business. They were precisely the kind of case that should have challenged a consolidation based on a shared work reference. The absence of that challenge reflected how we organised the decision.

This does not mean every data project needs an endless catalogue of exceptions before it can proceed. It means the acceptance discussion should expose the conceptual risk of the rule being approved. A spelling-normalisation rule and an identity-merge rule can have very different consequences even if both reduce apparent variation. The latter may remove relationships that are difficult to reconstruct once the original evidence has been discarded. A senior sponsor should understand that difference well enough to ask for the right challenge, rather than rely on a generic improvement percentage.

I also learned to distinguish the specialist's objection from resistance to efficiency. The colleague who questioned the merge was not defending untidy records for their own sake. The objection concerned what the records meant. If management rewards fewer rows without examining the retained meaning, specialists face a poor choice: accept a misleading success measure or appear obstructive. I had helped establish that choice by approving the rule too quickly. Correcting the model without acknowledging that leadership failure would have made the same problem likely to recur under a different label.

The repaired design retained the original trial evidence and the reason for changing the relationship. That mattered because an unexplained increase from forty rows to a hundred could otherwise be presented later as deterioration. The team needed an account of why the additional records were necessary, not just a new output to defend. Good documentation here was not a ceremonial record of approval. It allowed a future colleague to distinguish justified multiplicity from a fresh duplication problem, using the service's object and evidence rather than the superficial shape of the count.

A board needs the model's commercial implication

Directors do not need to adjudicate individual catalogue matches. They do need to understand when a data model can change the substance of the service an enterprise believes it is supplying. In our example, the count was not merely a presentation choice. It determined which recording objects the output could distinguish. A board discussion should connect that consequence to the product promise, the authority of the specialists reviewing it and the decision to hold delivery. Otherwise the issue may be reduced to a technology delay whose underlying commercial meaning never becomes visible.

I would also want directors to hear the actual limits of the repair. Restoring the recording structure did not settle all ownership, credit or language questions elsewhere in the catalogue. Those required separate evidence and responsible owners. Treating one successful correction as a certification of the entire data estate would repeat the original mistake at a larger scale: an attractive summary would stand in for the particular claim it could support. The useful executive account says what changed, why it mattered and what remained outside the work.

The question I now carry into a consolidation proposal is straightforward: which distinctions does the customer need us to preserve, and what evidence permits us to remove any of them? Sometimes the answer will support a smaller set. Sometimes the correct model will be larger or more complex than the first design allowed. Neither outcome is inherently a victory. The point is that the service can explain its objects and relationships faithfully. In this case, a hundred recording records linked to forty works was the more useful result because it retained the music our cleaner-looking output had lost.