Grace HalimChief Data Officer

The journal · Replicate readings and the interpretation of research counts

Another reading is not automatically another sample

I corrected an account that let the number of rows enlarge the meaning of the research material, and learned to keep the observation unit visible in every later description.

A research dataset can become more substantial in a presentation without acquiring any new source material. The change can happen through a label. In 2011, I described 2700 laboratory readings as 2700 independent samples. The readings actually came from 900 source samples, with three replicate readings for each. Lina Mervathi challenged my independent-sample wording, and she was right. The rows were real observations in the laboratory record. My description had changed their relationship to the source and invited a conclusion the row count did not establish.

The correction was uncomfortable because I could explain why the repeated readings had value. That explanation did not answer the challenge. Useful repetition is not the same thing as another independent source sample. I had allowed the convenience of counting rows to become a statement about the scale of the evidence. The responsible statisticians needed an accurate account of the replicate relationship to assess the intended analysis. My role was to preserve that account, not to confer independence through the language of a management summary.

We withdrew the 2700-independent-sample claim and supported S$480000 review. The revised record retained 900 source samples and 2700 readings. It did not announce that every source sample was independent for every possible analysis; that is another question requiring the relevant assessment. It also did not discard the laboratory observations as useless. The correction concerned what I said they represented. I wanted colleagues to see both counts and understand why they answered different questions, rather than replacing one impressive total with a smaller number stripped of its own context.

Follow the row back to what was observed

A row is an arrangement in a dataset, not a universal scientific unit. It can represent a person, a specimen, a visit, a reading or another part of a process. The same underlying source may contribute several rows for legitimate reasons. Before turning the total into a claim, I want to understand that relationship. What was observed? What was repeated? What identifies the source? The data account should make those questions answerable for the expert using the material. A count becomes meaningful only when its unit is stated accurately.

In the 2011 case, the three-readings-per-sample relationship was simple enough to explain. The difficulty was not complicated arithmetic. It was the confidence of my independent-sample phrase and the momentum it gained once presented. A reader could reasonably take that phrase to imply a different evidential structure from the one recorded. I needed to inspect the sentence as well as the table. Data leadership includes the responsibility to notice when a familiar organisational shorthand changes the scientific meaning of what the team has prepared.

This does not mean every management audience needs all the details of an analysis. It means the detail omitted should not be the distinction that determines the claim. A concise account can say that 2700 readings came from 900 source samples. That is understandable without publishing laboratory records or restricted study material. The responsible specialists can then explain what the relationship implies for the intended analysis. Simplification should help the audience follow the evidence, not require them to accept a stronger meaning than the underlying record supports.

Correct the claim without discarding useful material

An analytical correction can become polarised between defending the original account and treating the whole dataset as discredited. Neither response fitted this case. The laboratory had produced repeated readings, and those readings could remain useful for appropriate questions. The error was my independent-sample interpretation I had added. I wanted the correction to preserve the legitimate work while removing the unsupported claim. That required a more precise explanation than simply saying the original number was wrong, because the 2700-reading total itself remained correct.

The S$480000 review was a cost of examining and correcting the account. It did not establish a later scientific success or a patient benefit. I did not attach such an outcome to make the story feel complete. The documented consequence was the withdrawal of the wording, retention of the two counts and clearer treatment of the replicate relationship. A leader can show responsible action without inventing a compensating victory. The quality of the correction lies partly in leaving its own result within the evidence available.

The correction also had to reach earlier users of the statement. Changing a later chart would not ensure that colleagues stopped repeating the 2700-independent-sample description. I needed to explain what had changed and why. This is a practical part of leadership accountability: an executive summary can move faster than the underlying data review, and its author may need to help reverse the interpretation they introduced. The task is not finished when the corrected file is saved. It is finished only to the extent that the relevant account has actually been clarified.

Keep the interpretation with its responsible expert

As a data leader, I can help preserve source relationships and make them understandable. I should not treat that role as authority to settle every scientific or statistical question. The 900 source samples still need to be considered in the context of the intended analysis. The correction of one overstatement does not create a new universal assurance. I would ask the responsible experts to assess the relevant dependence, design and interpretation, with my team providing an accurate record of how observations relate to their sources.

This distinction shapes how I would contribute to a board discussion. I would ask whether the population and unit in a management claim match the material described, and who has assessed any scientific implication. Directors do not need to become laboratory statisticians to recognise that a row count can be mislabelled. They need an intelligible account of the evidence and a clear route to the relevant expertise. The CDO can improve that account while remaining accountable for the limits of their own judgement.

For a professional profile, the case offers a more revealing story than a large dataset figure alone. A real leader can describe the original claim, the challenge and the corrected interpretation using permitted information. The narrative should protect participants and restricted research detail. It should also identify the leader's own part in the mistake rather than turning the challenger into an anonymous quality process. Lina's question mattered because it forced me to address the unit I had changed, not merely the arithmetic I could still defend.

I now read a research count with its source relationship in mind. Another observation may be valuable, but its value does not depend on pretending it is something else. The 2011 record became clearer when it stated 900 samples and 2700 readings together. That clarity left the specialists better able to judge the material for its intended use. It also left my leadership account more honest: the dataset had not shrunk through the correction; the claim had returned to the meaning the evidence could support.