Case 01
A shared reporting unit did not settle whether research readings belonged in one pool
The 2023 portfolio proposal at the fictional Seravune Therapeutics brought 240000 research readings from twelve studies toward a combined view. Nine studies used one measurement method and three used another. Marcus Selvarne wanted a pooled chart that would make the portfolio easier to discuss. The results were expressed in the same reported unit, and the large collection appeared to offer a more comprehensive account than separate study views. I agreed that the portfolio needed a useful presentation. I did not think the shared unit answered the question of scientific comparability.
The measurement method remained part of how an observation had been produced. A consistent column label could make the values easy to combine without establishing that they were suitable for the proposed interpretation. My role was to preserve that context and make the unresolved question visible. Scientists and statisticians needed to assess comparability for the intended analysis. The data office should neither declare the methods equivalent nor conclude that they could never be compared merely because their names differed. Both conclusions would exceed the decision I was qualified to make.
We retained the method families in separate views pending the scientific and statistical review, with S$3.8 million programme expense. The underlying study associations remained attached to the readings. Marcus had to accept a less compact portfolio presentation while the question was examined. I supported that cost because a pooled display could create an impression of comparability before the relevant assessment had occurred. The account did not claim a therapeutic effect, a patient benefit or a product decision. It concerned the organisation and interpretation of research material for a particular proposed view.
The outcome was a qualified portfolio account with the method distinction preserved, not an eventual finding of equivalence or a completed pooled scientific conclusion. The story reports no later resolution that the record does not contain. I learned to ask whether the convenience of a common data structure is being mistaken for agreement about the observations it holds. A CDO can improve access and organisation while still requiring the responsible experts to judge meaning. The distinction is especially important when a visually coherent chart may lead a management audience to believe that a scientific question has already been settled.