Miriam LalsoraniChief Information Officer · Essays & perspective
← All essays

Language testing in financial field applications6 min read

A translated screen earns approval through the action it produces

A linguistically acceptable phrase can still lead an officer to the wrong next step. Task observation brings language, workflow and customer consequences into the same release decision.

When a language update reaches its final review, the discussion often centres on whether each phrase is an accurate translation. That is necessary work, but it does not establish that the screen will help a person act correctly. A phrase appears beside buttons, amounts, status messages and expectations formed by earlier screens. The user reads it while trying to complete a task. I want language review to include that moment, because a technically defensible translation can still imply that something has happened when the application is only asking permission to attempt it.

Review the moment of use

In our field application, officers navigate repayment and service tasks under conditions that vary from a quiet branch desk to a customer visit with an unreliable connection. A revised prompt needs to communicate its role in that sequence. Is it asking for confirmation, reporting acceptance or explaining that further review is required? Those meanings may be obvious to a developer who knows the workflow and less obvious to the person reading the phrase alone. The test should expose the difference before the release makes it part of daily work across the branch network.

We took 23 revised prompts into a rehearsal with 44 officers completing 128 simulated tasks. The exercise asked each officer to choose the next action and explain what they believed had happened. A language reviewer could then hear whether the interpretation matched the intended process. The developer could see whether the problem arose from wording, placement or the sequence itself. Operations could judge whether the proposed action made sense in the working context. These perspectives were complementary. None could replace the others simply by asserting that the phrase had already been approved within its own discipline.

The observation needed restraint. If a reviewer coached the officer at the point of hesitation, the task might end successfully while concealing the weakness we needed to understand. We recorded the hesitation or wrong action before discussing it. That was not a performance assessment of the officer. It was evidence about the application and its explanation. Making that purpose clear helped participants reveal confusion instead of trying to produce the answer they thought the project team wanted. A rehearsal designed to protect the release from criticism will usually discover less than one designed to learn how people actually interpret it.

Some problems belonged to the workflow rather than the translation. A phrase could be clear but appear before the evidence necessary to support it, or two adjacent screens could use similar words for different states. Replacing a word would not repair that sequence. I wanted the issue assigned to the responsible part of the design rather than returned indefinitely to the language reviewer. The application team had to accept that a language exercise could expose a software problem. Equally, a familiar workflow did not excuse a phrase that gave an inaccurate account of the next action.

Keep the comparison honest

The first round produced seventeen incorrect next actions. After revisions, the second produced four. We retained the task definitions so the comparison did not improve simply because the follow-up exercise was easier. The figures described performance in a rehearsal, with a particular group and set of tasks. They were useful evidence for a release decision, but they did not establish a measured reduction in live customer errors. I wanted the report to say exactly that. A small, controlled exercise can be valuable without being promoted into a claim about every officer and every future interaction.

The definition of an incorrect action also needed agreement before the result was counted. If one reviewer regarded a request for clarification as a failure while another counted only an irreversible wrong step, the total would mix different observations. We distinguished the action chosen from the reason given and kept the notes that explained the classification. This allowed the team to examine whether a revision addressed the original misunderstanding. A lower number alone would not tell us whether the remaining problem was less serious, equally serious or concentrated in a task with greater customer consequences.

We kept the underlying approved lending terms outside the scope of a routine translation change. Improving navigation did not authorise the technology team to change an obligation or the explanation of it without the responsible review. Where wording touched customer treatment, compliance remained involved. That boundary is especially important when a project is presented as a simple language update. A small textual change can alter what a user believes they are committing to, even when nobody changes a calculation. The release process needs to recognise the consequence of the words rather than judge significance only by the size of the code change.

The follow-up also needs to avoid teaching participants a particular answer and then treating recall as independent evidence of usability. Familiarity is a real part of learning a system, but the team should understand what its exercise measures. We used the rehearsal to identify the remaining confusing prompts and recorded the conditions of the comparison. Subsequent observation in ordinary use was a separate activity. I would rather present a modest conclusion with a clear method than a dramatic percentage that cannot survive a question about how the second round differed from the first.

Release the part that is ready and explain the rest

Nineteen prompts were ready for release after the review; four remained under further work. The release manager preferred a single completion date because a split complicated support. I understood the argument. Supporting two states of a change can require additional guidance and coordination. It does not follow that an unresolved prompt should be released merely to simplify the project report. We agreed the temporary operating guidance and retained an explicit owner for each remaining item. The decision made the unfinished work visible rather than transferring the cost of confusion to field staff.

Partial release needs a coherent boundary. It should not leave a user moving between incompatible meanings within the same task. The team examined the dependencies before deciding which prompts could proceed. A split is defensible only when the released portion can be used responsibly with the surrounding workflow. Otherwise, holding the whole change may be the better decision. I do not regard phased delivery as an automatic virtue. It is a choice that needs evidence about how the parts relate, who will support them and what would cause us to change the plan.

For the board, this kind of case can make technology oversight concrete without requiring a discussion of every phrase. Management should be able to explain the user consequence being tested, the evidence obtained and the reason for any incomplete release. Directors can ask whether the project has distinguished simulated results from live outcomes and whether customer obligations received the right review. They should not become a translation committee. Their role is to assess whether the organisation has a credible method for discovering and acting on a misunderstanding before it becomes widespread, and whether a delivery deadline is suppressing evidence that should change the decision.

Language quality belongs to the functioning service, not only to the document containing its strings. A phrase earns its place by helping a person understand the action and its consequence in context. That requires linguistic care, observation and willingness to revise the workflow when the words expose a deeper problem. Our nineteen-prompt release was deliberately incomplete because the evidence was incomplete for the remaining four. I consider that a more useful account of progress than a finished translation list that leaves officers to discover its ambiguities in front of customers.