Skip to content
KEYPAIR INFRA
← Field Notes

The best thing our engine does is refuse to answer

KeyPair Infra
forensicsTRONheuristicscalibration

The best thing TRONORIGIN does is refuse to answer. The tool exists to settle one hard question about a TRON address — who controls it? — and the temptation in that kind of product is to always produce a name. Confidence is cheap. Knowing when you don’t have it is the whole job.

What the benchmark caught

A few weeks ago we built a benchmark to grade the engine against real, hand-labelled accounts — and we graded it engine-blind, so the answer key couldn’t leak into the scoring. One group of test cases was deliberately nasty: snapshot-less addresses. These are accounts that have never set an owner permission on-chain — wallets that received a token once and then sat there. There’s no permission record, which means there’s no on-chain evidence of who controls them. For that group, the only correct answer is “unknown.”

The engine named a controller on all thirteen. Zero out of thirteen correct — a 100% false-confidence rate. And the “controller” it picked was simply the biggest address that had ever sent the account money. It was crowning the funder as the controller, with no permission evidence whatsoever, and reporting it with a straight face. A guess, dressed as a result.

The fix was a deletion

We didn’t tune a threshold to squeak past the test. We removed the mechanism. Buried in the engine was a fallback that, when it found no permission evidence, picked a best guess anyway. We deleted it and replaced it with a rule: no permission evidence, no controller claim. When the chain is silent, the engine now abstains.

Two numbers told us we’d fixed the right thing. Abstention on those accounts went from 0/13 to 13/13. And the hundred-out-of-a-hundred accounts that do carry permission evidence scored byte-for-byte identically afterward — proof we removed a flaw rather than bending the engine around a benchmark. (That’s the payoff of building on auditable signals and golden fixtures: you can prove a change touched only what it was meant to.)

Why a wrong name is worse than no name

In compliance and forensic work, a wrong name isn’t a smaller version of the right one — it’s actively harmful. “Unknown” tells an investigator to dig deeper. A confident, wrong “this is the controller” points them at an innocent address — and they act on it. The cost of a false answer lands on a real person.

The same logic holds for any AI system people make decisions on. The product pressure is always to return something; the discipline is recognising the cases where you honestly can’t. We’ve written about how TRONORIGIN shows its work so every score is checkable — this is the other half of the same principle. An auditable answer and an honest “I don’t know” come from one commitment: the engine only says what the data lets it say.

Abstention isn’t a gap in the tool. It’s the tool working. Sometimes the best forensic answer is the one that refuses to be given — see it for yourself in TRONORIGIN.

Related work

Field Notes in your inbox

Practical write-ups from real projects — AI, crypto engineering, and the things we learned building them. No spam.

Say hello

Questions about what we build, or want to follow the work? Get in touch.