A language model can give your Norwegian legal tool a value that never applied.
Eirik Botten Nicolaysen’s norregel benchmark tests numeric values in Norwegian law at stated dates. In its first run, Opus 5.5 answered 46.7% of the 880 primary items correctly. Sonnet 4.6 answered 40.2% correctly.
Most wrong answers used values absent from the provision’s dated history. For a builder, checking whether an answer is outdated won't catch that failure.
https://arxiv.org/abs/2610.29207v1
Terminus needs JavaScript to show replies and pictures.