02Research

What we study

We work on two questions: how to make models reason well on less compute, and how to tell whether a model is doing its job once people rely on it. We'll publish methods and results here as the work matures.

A Renaissance scholar studying a sample through a brass microscope

Area 01

Efficient reasoning

Models that spend compute where the difficulty is, and stop when more thinking won't help. This work produces the Kaer Reasoners.

Area 02

Evaluation

How models behave on everyday questions, judged by the people who do the work. It's also the method behind the studies we offer public services.

Area 03

Alignment and interpretability

Why models behave as they do, and whether that behaviour holds up as they are updated over months.

Current questions

What we're working on now. Results will be published with their method, cost and limits.

  1. 01Efficient reasoningCan a model learn when more thinking will help?Training a halting signal that decides, question by question, whether to keep reasoning, and when to hand over instead.In progress
  2. 02Efficient reasoningWhich training data improves reasoning?Measuring each part of a training mix by what changes when it's taken out.In progress
  3. 03EvaluationHow much does wording change an answer?Testing the same question in many phrasings, and reporting the spread rather than one score.In progress
  4. 04EvaluationHow should an assistant be judged in real use?Realistic questions, scored by practitioners as helped, neutral or harmed.In progress
  5. 05AlignmentDoes the model answer the question that was asked?Catching the moment a model quietly answers an easier question instead.In progress
  6. 06AlignmentHow does behaviour change after launch?Monthly checks that pick up changes in manner before they show up in accuracy.In progress

What every study includes

Five things will ship with everything we publish, so anyone can check the result or rerun it.

  1. 01
    The protocol

    Written before the results, so the method can't bend to fit them.

  2. 02
    The cost

    What each score cost to produce, at batch pricing.

  3. 03
    The variance

    Spread across phrasings and seeds, never a mean on its own.

  4. 04
    The limits

    Where the result stops holding, stated up front.

  5. 05
    The failures

    Variants that didn't work, and bugs we found in our own tools.