Evaluating long-horizon model behavior
A proposed evaluation framework for goal retention, evidence tracking, recovery, and calibrated escalation across multi-step technical tasks.
A place for technical agendas, evaluation designs, and observations as LabOne37 develops. These entries describe planned inquiry, not completed publications.
Frontier labs separate fast-moving updates from formal publications. Here we begin with an honest working record and will add evidence as it becomes available.
A proposed evaluation framework for goal retention, evidence tracking, recovery, and calibrated escalation across multi-step technical tasks.
Metrics that connect capability with latency, memory, energy, and total operational cost rather than treating benchmark score as the only outcome.
Design questions around authorization, plan inspection, intervention points, execution traces, and bounded recovery.
Product work on identity, PII detection, policy enforcement, token optimization, provider routing, and request-level observability.
Methods for adapting models to technical domains while preserving calibration, transfer, provenance, and dependable behavior.
Future technical reports will include methods, evaluation conditions, limitations, and links to artifacts where release is appropriate. Until then, these entries remain research agendas.
Discuss the agenda →