Research

Frontier evaluation
for frontier AI.

Teehoo AI builds methodology, capability systems, and open collaboration samples across evaluation design, RL environments, and expert verification — purpose-built for the post-training era.

8
EVALUATION DIMENSIONS
6
DOMAIN EXPERT TIERS
4
COMPLIANCE GRADES
2
BILINGUAL COVERAGE

Capability scope — not operational traction figures (users, tasks, customers).

Research directions for
post-training evaluation.

Three lines of work — evaluation, RL environments, expert verification — defining the boundary where models are not yet reliable.

Evaluation Design

Rubric systems for complex reasoning, multi-step tasks, and agent behavior. Expert-level scoring standards anchored by multi-judge agreement, with failure modes flowing back into rubric iteration — evaluation quality compounds over time.

RL Environments

Reproducible task environments with auditable rewards. Trajectory replay, ground-truth labeling, and reward shaping — supporting agent evaluation, tool-use verification, and multi-turn alignment.

Expert Verification

Tier-gated global expert network providing reasoning correctness, agent trajectory review, and safety verification. Humans define what models ought to produce, not just what they currently produce.

What models can't do What labs want models to do Teehoo Frontier Evaluation Coverage

Evaluation Capability Matrix

Methodology, dimensions, and aligned public benchmarks. Progress bars below indicate capability coverage scope — not model scores.

Teehoo-Reasoning

Complex multilingual reasoning evaluation across multi-step logic, long-context, and cross-disciplinary tasks. Anchored by expert rubrics and multi-judge agreement, with continuous judge-human alignment calibration.

Rubric design
In progress
Multi-judge agreement
In progress
Bilingual coverage
Ready
Long context
In progress
Scope planningCapability ready
Illustrative capability coverage · Not model scores · Not real data

Teehoo-Agent

Agent behavior and trajectory evaluation across multi-step tool-use trajectories, error-step localization, and regression verification. Root-cause attribution replaces aggregate scoring to pinpoint real failure modes.

Trajectory review
In progress
Tool-use verification
In progress
Failure attribution
In progress
Regression verification
Planned
Scope planningCapability ready
Illustrative capability coverage · Not model scores · Not real data

Teehoo-Safety

Model safety and red-team evaluation across adversarial prompting, jailbreak attempts, and harmful output detection. Tiered classification by harm category with risks feeding back into safeguard iteration.

Red-team probing
In progress
Risk tiering
In progress
Harmful-output detection
In progress
Regulatory alignment
Ready
Scope planningCapability ready
Illustrative capability coverage · Not model scores · Not real data
Public Benchmark Alignment

Aligned with public benchmarks

Teehoo AI does not publish proprietary benchmarks. Instead, we align with public academic and industry benchmarks and extend bilingual coverage on top. "Alignment" denotes methodology-level coverage capability — not third-party certification or endorsement.

BenchmarkLanguageTypeAlignment Status
SuperCLUEChinese ComprehensiveChineseComprehensiveAligned
C-EvalChinese AcademicChineseSubject ReasoningAligned
CMMLUChinese Multi-taskChineseMulti-task QAAligned
MMLUEnglish AcademicEnglishSubject ReasoningExtending
SWE-benchSoftware EngineeringEnglishCode / SWEExtending
GAIAAgent AssistantEnglishAgent TasksPlanned
HumanEvalCode GenerationEnglishCode GenerationExtending
FLAMESChinese SafetyChineseSafety / ValuesExtending

Benchmark names follow each project's official designation. "Aligned / Extending / Planned" denotes Teehoo AI's methodology-level coverage relative to each, not certification or exclusive licensing.

Research Notes

Methodology drafts, Distributed Expert workflow papers, compliance frameworks, and frontier observations. Drafts in progress — released as ready.

Research Newsletter

Subscribe to Teehoo Research

Methodology briefs, benchmark alignment progress, compliance framework updates — subscribers get them first.

Form is a frontend placeholder; production launch wires it to a compliant email service with unsubscribe controls. Research inquiries: press@teehooai.com · partnerships: partnerships@teehooai.com