alloevil.github.io valid

agent-harness-evals

agent-harness-evals is a reconciliation layer over public AI evaluation leaderboards that exposes the model x agent-harness matrix model-only leaderboards hide: which harness gets the most out of each model, and how much the harness alone moves the score.

Visit publisher ↗

For agents: agent-harness-evals: reconciles public AI evaluation leaderboards into a model x agent-harness matrix showing how much the harness moves benchmark scores.

ai agent evaluation agent harness llm leaderboards terminal-bench benchmark matrix

Authority: 45 reach 0 · trust 5 · quality 25 · freshness 15
Tier: listed
llms.txt: https://alloevil.github.io/agent-harness-evals/llms.txt
llms-full.txt: https://alloevil.github.io/agent-harness-evals/llms-full.txt
Sections: 5
Links: 22
Size: 4849 bytes
Country: United States Hosting inference
Hosting country: United States Hosting inference
Country evidence: No published address evidence collected yet
Categories: AI and machine learning
For agents: Documentation: developer or product docs worth reading, nothing to call
Inferred actions: Read documentation Download data Search content About these labels
Audience: developers · agents can: read docs, download data, search content · en
First seen: 2026-10-24T10:01:32.894Z
Last checked: 2026-10-24T10:01:34.000Z
Badge

Their llms.txt

The beginning of the file, from our validated copy saved 2026-10-24T10:01:32.967Z. Cached copy · Source on alloevil.github.io

# agent-harness-evals

> agent-harness-evals is a reconciliation layer over public AI evaluation leaderboards that exposes the model x agent-harness matrix model-only leaderboards hide: which harness gets the most out of each model, and how much the harness alone moves the score.

The same model does not score the same under every agent harness. This project fetches published leaderboard data (the Epoch AI Benchmarking Hub, refreshed about daily under CC-BY, plus the HAL harness leaderboards as a historical snapshot), reconciles model and harness names into one (benchmark, model, harness, score) record, and pivots the result per benchmark into a model x harness matrix with a per-model spread — best harness minus worst — so the harness contribution can be read with the model held fixed. As of 2026-10-24 it holds 7005 records over 94 benchmarks, with 41 models and 50 harnesses on 10 cross-harness boards. It runs no evaluations: every score is a third-party published number, republished with its source.

Reproduce it: `pip install -r requirements.txt && python src/fetch.py && python src/normalize.py && python src/views_harness.py && python src/build_site.py`.

## Docs
- [Live matrix](https://alloevil.github.io/agent-harness-evals/): per benchmark, the model x harness matrix, a harness ranking and a model ranking
- [Score trend](https://alloevil.github.io/agent-harness-evals/trend.html): score over time, one line per harness
- [Method and record schema](https://github.com/alloevil/agent-harness-evals#record-schema): how model and harness ids are reconciled across sources
- [Status and limitations](https://github.com/alloevil/agent-harness-evals#status--limitations): which harness data is live, which is a snapshot

## Data
- [Daily snapshots](https://github.com/alloevil/agent-harness-evals/tree/master/data/snapshots): one JSONL per day of normalized records, diffable history
- [Harness matrices](https://github.com/alloevil/agent-harness-evals/tree/master/views): per-benchmark model x harness CSV and Markdown, with spread and n

## Evidence
- [claims.json](https://alloevil.github.io/agent-harness-evals/claims.json): the five headline aggregates, each with metric, method, repro command and evidence
- [llms-full.txt](https://alloevil.github.io/agent-harness-evals/llms-full.txt): self-contained description, install, limits and FAQ

## Benchmarks
- [Terminal-Bench](https://alloevil.github.io/agent-harness-evals/#terminalbench): 30 models x 37 harnesses. Agentic tasks in a real shell — coding, sysadmin, data wrangling. Score = share of tasks passed.
- [CORE-Bench Hard](https://alloevil.github.io/agent-harness-evals/#hal_corebench_hard): 15 models x 3 harnesses. Reproduce computational results from real research papers. (HAL)
- [GAIA](https://alloevil.github.io/agent-harness-evals/#hal_gaia): 11 models x 2 harnesses. General-assistant questions needing web search, browsing, and tool use. (HAL)
- [SWE-bench Verified Mini](https://alloevil.github.io/agent-harn
…

Related sites

Explore similar publishers →

Similar publisher descriptions and documentation. Similarity does not imply affiliation or equivalent capabilities.

Domain	Title	Category	Country	Authority	llms.txt	llms-full.txt
llm-stats.com	LLM Stats	informational AI and machine learning Search content	—	59	✓
vals.ai	Vals AI	documentation AI and machine learning Search content Read documentation	US	63	✓	✓
benchlm.ai	BenchLM AI	documentation AI and machine learning Data and analytics Search content Read documentation	—	60	✓	✓
huggingface.co	ALL Bench Leaderboard 2026	documentation AI and machine learning Read documentation Search content	—	64	✓	✓
benchmarkheaven.com	Benchmark Heaven	interface AI and machine learning Read documentation Search content+1	FI	50	✓	✓
agentmods.dev	agentmods	documentation AI agents and MCP Developer tools Search content Read documentation	—	53	✓	✓
arklex.ai	Arklex	documentation AI and machine learning AI agents and MCP +1 Read documentation	US	50	✓
trulens.org	TruLens	interface AI and machine learning DevOps and observability +1 Read documentation	US	53	✓

Machine-readable: GET /v1/resolve?q=alloevil.github.io · GET /v1/domain/alloevil.github.io · this page as Accept: application/json or text/markdown · MCP lookup_domain

Automatically discovered from public files. Inclusion does not imply endorsement or publisher participation.

Own or manage this website?

If you own or manage alloevil.github.io, you can update its listing and review file health, discovery activity and score history.

Manage this listing — optional

What verification unlocks

See how your site is discovered—and control what agents see.

See your website in the map
Review your indexed topics, nearby publishers sharing headings, measured listing exposure and map snapshots in a private report for your website.
Control what agents see
Edit your listing description, tags, public contact details and additional llms.txt paths. Publish your terms for automated access, attribution and pricing.
Make your profile eligible for search
A valid, listed, unblocked, verified profile can appear in our publisher sitemap and become eligible for search-engine visibility. Search engines decide what to index and rank.
Appear in our llms-full.txt
Eligible verified publishers are listed by name, with their file links and summaries, in the service overview agents can read.

Free. No account registration, backlink or payment required. Public discovery remains available without verification.

Verify your website—free

Preview the owner dashboard · All verification benefits

Let your coding agent verify it

If your coding agent is authorized to manage this website, paste these instructions into it.

Claim my listing on Agent Web Map for alloevil.github.io:
1. POST https://agentwebmap.com/v1/sites/alloevil.github.io/claims and keep claim_id and claim_secret private.
2. Publish the proof: add the line "AgentWebMap ownership: <token>" (token from step 1) to https://alloevil.github.io/llms.txt, or use the DNS, meta-tag or well-known method the response describes.
3. POST https://agentwebmap.com/v1/sites/alloevil.github.io/verify with {"claim_id": "...", "claim_secret": "..."}.
4. Save the api_key from the answer; it manages the listing (PATCH https://agentwebmap.com/v1/sites/alloevil.github.io).
MCP equivalent: tools begin_ownership_claim, then verify_domain, at https://agentwebmap.com/mcp. Docs: https://agentwebmap.com/docs#verify

Corrections or removal requests: contact the directory.