Repository Issue Activity (beta)

openai/evals

Current issue state, recent activity, and per-issue timelines from the indexed issue data.

Open Issues
125
New in 7 Days
1
Closed in 7 Days
2
Average Open Age
762 days
Stale 30+ Days
122
Stale 90+ Days
119
Last 2 Weeks
DateOpenedClosedCommentsEventsOpen Backlog
2026-07-1000000
2026-07-0900000
2026-07-0800000
2026-07-0700000
2026-07-0600111
2026-07-0500000
2026-07-0400000
2026-07-0312240
2026-07-0210001
2026-07-0100000
2026-06-3010001
2026-06-2900000
2026-06-2800000
2026-06-2700000
This Week

Opened: 0

Closed: 0

Comments: 1

Events: 1

Top Labels
bug (52)
Idea for Eval (15)
Issue Explorer
IssueAuthorStateLabelsCommentsReactionsUpdated

#1663 Eval proposal: prompt-defense-eval (OWASP LLM02 output-handling, 33 samples, deterministic regex scoring)

Opened 2 months ago
ppcvote
open
No labels
104 days ago

#1687 Registry suggestion: Helium benchmarks

Opened 7 days ago
connerlambden
closed - completed
No labels
107 days ago

#1688 Community eval: Helium option-chain + cue-swap benchmarks

Opened 7 days ago
connerlambden
closed - completed
No labels
107 days ago

#1685 OpenAI

Opened 10 days ago
ronardcedeno31-coder
open
No labels
0010 days ago

#1665 Question about issue & PR maintenance

Opened 2 months ago
Ein-Tim
open
No labels
0129 days ago

#1668 AgentThreatBench: OWASP Agentic Top 10 benchmark for indirect prompt injection and memory poisoning

Opened 2 months ago
vgudur-dev
open
No labels
2030 days ago

#1667 Add AgentThreatBench: OWASP Agentic Top 10 security evaluation suite (UK AISI)

Opened 2 months ago
vgudur-dev
open
No labels
102 months ago

#1636 Feature Request: HarmActionsEval benchmark for evaluation of agent action safety

Opened 4 months ago
prane-eth
open
No labels
102 months ago

#1635 Proposal: narrow factual-overelaboration pairwise eval (human-reviewed, no custom code)

Opened 4 months ago
joaquinhuigomez
open
No labels
004 months ago

#1634 test

Opened 4 months ago
aartipswc-dot
open
bug
004 months ago

#1527 What is this

Opened 2 years ago
DXv-3
open
No labels
204 months ago

#1632 Measuring hallucination rates in production systems

Opened 4 months ago
terrywerk
open
No labels
004 months ago

#1629 Proposal: add WFGY 16-problem RAG failure map as a taxonomy for eval analysis

Opened 4 months ago
onestardao
open
No labels
004 months ago

#1628 Feature Request: Add Explainability / Visibility Mode to `HumanCliSolver`

Opened 4 months ago
AftabHussain
open
No labels
004 months ago

#1627 Add speciesist bias evaluation category

Opened 4 months ago
stuckvgn
open
No labels
004 months ago

#1576 Link miss in readme

Opened 1 year ago
yufansong
open
bug
205 months ago

#1493 `OpenAIChatCompletionFn` should `__init__` should accept `**kwargs`

Opened 2 years ago
ezraporter
open
bug
305 months ago

#1556 o1 release breaks token usage stats

Opened 2 years ago
lucapericlp
open
bug
115 months ago

#1608 Pull request template is obsolete

Opened 7 months ago
omonimus1
open
No labels
107 months ago

#1606 Update python version in GitHub workflows to python 3.12

Opened 7 months ago
omonimus1
open
No labels
007 months ago

#1604 “Proposal: Thermodynamic trip-wire metric for AI consciousness threshold”

Opened 9 months ago
bordode
open
No labels
209 months ago

#1586 Improve installation documentation

Opened 1 year ago
bibhas2
open
No labels
109 months ago

#1599 Vimgolf, Cybergod and CTF environments integration, WebUI computer operation recorder integration

Opened 10 months ago
James4Ever0
closed - completed
No labels
0010 months ago

#1600 Reproducible rare anomaly: triple transcendental convergence at 9 decimal places

Opened 10 months ago
brybarrett
open
No labels
1010 months ago

#1601 Not a feature request — reproducible anomaly in entropy-probe outputs that may affect evaluation reproducibility. Transcendental convergence at 9dp observed, seems worth documenting.

Opened 10 months ago
brybarrett
open
No labels
1010 months ago

Rows per page:

1–25 of 250