Current issue state, recent activity, and per-issue timelines from the indexed issue data.
| Date | Opened | Closed | Comments | Events | Open Backlog |
|---|---|---|---|---|---|
| 2026-09-09 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-08 | 1 | 0 | 0 | 0 | 145 |
| 2026-09-07 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-06 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-05 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-04 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-03 | 1 | 0 | 0 | 0 | 0 |
| 2026-09-02 | 0 | 0 | 0 | 0 | 0 |
| 2026-09-01 | 1 | 0 | 0 | 0 | 0 |
| 2026-08-31 | 0 | 0 | 0 | 0 | 0 |
| 2026-08-30 | 0 | 0 | 0 | 0 | 0 |
| 2026-08-29 | 0 | 0 | 0 | 0 | 0 |
| 2026-08-28 | 1 | 0 | 0 | 0 | 0 |
| 2026-08-27 | 0 | 0 | 0 | 0 | 0 |
Opened: 2
Closed: 0
Comments: 0
Events: 0
| Issue | Author | State | Labels | Comments | Reactions | Updated |
|---|---|---|---|---|---|---|
#2635 TopkRetriever crashes on transformers 5.x: tokenizer.encode_plus was removed Opened 3 days ago | rrrxxx0510 | open | No labels | 0 | 0 | 3 days ago |
#2631 Grading integrity: model code rewrites ground truth in three benchmarks; CRUXEval splices prediction into assertion; unparseable verdicts exit denominator; LCEvaluator eval() on raw prediction (follow-up to #2535) Opened 7 days ago | AUTHENSOR | open | No labels | 0 | 0 | 7 days ago |
#2627 [Bug] ToxicEvaluator: expected_max_toxicity uses built-in max() on a NaN-containing array, so the metric depends on sample order Opened 9 days ago | IgorVoytyuk | open | No labels | 0 | 0 | 9 days ago |
#2615 OpenAI-compat: OpenAISDK openai_api_base /v1, not the requests OpenAI full-path default Opened 14 days ago | cursor[bot] | open | No labels | 0 | 0 | 14 days ago |
#2604 Feature request: EvalPort import/export for CustomDataset (adapter already built and tested) Opened 21 days ago | adhabnr-ux | open | No labels | 0 | 0 | 21 days ago |
#2485 [Feature] 集成 ELBench 作为 OpenCompass 的面向教育大模型的评测基准的一部分 Opened 3 months ago | Amber0614 | closed - completed | No labels | 1 | 0 | 27 days ago |
#2508 [Feature] DIK-structured Turkish syntactic dependency annotation dataset for structured linguistic evaluation Opened 2 months ago | nane100503-gif | open | No labels | 1 | 0 | 1 month ago |
#2574 CompassAcademic: 4 of 7 objective boards have an unseparated #1, two are exact ties broken by display order Opened 1 month ago | ipezygj | open | No labels | 1 | 0 | 1 month ago |
#2573 [Bug] Qwen3.5 cannot run when using HuggingFacewithChatTemplate Opened 1 month ago | hobbitlzy | open | No labels | 0 | 0 | 1 month ago |
#2437 [Feature] 支持原生多轮对话评测流程（MultiTurnInferencer） Opened 5 months ago | shuheng-mo | closed - completed | No labels | 1 | 0 | 1 month ago |
#1686 [Bug] The evaluation of configurations requiring a TopKRetriever, such as for flores_datasets, failed with a KeyError: 'metadata'. Opened 2 years ago | yqchen0205 | closed - completed | No labels | 3 | 0 | 1 month ago |
#2535 Return-value deception via __eq__ override: model can pass code-exec benchmarks without solving problems Opened 2 months ago | AUTHENSOR | closed - completed | No labels | 0 | 0 | 1 month ago |
#1930 [Bug] LiveCodeBench评测报错 Opened 2 years ago | AllenShow | closed - completed | No labels | 2 | 0 | 2 months ago |
#1608 [Bug] 评估wikitext ppl数据集时候由于没有reference无法计算结果 Opened 2 years ago | LanDisen | closed - completed | No labels | 4 | 0 | 2 months ago |
#2055 [Bug] livecodebench evaluator may need to check the memory footprint Opened 1 year ago | astly123456 | closed - completed | No labels | 1 | 0 | 2 months ago |
#1860 [Bug] 使用提示词攻击，出现导入模块失败 Opened 2 years ago | pomliuxj | closed - completed | No labels | 0 | 0 | 2 months ago |
#1928 [Bug] gpqa_gen数据集得出的结果很低 Opened 2 years ago | AllenShow | closed - completed | No labels | 2 | 0 | 2 months ago |
#2215 [Bug] 目前只有python3.10版本，3.11啥时候能支持 Opened 1 year ago | huskyisdog | closed - completed | No labels | 3 | 0 | 2 months ago |
#1913 [Bug] xunfei api 评测报错 Opened 2 years ago | wtlwang2019 | closed - completed | No labels | 3 | 0 | 2 months ago |
#1965 [Bug] configs/datasets/GaokaoBench/README.md 文档数据问题 Opened 1 year ago | yodhcn | closed - completed | No labels | 2 | 0 | 2 months ago |
#1984 [Bug] 最新版本的默认summarizer 会在平均分上产生冗余结果 Opened 1 year ago | linbeyoung | closed - completed | No labels | 2 | 0 | 2 months ago |
#2511 [Bug] gsm_hard没有数据？ Opened 2 months ago | yangyangyang127 | closed - completed | No labels | 1 | 0 | 2 months ago |
#2433 [Bug] vllm 推理会在代码里删除 bos Opened 5 months ago | suhmily10 | closed - completed | No labels | 0 | 0 | 2 months ago |
#1538 [Bug] mbpp_plus.jsonl 在哪里，下载的zip中没有这个东西 Opened 2 years ago | kkwhale7 | closed - completed | No labels | 3 | 1 | 2 months ago |
#1895 [Bug] Take too much time on MATH-500 dataset evaluation Opened 2 years ago | msz12345 | closed - completed | No labels | 5 | 0 | 2 months ago |
