Repository Issue Activity (beta feature)

#

#318 Question: is there room for long horizon "spec tension" tests around complex code tasks?

#

#

#

#304 Unable to execute the MultiPL-E task for C++

#

#315 Wrong Hugging Face link for Spider dataset in bigcode-evaluation-harness/docs/README.md line 434

#

#311 Improve pass@1 Score on Humaneval

#313 Support configurability of FIM tokens on SantaCoder

#224 Multiple-E Go test file name suffix does not contain _test.go

#

#240 Some questions about APPS

#

#308 testing Humaneval of qwen-2.5-7B-coder-instruct

#307 how to add new model?

#306 When executing languages such as JS and GO in Multiple-E, the generated results suddenly end

#266 What is `fine-tuning` in task submission?

#

#303 Code-Llama-7B-Python 4 Bit Error on HumanEval

#300 is there a benchmark page on the benchmark results evaluated using bigcode-evaluation-harness

#

#131 'HumanEval' object has no attribute 'dataset'

#