1 hasil untuk "Lim, Soohan"
Menampilkan 1–1 · 0,15 detik · RSS
-
Preprint Teks lengkap
ContractEval: A Benchmark for Evaluating Contract-Satisfying Assertions in Code Generation
Current code generation evaluation measures functional correctness on well-formed inputs that satisfy all input preconditions. This paradigm has a critical limitation: task descriptions often leave these preconditions implicit, while evaluation filters out inputs that violate them. As a result…