Что думаешь? Оцени!
Гуменник рассказал о переживаниях перед финалом Гран-при России17:42
。关于这个话题,新收录的资料提供了深入分析
.pipeThrough(parse) // buffers filling...
Naive LLM judges are inconsistent. Run the same poem through twice and you get different scores (obviously, due to sampling). But lowering the temperature also doesn’t help much, as that’s only one of many technical issues. So, I developed a full scoring system, based on details on the logits outputs. It can get remarkably tricky. Think about a score from 1-10: