{"by":"killiandunne1","descendants":7,"id":49190622,"kids":[49190849,49192464,49190707,49191548,49190648,49190654],"score":10,"text":"What if you could measure humor?<p>Well we&#x27;ve trained a model on our own dataset of ~50k human ratings to detect what jokes people find funniest. \nWe know it&#x27;s part objective, part subjective component. \nSubjective is out of our depth for now haha<p>The main results: Fable 5 is funniest - beating the average model 67% of the time, with GPT 4o last at 17%.<p>Other findings:\n - The models never refused to try, even with dark prompts\n - Thinking longer has a slight benefit\n - Absurdness correlates negatively with joke quality<p>Some methodology notes:\n - We benchmarked our model against the human majority and it agreed 72% of the time in a blind sample test.\n - We had 51 US adults rate the jokes, each blind to the models, with joke order randomized, and quality checked for attention and speed.\n - To rate some yourself visit <a href=\"https:&#x2F;&#x2F;pair.laugh.so\" rel=\"nofollow\">https:&#x2F;&#x2F;pair.laugh.so</a><p>The full benchmark here:<p><a href=\"https:&#x2F;&#x2F;laugh.so&#x2F;benchmark\" rel=\"nofollow\">https:&#x2F;&#x2F;laugh.so&#x2F;benchmark</a><p>Am taking requests if there&#x27;s more research you want to see! Cheers","time":1785973712,"title":"Show HN: Humor Arena – Which frontier model is funniest?","type":"story","url":"https://laugh.so/benchmark/"}