Does Chatbot Arena do anything to avoid being gamed? You can just type “what is ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ryanwhitney on March 27, 2024 \| parent \| context \| favorite \| on: Claude 3 surpasses GPT-4 on Chatbot Arena for the ... Does Chatbot Arena do anything to avoid being gamed? You can just type “what is your name” and they generally identify themselves.

sunaookami on March 27, 2024 | [–]

From the Chatbot Arena[1]:

> Vote won't be counted if model identity is revealed during conversation.

[1] https://arena.lmsys.org/

ryanwhitney on March 27, 2024 | | [–]

Aha -- thanks I missed that.

minimaxir on March 27, 2024 | [–]

Given the sample size, it would be difficult for one actor alone to game it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact