The Generative Energy Arena (GEA): Incorporating Energy Awareness in Large Language Model (LLM) Human Evaluations
Paper
• 2507.13302 • Published
• 5
Universidad Politécnica de Madrid
university
Verified
AI & ML interests
Knowledge Management, Semantic Web, Natural Language Processing
Recent Activity
View all activity
javicond3
authored a paper 8 months ago
reviriego
authored a paper 8 months ago
javicond3
authored 5 papers about 1 year ago
Spanish and LLM Benchmarks: is MMLU Lost in Translation?
Paper
• 2406.17789 • Published
• 2
How Stable is Stable Diffusion under Recursive InPainting (RIP)?
Paper
• 2407.09549 • Published
• 1
Using large language models to estimate features of multi-word expressions: Concreteness, valence, arousal
Paper
• 2408.16012 • Published
Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?
Paper
• 2409.15334 • Published
• 1
Multiple Choice Questions: Reasoning Makes Large Language Models (LLMs) More Self-Confident Even When They Are Wrong
Paper
• 2501.09775 • Published
• 32
reviriego
authored a paper about 1 year ago
Post
2376
Major update on the Talking to Chatbots dataset! Expanded the 'wrapped' dataset (one row per chat) to 2.86k records, and the 'unwrapped' version (one row per conversation turn) to 11k records. The main source is my ChatGPT archive with nearly 2 years of chats. It is still a work in progress as I incorporate chats from other sources and qualitative metrics (SCBN) for responses.
reddgr/talking-to-chatbots-unwrapped-chats
reddgr/talking-to-chatbots-chats
reddgr/talking-to-chatbots-unwrapped-chats
reddgr/talking-to-chatbots-chats
Post
1897
Thought it would only make sense to share this here. Lately, one of my favorite activities has been annotating prompts and putting them into datasets ( reddgr/tl-test-learn-prompts reddgr/rq-request-question-prompts reddgr/nli-chatbot-prompt-categorization), which I then use to classify and select chatbot conversations for my website. It's quite fun to use this widget on the lmsys/lmsys-chat-1m, but I also use it on my 2 years of talking to chatbots (soon to be dataset, but still a lot of web scraping and ETL work left)... This one in the picture was probably one of the first prompts I wrote to an LLM: