AI & ML interests
RLHF, Model Evaluation, Benchmarks, Data Labeling, Human Feedback, Computer Vision, Image Generation, Video Generation, LLMs, Translations
Recent Activity
View all activity
Articles
Human judgements of LLM output: translation quality across 10+ languages and multilingual humour.
-
Rapidata/Translation-gpt4o_mini-v-gpt4o-v-deepl
Viewer • Updated • 373 • 97 • 16 -
Rapidata/Translation-deepseek-llama-mixtral-v-deepl
Viewer • Updated • 845 • 138 • 16 -
Rapidata/multilingual-llm-jokes-4o-claude-gemini
Viewer • Updated • 9.98k • 195 • 15 -
Rapidata/vlm-vs-crowd
Viewer • Updated • 325 • 133
Image-to-3D and LLM-written 3D scenes judged by people.
Human judgements of text-to-video and image-to-video models. Start with the consolidated 823k-vote set.
-
Rapidata/text-to-video-human-preferences-823k
Viewer • Updated • 47.2k • 63 • 6 -
Rapidata/image-to-video-physics-human-feedback-benchmark
Viewer • Updated • 22.6k • 3.62k • 5 -
Rapidata/physics-iq-verified
Viewer • Updated • 63.2k • 365 • 5 -
Rapidata/image-to-video-realism-human-feedback-benchmark
Viewer • Updated • 2.98k • 669 • 2
The vote data behind every live benchmark on benchmark.ai. One dataset per benchmark.
-
Rapidata/text-to-svg-human-feedback-benchmark
Viewer • Updated • 518k • 5.06k • 39 -
Rapidata/image-to-video-physics-human-feedback-benchmark
Viewer • Updated • 22.6k • 3.62k • 5 -
Rapidata/text-to-image-human-feedback-benchmark
Updated • 6.78k • 21 -
Rapidata/image-to-video-camera-movement-human-feedback-benchmark
Updated • 2.67k • 12
One dataset per launch. A new image model ships, we put it in front of thousands of people, and publish how it actually did against other SOTA models.
-
Rapidata/Runway_Frames_t2i_human_preferences
Viewer • Updated • 25.5k • 330 • 14 -
Rapidata/OpenAI-4o_t2i_human_preference
Viewer • Updated • 13k • 757 • 35 -
Rapidata/xAI_Aurora_t2i_human_preferences
Viewer • Updated • 26.2k • 214 • 15 -
Rapidata/Flux-2-pro_t2i_human_preference
Viewer • Updated • 44.9k • 977 • 15
The 2M+ annotations our first benchmarks were built on: Flux, SD3, Midjourney and DALL·E 3, split into preference, coherence and prompt alignment.
-
Rapidata/700k_Human_Preference_Dataset_FLUX_SD3_MJ_DALLE3
Viewer • Updated • 25.6k • 906 • 21 -
Rapidata/Flux_SD3_MJ_Dalle_Human_Alignment_Dataset
Viewer • Updated • 25.6k • 500 • 18 -
Rapidata/Flux_SD3_MJ_Dalle_Human_Coherence_Dataset
Viewer • Updated • 25.6k • 320 • 12 -
Rapidata/human-coherence-preferences-images
Viewer • Updated • 63.7k • 729 • 14
The raw material and the one-off runs including prompt sets, labeled image collections, and smaller studies.
Text-to-audio / TTS preference judgements (naturalness, friendliness) and audio association studies.
Text-to-image, SVG and face-generation preference data behind benchmark.ai/image and benchmark.ai/svg.
-
Rapidata/text-to-image-human-feedback-benchmark
Updated • 6.78k • 21 -
Text to Image Benchmark
🖼9Text to Image model benchmark, ranked by humans
-
Rapidata/text-to-svg-human-feedback-benchmark
Viewer • Updated • 518k • 5.06k • 39 -
SVG Generation Benchmark
🔺10SVG generation benchmark, ranked by humans
Generative models ranked by real people.
-
Rapidata Benchmarks
📊10Image, video and SVG model benchmarks, ranked by humans
-
Video Physics Benchmark
🧪10World models physics benchmark, ranked by humans
-
Camera Movement Benchmark
🎥8World models camera movement benchmark, ranked by humans
-
SVG Generation Benchmark
🔺10SVG generation benchmark, ranked by humans
1.5M responses from 152,684 people.
-
Rapidata/sora-video-generation-time-flow
Updated • 186 • 27 -
Rapidata/sora-video-generation-aligned-words
Updated • 249 • 28 -
Rapidata/sora-video-generation-alignment-likert-scoring
Viewer • Updated • 198 • 265 • 23 -
Rapidata/sora-video-generation-physics-likert-scoring
Viewer • Updated • 198 • 386 • 31
One dataset per launch, text-to-video and image-to-video. Veo, Sora, Kling, Pika, Seedance, ranked by real humans.
-
Rapidata/text-2-video-human-preferences
Viewer • Updated • 2.57k • 2.33k • 22 -
Rapidata/text-2-video-human-preferences-wan2.1
Viewer • Updated • 787 • 564 • 21 -
Rapidata/text-2-video-human-preferences-seedance-1-pro
Viewer • Updated • 1.09k • 1.26k • 9 -
Rapidata/text-2-video-human-preferences-veo3
Viewer • Updated • 1.02k • 1.28k • 21
What people think when no model is involved: where the future sits in your head, which sounds feel round, how our crowd compares to Prolific.
Human judgements of LLM output: translation quality across 10+ languages and multilingual humour.
-
Rapidata/Translation-gpt4o_mini-v-gpt4o-v-deepl
Viewer • Updated • 373 • 97 • 16 -
Rapidata/Translation-deepseek-llama-mixtral-v-deepl
Viewer • Updated • 845 • 138 • 16 -
Rapidata/multilingual-llm-jokes-4o-claude-gemini
Viewer • Updated • 9.98k • 195 • 15 -
Rapidata/vlm-vs-crowd
Viewer • Updated • 325 • 133
Text-to-audio / TTS preference judgements (naturalness, friendliness) and audio association studies.
Image-to-3D and LLM-written 3D scenes judged by people.
Text-to-image, SVG and face-generation preference data behind benchmark.ai/image and benchmark.ai/svg.
-
Rapidata/text-to-image-human-feedback-benchmark
Updated • 6.78k • 21 -
Text to Image Benchmark
🖼9Text to Image model benchmark, ranked by humans
-
Rapidata/text-to-svg-human-feedback-benchmark
Viewer • Updated • 518k • 5.06k • 39 -
SVG Generation Benchmark
🔺10SVG generation benchmark, ranked by humans
Human judgements of text-to-video and image-to-video models. Start with the consolidated 823k-vote set.
-
Rapidata/text-to-video-human-preferences-823k
Viewer • Updated • 47.2k • 63 • 6 -
Rapidata/image-to-video-physics-human-feedback-benchmark
Viewer • Updated • 22.6k • 3.62k • 5 -
Rapidata/physics-iq-verified
Viewer • Updated • 63.2k • 365 • 5 -
Rapidata/image-to-video-realism-human-feedback-benchmark
Viewer • Updated • 2.98k • 669 • 2
Generative models ranked by real people.
-
Rapidata Benchmarks
📊10Image, video and SVG model benchmarks, ranked by humans
-
Video Physics Benchmark
🧪10World models physics benchmark, ranked by humans
-
Camera Movement Benchmark
🎥8World models camera movement benchmark, ranked by humans
-
SVG Generation Benchmark
🔺10SVG generation benchmark, ranked by humans
The vote data behind every live benchmark on benchmark.ai. One dataset per benchmark.
-
Rapidata/text-to-svg-human-feedback-benchmark
Viewer • Updated • 518k • 5.06k • 39 -
Rapidata/image-to-video-physics-human-feedback-benchmark
Viewer • Updated • 22.6k • 3.62k • 5 -
Rapidata/text-to-image-human-feedback-benchmark
Updated • 6.78k • 21 -
Rapidata/image-to-video-camera-movement-human-feedback-benchmark
Updated • 2.67k • 12
1.5M responses from 152,684 people.
-
Rapidata/sora-video-generation-time-flow
Updated • 186 • 27 -
Rapidata/sora-video-generation-aligned-words
Updated • 249 • 28 -
Rapidata/sora-video-generation-alignment-likert-scoring
Viewer • Updated • 198 • 265 • 23 -
Rapidata/sora-video-generation-physics-likert-scoring
Viewer • Updated • 198 • 386 • 31
One dataset per launch. A new image model ships, we put it in front of thousands of people, and publish how it actually did against other SOTA models.
-
Rapidata/Runway_Frames_t2i_human_preferences
Viewer • Updated • 25.5k • 330 • 14 -
Rapidata/OpenAI-4o_t2i_human_preference
Viewer • Updated • 13k • 757 • 35 -
Rapidata/xAI_Aurora_t2i_human_preferences
Viewer • Updated • 26.2k • 214 • 15 -
Rapidata/Flux-2-pro_t2i_human_preference
Viewer • Updated • 44.9k • 977 • 15
One dataset per launch, text-to-video and image-to-video. Veo, Sora, Kling, Pika, Seedance, ranked by real humans.
-
Rapidata/text-2-video-human-preferences
Viewer • Updated • 2.57k • 2.33k • 22 -
Rapidata/text-2-video-human-preferences-wan2.1
Viewer • Updated • 787 • 564 • 21 -
Rapidata/text-2-video-human-preferences-seedance-1-pro
Viewer • Updated • 1.09k • 1.26k • 9 -
Rapidata/text-2-video-human-preferences-veo3
Viewer • Updated • 1.02k • 1.28k • 21
The 2M+ annotations our first benchmarks were built on: Flux, SD3, Midjourney and DALL·E 3, split into preference, coherence and prompt alignment.
-
Rapidata/700k_Human_Preference_Dataset_FLUX_SD3_MJ_DALLE3
Viewer • Updated • 25.6k • 906 • 21 -
Rapidata/Flux_SD3_MJ_Dalle_Human_Alignment_Dataset
Viewer • Updated • 25.6k • 500 • 18 -
Rapidata/Flux_SD3_MJ_Dalle_Human_Coherence_Dataset
Viewer • Updated • 25.6k • 320 • 12 -
Rapidata/human-coherence-preferences-images
Viewer • Updated • 63.7k • 729 • 14
What people think when no model is involved: where the future sits in your head, which sounds feel round, how our crowd compares to Prolific.
The raw material and the one-off runs including prompt sets, labeled image collections, and smaller studies.