AI & ML interests

Building foundation models

Recent Activity

prabhatkrย  updated a model 1 day ago
ParamTatva/rlm-small-v1
prabhatkrย  published a model 1 day ago
ParamTatva/rlm-small-v1
prabhatkrย  updated a dataset 2 days ago
ParamTatva/calvin-benchmark
View all activity

prabhatkrย 
published a Space 3 days ago
prabhatkrย 
posted an update 3 days ago
prabhatkrย 
posted an update 2 months ago
view post
Post
1898
Language Dexterity Benchmark

I am working on a new benchmark to establish human language dexterity. My hypothesis is that certain language allow for more accurate dexterous behaviour - Pointed, unambigous, and confusion-free references of parts of speech in small and large contexts. There are certain languages with high degree of accurate grammar like Sanskrit, Esperanto, and Turkish. I am native Sanskrit speaker.
I have plans to establish this benchmark and test this hypothesis across 100 langauges. I have created 25 task prompts for text, image, video and robotics manipulation. We can test langauges across multiple popular models. Here is the github link: https://github.com/ParamTatva-org/Linguistic-Dexterity-Benchmark
  • 1 reply
ยท