Suggestion

#600
by drmcbride - opened

Include a column for sorting Nat intelligence to total param ratio. could be interesting to see especially with dense vs MOE

In this circumstance, I'd suggest just downloading the CSV, importing it into a spreadsheet tool like Excel, LibreOffice Calc, or Google Sheets, and examining that yourself - I do agree it would be an interesting metric, but I'd be reluctant to add that as a new column.

Yeah I'd also suggest playing around with the csv data in Files. Because the benchmarks don't really scale linearly, dividing them by parameter count would be kind of misleading. Like it gets harder and harder to get a higher score the closer you get to NatInt 100. With it being essentially impossible to get a 100 because of tests like predicting how a person will rate TV shows out of ten.

DontPlanToEnd changed discussion status to closed

Sign up or log in to comment