File size: 50,300 Bytes
61a25fe | 1 | {"project":"Multilingual ModelBench","version":"3.0","author":"Rodrigo Pantoja","source":"Research Retrieval Eval Mini v2, curated synthetic-adjacent evaluation cases","data_license":"CC BY 4.0","note":"Stored metric summaries and example-level rankings were calculated with Python scikit-learn on a small curated dataset. Browser dashboard displays them; it does not run neural models.","splits":{"monolingual":{"rows":[{"id":"es-01","language":"es","domain":"research","query":"¿Por qué debe documentarse la metodología de una investigación?","positive_passage":"Documentar la metodología permite que otras personas comprendan cómo se obtuvieron los resultados, evalúen los supuestos utilizados y reproduzcan, cuando sea posible, las principales etapas del estudio.","hard_negative":"Una conclusión convincente puede ser breve si resume el argumento principal sin introducir nuevas fuentes.","easy_negative":"Las presentaciones académicas suelen utilizar diapositivas para organizar el contenido visual."},{"id":"es-02","language":"es","domain":"education","query":"¿Qué riesgo existe al comparar indicadores educativos entre países?","positive_passage":"Las comparaciones internacionales de educación pueden ser engañosas cuando los países usan definiciones, coberturas o calendarios distintos; por eso deben revisarse los metadatos antes de interpretar diferencias.","hard_negative":"Los estudiantes pueden beneficiarse de calendarios de estudio que distribuyan las tareas durante la semana.","easy_negative":"La educación universitaria incluye actividades de docencia, investigación y extensión."},{"id":"es-03","language":"es","domain":"business","query":"¿Para qué sirve un análisis de sensibilidad en una decisión empresarial?","positive_passage":"El análisis de sensibilidad muestra cómo cambia una decisión cuando se modifican supuestos clave como precio, demanda, costos o tipo de cambio, ayudando a identificar qué variables generan mayor riesgo.","hard_negative":"Un plan de marketing puede incluir identidad visual, calendario de contenidos y elección de canales.","easy_negative":"Las empresas suelen utilizar reuniones para coordinar actividades internas."},{"id":"es-04","language":"es","domain":"latin-america","query":"¿Qué precaución debe tomarse al analizar datos económicos latinoamericanos?","positive_passage":"Al analizar datos económicos de América Latina conviene comprobar la fecha, la fuente, la moneda, la metodología y los cambios de serie antes de comparar países o construir tendencias regionales.","hard_negative":"Las capitales latinoamericanas concentran una parte importante de la actividad cultural y administrativa.","easy_negative":"El turismo regional incluye viajes de negocios y de ocio."},{"id":"es-05","language":"es","domain":"ai","query":"¿Por qué la similitud semántica no debe interpretarse como una prueba de verdad?","positive_passage":"La similitud semántica indica cercanía entre representaciones de texto, pero no verifica que una afirmación sea verdadera, actualizada o respaldada por una fuente confiable.","hard_negative":"Los modelos de lenguaje pueden producir texto fluido en diferentes estilos y extensiones.","easy_negative":"La inteligencia artificial se utiliza en múltiples industrias y aplicaciones."},{"id":"es-06","language":"es","domain":"research","query":"¿Qué ventaja tiene conservar citas por fragmento en un sistema RAG?","positive_passage":"Las citas por fragmento permiten rastrear cada afirmación hasta la evidencia recuperada, facilitan la revisión humana y hacen más transparente cuándo la respuesta depende de información insuficiente.","hard_negative":"Un resumen extractivo selecciona oraciones existentes del documento original.","easy_negative":"Los gestores bibliográficos ayudan a ordenar referencias y metadatos."},{"id":"es-07","language":"es","domain":"education","query":"¿Cómo puede utilizarse IA en escritura académica de forma responsable?","positive_passage":"Un uso responsable de IA en escritura académica exige transparencia sobre la herramienta utilizada, revisión humana, verificación de fuentes y respeto por las reglas de integridad de la institución.","hard_negative":"Los procesadores de texto permiten corregir formato y ortografía de documentos.","easy_negative":"La escritura académica suele emplear introducción, desarrollo y conclusión."},{"id":"es-08","language":"es","domain":"business","query":"¿Qué diferencia hay entre una métrica y un objetivo?","positive_passage":"Una métrica es una medida observada, mientras que un objetivo define el nivel o resultado que se desea alcanzar dentro de un plazo y contexto determinados.","hard_negative":"Los dashboards presentan indicadores mediante tablas, gráficos y filtros.","easy_negative":"Las organizaciones pueden utilizar distintos canales de comunicación."},{"id":"es-09","language":"es","domain":"latin-america","query":"¿Por qué deben mostrarse los datos faltantes en un dashboard regional?","positive_passage":"Mostrar los datos faltantes evita aparentar una cobertura inexistente y ayuda a distinguir una ausencia real de información de un valor igual a cero en las comparaciones regionales.","hard_negative":"Los mapas permiten ubicar países y ciudades en una visualización geográfica.","easy_negative":"Los dashboards pueden usar colores para diferenciar categorías."},{"id":"es-10","language":"es","domain":"ai","query":"¿Qué aporta un fallback lexical a un sistema de recuperación?","positive_passage":"Un fallback lexical mantiene disponible la búsqueda cuando el modelo de embeddings no puede cargarse y ofrece una ruta simple, interpretable y reproducible basada en coincidencias de términos.","hard_negative":"Los embeddings representan textos como vectores numéricos.","easy_negative":"Los sistemas de IA pueden combinar diferentes componentes de software."},{"id":"en-01","language":"en","domain":"research","query":"Why should a research workflow record data transformations?","positive_passage":"Recording data transformations creates an audit trail that shows how raw inputs became analytical outputs, making errors easier to detect and results easier to reproduce.","hard_negative":"A literature review can be organized chronologically or thematically depending on the research question.","easy_negative":"Researchers often use tables to summarize descriptive statistics."},{"id":"en-02","language":"en","domain":"education","query":"What makes cross-country education comparisons difficult?","positive_passage":"Cross-country education comparisons are difficult when indicators rely on different definitions, populations, reporting periods, or collection methods, so metadata must be checked before interpretation.","hard_negative":"Students may prefer different learning formats depending on schedule and access.","easy_negative":"Universities offer undergraduate and postgraduate programs."},{"id":"en-03","language":"en","domain":"business","query":"What is the purpose of scenario analysis in management?","positive_passage":"Scenario analysis tests how a decision performs under several plausible future conditions, helping managers understand uncertainty rather than relying on a single forecast.","hard_negative":"A business presentation may contain charts, recommendations, and an executive summary.","easy_negative":"Managers use meetings to communicate priorities."},{"id":"en-04","language":"en","domain":"latin-america","query":"Why is source consistency important in a Latin America dashboard?","positive_passage":"Source consistency matters because mixing indicators from different methodologies or revision cycles can create apparent regional differences that come from measurement rather than underlying conditions.","hard_negative":"Latin America includes countries with diverse languages, geographies, and economic structures.","easy_negative":"Regional dashboards often include maps."},{"id":"en-05","language":"en","domain":"ai","query":"Why are retrieval scores not equivalent to factual confidence?","positive_passage":"Retrieval scores estimate relevance between a query and candidate text; they do not establish whether the retrieved passage is correct, current, complete, or trustworthy.","hard_negative":"Language models generate outputs by predicting sequences of tokens.","easy_negative":"Machine learning systems use data and algorithms."},{"id":"en-06","language":"en","domain":"research","query":"What does chunk-level citation improve in document question answering?","positive_passage":"Chunk-level citation improves traceability by connecting answer statements to specific retrieved passages, allowing users to inspect the evidence and challenge unsupported synthesis.","hard_negative":"Document chunking divides long material into smaller units for processing.","easy_negative":"Citation styles differ across academic disciplines."},{"id":"en-07","language":"en","domain":"education","query":"How can generative AI be used responsibly in academic writing?","positive_passage":"Responsible academic use of generative AI requires human review, source verification, disclosure when required, and compliance with the institution’s integrity and authorship rules.","hard_negative":"Writing tools can help authors revise grammar and formatting.","easy_negative":"Academic essays usually contain structured sections."},{"id":"en-08","language":"en","domain":"business","query":"How does a KPI differ from a target?","positive_passage":"A KPI is a monitored performance measure, while a target specifies the desired level of that measure within a defined period or strategic context.","hard_negative":"Dashboards combine metrics, filters, and visualizations.","easy_negative":"Organizations track many types of operational data."},{"id":"en-09","language":"en","domain":"latin-america","query":"Why should missing values remain visible in regional analysis?","positive_passage":"Visible missing values prevent analysts from confusing absent observations with zero values and make differences in data coverage explicit across countries and years.","hard_negative":"Maps can communicate geographic patterns efficiently.","easy_negative":"Public datasets often contain country names and codes."},{"id":"en-10","language":"en","domain":"ai","query":"What is the benefit of a lexical fallback in semantic search?","positive_passage":"A lexical fallback keeps search operational when an embedding model is unavailable and provides an interpretable baseline based on direct term and phrase overlap.","hard_negative":"Embeddings encode text into vectors for similarity comparisons.","easy_negative":"Search systems may use indexes to improve retrieval speed."},{"id":"pt-01","language":"pt","domain":"research","query":"Por que uma pesquisa deve registrar as transformações feitas nos dados?","positive_passage":"Registrar as transformações dos dados cria uma trilha de auditoria que mostra como os dados brutos foram convertidos em resultados, facilitando a reprodução e a detecção de erros.","hard_negative":"Uma revisão de literatura pode organizar estudos por tema, período ou abordagem teórica.","easy_negative":"Pesquisadores costumam apresentar resultados em tabelas e gráficos."},{"id":"pt-02","language":"pt","domain":"education","query":"Qual é um risco de comparar indicadores educacionais entre países?","positive_passage":"Comparações educacionais podem ser distorcidas quando países adotam definições, populações, períodos ou métodos de coleta diferentes; por isso os metadados devem ser verificados.","hard_negative":"Estudantes podem escolher diferentes métodos de estudo conforme o tempo disponível.","easy_negative":"Universidades oferecem cursos em diversas áreas do conhecimento."},{"id":"pt-03","language":"pt","domain":"business","query":"Para que serve uma análise de cenários em gestão?","positive_passage":"A análise de cenários avalia como uma decisão se comporta em diferentes condições futuras plausíveis, permitindo que gestores considerem incerteza em vez de depender de uma única previsão.","hard_negative":"Uma apresentação empresarial pode incluir gráficos e recomendações.","easy_negative":"Gestores realizam reuniões para acompanhar projetos."},{"id":"pt-04","language":"pt","domain":"latin-america","query":"Por que a consistência das fontes é importante em um painel latino-americano?","positive_passage":"A consistência das fontes evita que diferenças de metodologia, revisão ou cobertura sejam confundidas com diferenças reais entre países da América Latina.","hard_negative":"A América Latina reúne países com grande diversidade econômica e cultural.","easy_negative":"Painéis regionais podem utilizar mapas interativos."},{"id":"pt-05","language":"pt","domain":"ai","query":"Por que uma pontuação de recuperação não representa confiança factual?","positive_passage":"Uma pontuação de recuperação estima a relevância entre consulta e texto, mas não prova que o conteúdo recuperado seja verdadeiro, atual, completo ou confiável.","hard_negative":"Modelos de linguagem geram texto a partir de padrões aprendidos.","easy_negative":"Sistemas de inteligência artificial podem apoiar diferentes atividades."},{"id":"pt-06","language":"pt","domain":"research","query":"Qual é a vantagem de citar o fragmento recuperado em um sistema de perguntas e respostas?","positive_passage":"A citação do fragmento melhora a rastreabilidade porque liga a resposta à evidência específica, permitindo revisão humana e identificação de sínteses sem suporte suficiente.","hard_negative":"Dividir documentos em fragmentos facilita o processamento de textos extensos.","easy_negative":"Normas de referência variam entre áreas acadêmicas."},{"id":"pt-07","language":"pt","domain":"education","query":"Como usar IA generativa de forma responsável na escrita acadêmica?","positive_passage":"O uso responsável de IA generativa na escrita acadêmica exige revisão humana, verificação das fontes, transparência quando exigida e respeito às normas de integridade e autoria da instituição.","hard_negative":"Ferramentas de escrita podem auxiliar na revisão de gramática e formatação.","easy_negative":"Textos acadêmicos costumam apresentar seções estruturadas."},{"id":"pt-08","language":"pt","domain":"business","query":"Qual é a diferença entre um indicador e uma meta?","positive_passage":"Um indicador mede o desempenho observado, enquanto uma meta define o nível desejado desse indicador em determinado prazo e contexto estratégico.","hard_negative":"Dashboards apresentam métricas por meio de gráficos e filtros.","easy_negative":"Empresas monitoram vários processos operacionais."},{"id":"pt-09","language":"pt","domain":"latin-america","query":"Por que valores ausentes devem aparecer em análises regionais?","positive_passage":"Manter valores ausentes visíveis evita confundir falta de informação com valor zero e torna explícitas as diferenças de cobertura entre países e períodos.","hard_negative":"Mapas ajudam a visualizar padrões geográficos.","easy_negative":"Bases públicas costumam usar códigos padronizados de países."},{"id":"pt-10","language":"pt","domain":"ai","query":"Qual é a utilidade de um fallback lexical em busca semântica?","positive_passage":"Um fallback lexical mantém a busca funcionando quando o modelo de embeddings não está disponível e oferece uma referência interpretável baseada em coincidência de termos e expressões.","hard_negative":"Embeddings representam textos como vetores numéricos.","easy_negative":"Mecanismos de busca podem combinar diferentes métodos de recuperação."}],"results":{"benchmark":"Research Retrieval Eval Mini","split":"monolingual","dataset_rows":30,"languages":["en","es","pt"],"language_pairs":[],"domains":["ai","business","education","latin-america","research"],"metrics":["accuracy_at_1","mrr","avg_latency_ms"],"models":[{"name":"char-tfidf","kind":"lexical","status":"executed","n":30,"accuracy_at_1":0.9666666666666667,"mrr":0.9833333333333333,"avg_latency_ms":1.4816202667740679,"load_seconds":null,"by_language":{"en":{"n":10,"accuracy_at_1":0.9,"mrr":0.95},"es":{"n":10,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":10,"accuracy_at_1":1.0,"mrr":1.0}},"by_domain":{"ai":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"latin-america":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666},"research":{"n":6,"accuracy_at_1":1.0,"mrr":1.0}},"by_language_pair":{},"metadata":{}},{"name":"word-tfidf","kind":"lexical","status":"executed","n":30,"accuracy_at_1":0.9333333333333333,"mrr":0.9666666666666667,"avg_latency_ms":0.8641812000557062,"load_seconds":null,"by_language":{"en":{"n":10,"accuracy_at_1":0.9,"mrr":0.95},"es":{"n":10,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":10,"accuracy_at_1":0.9,"mrr":0.95}},"by_domain":{"ai":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"latin-america":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666},"research":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666}},"by_language_pair":{},"metadata":{}},{"name":"hybrid-tfidf","kind":"lexical","status":"executed","n":30,"accuracy_at_1":0.9666666666666667,"mrr":0.9833333333333333,"avg_latency_ms":2.3350371333132593,"load_seconds":null,"by_language":{"en":{"n":10,"accuracy_at_1":0.9,"mrr":0.95},"es":{"n":10,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":10,"accuracy_at_1":1.0,"mrr":1.0}},"by_domain":{"ai":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"latin-america":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666},"research":{"n":6,"accuracy_at_1":1.0,"mrr":1.0}},"by_language_pair":{},"metadata":{}},{"name":"bm25","kind":"lexical","status":"executed","n":30,"accuracy_at_1":0.9,"mrr":0.95,"avg_latency_ms":0.0434317334414421,"load_seconds":null,"by_language":{"en":{"n":10,"accuracy_at_1":0.7,"mrr":0.85},"es":{"n":10,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":10,"accuracy_at_1":1.0,"mrr":1.0}},"by_domain":{"ai":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666},"latin-america":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666},"research":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.9166666666666666}},"by_language_pair":{},"metadata":{}},{"name":"multilingual-e5-small","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"intfloat/multilingual-e5-small","query_prefix":"query: ","passage_prefix":"passage: ","languages":94,"license":"MIT","role":"efficient multilingual retrieval model"}},{"name":"multilingual-minilm","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2","query_prefix":"","passage_prefix":"","languages":50,"license":"Apache-2.0","role":"compact multilingual sentence similarity baseline"}},{"name":"labse","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"sentence-transformers/LaBSE","query_prefix":"","passage_prefix":"","languages":110,"license":"Apache-2.0","role":"high-coverage multilingual embedding reference"}}],"interpretation_note":"This is a small diagnostic benchmark. Results should not be generalized to broader retrieval quality without larger external evaluation."},"case_results":{"char-tfidf":[{"id":"es-01","positive_rank":1,"scores":[0.1753521,0.056429,0.0142081]},{"id":"es-02","positive_rank":1,"scores":[0.1045852,0.0121956,0.038113]},{"id":"es-03","positive_rank":1,"scores":[0.282553,0.0624616,0.1117716]},{"id":"es-04","positive_rank":1,"scores":[0.2152538,0.1288232,0.0156227]},{"id":"es-05","positive_rank":1,"scores":[0.2681918,0.0156802,0.0461383]},{"id":"es-06","positive_rank":1,"scores":[0.1269845,0.0625832,0.006169]},{"id":"es-07","positive_rank":1,"scores":[0.2910825,0.0678462,0.1683202]},{"id":"es-08","positive_rank":1,"scores":[0.2229894,0.009201,0.0076495]},{"id":"es-09","positive_rank":1,"scores":[0.2705562,0.0344279,0.1388572]},{"id":"es-10","positive_rank":1,"scores":[0.163762,0.0037121,0.0931818]},{"id":"en-01","positive_rank":1,"scores":[0.2239371,0.0849489,0.0655181]},{"id":"en-02","positive_rank":1,"scores":[0.3891482,0.0319771,0.0051847]},{"id":"en-03","positive_rank":1,"scores":[0.1814769,0.022115,0.065641]},{"id":"en-04","positive_rank":2,"scores":[0.1442788,0.1434799,0.1676562]},{"id":"en-05","positive_rank":1,"scores":[0.1921995,0.0257485,0.0]},{"id":"en-06","positive_rank":1,"scores":[0.2324794,0.1504903,0.0972576]},{"id":"en-07","positive_rank":1,"scores":[0.2628528,0.146445,0.1189773]},{"id":"en-08","positive_rank":1,"scores":[0.1061157,0.0,0.0052417]},{"id":"en-09","positive_rank":1,"scores":[0.271046,0.0,0.0259713]},{"id":"en-10","positive_rank":1,"scores":[0.1855254,0.0024044,0.056816]},{"id":"pt-01","positive_rank":1,"scores":[0.3309823,0.0621245,0.1246788]},{"id":"pt-02","positive_rank":1,"scores":[0.2281843,0.0207629,0.0064616]},{"id":"pt-03","positive_rank":1,"scores":[0.2731803,0.037526,0.0964358]},{"id":"pt-04","positive_rank":1,"scores":[0.228304,0.052561,0.0494842]},{"id":"pt-05","positive_rank":1,"scores":[0.3645364,0.0196176,0.0139053]},{"id":"pt-06","positive_rank":1,"scores":[0.144988,0.1084548,0.0323406]},{"id":"pt-07","positive_rank":1,"scores":[0.3544035,0.1555239,0.0862802]},{"id":"pt-08","positive_rank":1,"scores":[0.2411719,0.0226673,0.0]},{"id":"pt-09","positive_rank":1,"scores":[0.1675507,0.0111668,0.0173374]},{"id":"pt-10","positive_rank":1,"scores":[0.2099735,0.0039919,0.0685742]}],"word-tfidf":[{"id":"es-01","positive_rank":1,"scores":[0.0667789,0.0297217,0.0]},{"id":"es-02","positive_rank":1,"scores":[0.0219931,0.0,0.0]},{"id":"es-03","positive_rank":1,"scores":[0.194209,0.0718369,0.0373947]},{"id":"es-04","positive_rank":1,"scores":[0.161332,0.0,0.0]},{"id":"es-05","positive_rank":1,"scores":[0.1901108,0.0190317,0.0221187]},{"id":"es-06","positive_rank":1,"scores":[0.1010449,0.0352294,0.0]},{"id":"es-07","positive_rank":1,"scores":[0.1964509,0.0421561,0.0888368]},{"id":"es-08","positive_rank":1,"scores":[0.1906935,0.0,0.0]},{"id":"es-09","positive_rank":1,"scores":[0.131791,0.0387468,0.0170911]},{"id":"es-10","positive_rank":1,"scores":[0.1594934,0.0,0.0426918]},{"id":"en-01","positive_rank":1,"scores":[0.0782995,0.0369621,0.0]},{"id":"en-02","positive_rank":1,"scores":[0.2341763,0.0,0.0]},{"id":"en-03","positive_rank":1,"scores":[0.0745052,0.0,0.0]},{"id":"en-04","positive_rank":2,"scores":[0.0698747,0.1090161,0.0]},{"id":"en-05","positive_rank":1,"scores":[0.0962304,0.0,0.0]},{"id":"en-06","positive_rank":1,"scores":[0.1076416,0.0354449,0.0310754]},{"id":"en-07","positive_rank":1,"scores":[0.0852104,0.0768024,0.0310754]},{"id":"en-08","positive_rank":1,"scores":[0.0624146,0.0,0.0]},{"id":"en-09","positive_rank":1,"scores":[0.138761,0.0,0.0]},{"id":"en-10","positive_rank":1,"scores":[0.1053906,0.0,0.0244708]},{"id":"pt-01","positive_rank":1,"scores":[0.1856759,0.0507538,0.0]},{"id":"pt-02","positive_rank":1,"scores":[0.0636242,0.0250555,0.0]},{"id":"pt-03","positive_rank":1,"scores":[0.2393525,0.0316199,0.0530955]},{"id":"pt-04","positive_rank":1,"scores":[0.1403454,0.0,0.0]},{"id":"pt-05","positive_rank":1,"scores":[0.2212427,0.0300895,0.0184614]},{"id":"pt-06","positive_rank":2,"scores":[0.039412,0.0592275,0.0287047]},{"id":"pt-07","positive_rank":1,"scores":[0.231365,0.0967247,0.0]},{"id":"pt-08","positive_rank":1,"scores":[0.2214696,0.0,0.0]},{"id":"pt-09","positive_rank":1,"scores":[0.0747118,0.0,0.0]},{"id":"pt-10","positive_rank":1,"scores":[0.20501,0.0,0.0755429]}],"hybrid-tfidf":[{"id":"es-01","positive_rank":1,"scores":[0.1319228,0.0457461,0.0085248]},{"id":"es-02","positive_rank":1,"scores":[0.0715484,0.0073173,0.0228678]},{"id":"es-03","positive_rank":1,"scores":[0.2472154,0.0662117,0.0820209]},{"id":"es-04","positive_rank":1,"scores":[0.1936851,0.0772939,0.0093736]},{"id":"es-05","positive_rank":1,"scores":[0.2369594,0.0170208,0.0365304]},{"id":"es-06","positive_rank":1,"scores":[0.1166087,0.0516417,0.0037014]},{"id":"es-07","positive_rank":1,"scores":[0.2532299,0.0575701,0.1365269]},{"id":"es-08","positive_rank":1,"scores":[0.2100711,0.0055206,0.0045897]},{"id":"es-09","positive_rank":1,"scores":[0.2150501,0.0361555,0.0901507]},{"id":"es-10","positive_rank":1,"scores":[0.1620546,0.0022273,0.0729858]},{"id":"en-01","positive_rank":1,"scores":[0.1656821,0.0657542,0.0393108]},{"id":"en-02","positive_rank":1,"scores":[0.3271594,0.0191863,0.0031108]},{"id":"en-03","positive_rank":1,"scores":[0.1386882,0.013269,0.0393846]},{"id":"en-04","positive_rank":2,"scores":[0.1145172,0.1296944,0.1005937]},{"id":"en-05","positive_rank":1,"scores":[0.1538119,0.0154491,0.0]},{"id":"en-06","positive_rank":1,"scores":[0.1825443,0.1044721,0.0707847]},{"id":"en-07","positive_rank":1,"scores":[0.1917959,0.1185879,0.0838165]},{"id":"en-08","positive_rank":1,"scores":[0.0886352,0.0,0.003145]},{"id":"en-09","positive_rank":1,"scores":[0.218132,0.0,0.0155828]},{"id":"en-10","positive_rank":1,"scores":[0.1534715,0.0014426,0.043878]},{"id":"pt-01","positive_rank":1,"scores":[0.2728597,0.0575762,0.0748073]},{"id":"pt-02","positive_rank":1,"scores":[0.1623602,0.0224799,0.003877]},{"id":"pt-03","positive_rank":1,"scores":[0.2596491,0.0351636,0.0790997]},{"id":"pt-04","positive_rank":1,"scores":[0.1931206,0.0315366,0.0296905]},{"id":"pt-05","positive_rank":1,"scores":[0.3072189,0.0238063,0.0157277]},{"id":"pt-06","positive_rank":1,"scores":[0.1027576,0.0887639,0.0308862]},{"id":"pt-07","positive_rank":1,"scores":[0.3051881,0.1320043,0.0517681]},{"id":"pt-08","positive_rank":1,"scores":[0.2332909,0.0136004,0.0]},{"id":"pt-09","positive_rank":1,"scores":[0.1304151,0.0067001,0.0104024]},{"id":"pt-10","positive_rank":1,"scores":[0.2079881,0.0023952,0.0713617]}],"bm25":[{"id":"es-01","positive_rank":1,"scores":[1.5848765,1.0523067,0.0]},{"id":"es-02","positive_rank":1,"scores":[0.7840603,0.0,0.0]},{"id":"es-03","positive_rank":1,"scores":[4.3253657,1.8777536,1.2655861]},{"id":"es-04","positive_rank":1,"scores":[2.9854386,0.0,0.0]},{"id":"es-05","positive_rank":1,"scores":[5.1206546,0.5089901,0.5613766]},{"id":"es-06","positive_rank":1,"scores":[2.1635939,1.1961332,0.0]},{"id":"es-07","positive_rank":1,"scores":[3.6156534,0.7501687,1.1780142]},{"id":"es-08","positive_rank":1,"scores":[4.0010025,0.5645295,0.0]},{"id":"es-09","positive_rank":1,"scores":[2.61843,0.6969569,0.1712408]},{"id":"es-10","positive_rank":1,"scores":[3.3476739,0.0,0.7520058]},{"id":"en-01","positive_rank":2,"scores":[1.5469455,2.0602894,0.0]},{"id":"en-02","positive_rank":1,"scores":[3.623116,0.0,0.0]},{"id":"en-03","positive_rank":1,"scores":[1.4791016,0.0,0.0]},{"id":"en-04","positive_rank":2,"scores":[1.4285613,2.1504812,0.0]},{"id":"en-05","positive_rank":1,"scores":[2.1635939,0.0,0.0]},{"id":"en-06","positive_rank":1,"scores":[1.8063776,1.0944876,0.6203094]},{"id":"en-07","positive_rank":2,"scores":[1.7610924,2.2769251,0.6203094]},{"id":"en-08","positive_rank":1,"scores":[4.3643747,0.0,0.0]},{"id":"en-09","positive_rank":1,"scores":[3.2145284,0.0,0.0]},{"id":"en-10","positive_rank":1,"scores":[3.2780008,0.0,0.5553357]},{"id":"pt-01","positive_rank":1,"scores":[4.4642277,1.5975463,0.0]},{"id":"pt-02","positive_rank":1,"scores":[1.8860537,0.5201621,0.0]},{"id":"pt-03","positive_rank":1,"scores":[4.9055422,0.5823054,1.3203471]},{"id":"pt-04","positive_rank":1,"scores":[3.3497459,0.5049626,0.0]},{"id":"pt-05","positive_rank":1,"scores":[3.8122966,0.2100494,0.1654371]},{"id":"pt-06","positive_rank":1,"scores":[3.0377597,2.5347454,0.3421742]},{"id":"pt-07","positive_rank":1,"scores":[4.0239382,1.8025707,0.0]},{"id":"pt-08","positive_rank":1,"scores":[3.6237635,0.5238894,0.0]},{"id":"pt-09","positive_rank":1,"scores":[1.4120888,0.0,0.0]},{"id":"pt-10","positive_rank":1,"scores":[4.3074287,0.0,1.3185116]}]}},"cross-language":{"rows":[{"id":"x-es-en-01","query_language":"es","passage_language":"en","domain":"research","query":"¿Por qué es importante conservar una trazabilidad de las transformaciones realizadas sobre los datos?","positive_passage":"Keeping an audit trail of data transformations shows how raw inputs became analytical outputs, making errors easier to detect and results easier to reproduce.","hard_negative":"A literature review can group previous studies by theory, method, chronology, or research theme.","easy_negative":"Academic presentations often use charts and tables to summarize information."},{"id":"x-es-en-02","query_language":"es","passage_language":"en","domain":"ai","query":"¿Qué ventaja aporta citar fragmentos concretos en un sistema RAG?","positive_passage":"Chunk-level citations connect generated statements to specific retrieved evidence, allowing users to inspect the source and identify unsupported synthesis.","hard_negative":"Document chunking divides long texts into smaller units that are easier for retrieval systems to process.","easy_negative":"Artificial intelligence systems may combine several software components."},{"id":"x-es-en-03","query_language":"es","passage_language":"en","domain":"business","query":"¿Para qué sirve analizar escenarios alternativos antes de tomar una decisión empresarial?","positive_passage":"Scenario analysis evaluates how a decision performs under several plausible future conditions, helping managers reason about uncertainty instead of relying on one forecast.","hard_negative":"Business dashboards can combine financial indicators, filters, tables, and charts for management reporting.","easy_negative":"Companies use meetings to coordinate teams and projects."},{"id":"x-en-es-01","query_language":"en","passage_language":"es","domain":"education","query":"Why must metadata be checked before comparing education indicators across countries?","positive_passage":"Los metadatos permiten verificar definiciones, población cubierta, periodos y métodos de recolección; sin esa revisión, una comparación internacional puede atribuir a la realidad diferencias que provienen de la medición.","hard_negative":"Los estudiantes pueden utilizar distintas estrategias de estudio según el tiempo disponible y el tipo de evaluación.","easy_negative":"Las universidades ofrecen programas de grado y posgrado en múltiples disciplinas."},{"id":"x-en-es-02","query_language":"en","passage_language":"es","domain":"latin-america","query":"Why should missing values remain visible in a regional Latin America dashboard?","positive_passage":"Mantener visibles los valores ausentes evita confundir falta de información con valor cero y hace explícitas las diferencias de cobertura entre países y años.","hard_negative":"Los mapas regionales permiten observar patrones geográficos y comparar la distribución espacial de indicadores.","easy_negative":"América Latina incluye países con estructuras económicas y sociales diversas."},{"id":"x-en-es-03","query_language":"en","passage_language":"es","domain":"ai","query":"Why is semantic similarity not the same thing as factual confidence?","positive_passage":"La similitud semántica estima cercanía entre representaciones de texto, pero no demuestra que una afirmación sea verdadera, actual, completa ni respaldada por una fuente confiable.","hard_negative":"Los embeddings convierten textos en representaciones numéricas que pueden compararse mediante medidas de distancia o similitud.","easy_negative":"La inteligencia artificial se aplica en numerosos sectores productivos."},{"id":"x-pt-en-01","query_language":"pt","passage_language":"en","domain":"research","query":"Por que uma pesquisa deve registrar as decisões metodológicas tomadas durante a análise?","positive_passage":"Documenting methodological decisions creates a transparent record of how the study was conducted, helping reviewers evaluate assumptions and making later replication more feasible.","hard_negative":"A research abstract usually summarizes the objective, method, main findings, and conclusion of a study.","easy_negative":"Researchers often organize references with bibliography software."},{"id":"x-pt-en-02","query_language":"pt","passage_language":"en","domain":"business","query":"Qual é a utilidade de uma análise de sensibilidade em planejamento empresarial?","positive_passage":"Sensitivity analysis shows how an outcome changes when key assumptions such as price, demand, cost, or exchange rates vary, revealing which variables drive the greatest uncertainty.","hard_negative":"Marketing plans commonly define audiences, channels, messages, and campaign calendars.","easy_negative":"Organizations can use several communication channels internally."},{"id":"x-pt-en-03","query_language":"pt","passage_language":"en","domain":"ai","query":"Por que um fallback lexical pode ser útil em um sistema de busca semântica?","positive_passage":"A lexical fallback keeps retrieval available when an embedding model cannot load and provides a simple, interpretable baseline based on direct term or phrase overlap.","hard_negative":"Embedding models encode text into vectors so that semantic similarity can be estimated numerically.","easy_negative":"Search systems often create indexes to speed up retrieval."},{"id":"x-en-pt-01","query_language":"en","passage_language":"pt","domain":"research","query":"What does chunk-level citation improve in research question answering?","positive_passage":"A citação em nível de fragmento melhora a rastreabilidade ao ligar a resposta à evidência recuperada específica, permitindo revisão humana e identificação de sínteses sem suporte.","hard_negative":"A divisão de documentos em fragmentos facilita o processamento e a recuperação de textos extensos.","easy_negative":"Normas de referência bibliográfica variam entre áreas acadêmicas."},{"id":"x-en-pt-02","query_language":"en","passage_language":"pt","domain":"business","query":"How is a performance indicator different from a target?","positive_passage":"Um indicador mede o desempenho observado, enquanto uma meta define o nível desejado desse indicador em um prazo e contexto estratégico específicos.","hard_negative":"Dashboards empresariais apresentam métricas por meio de gráficos, tabelas e filtros interativos.","easy_negative":"Empresas acompanham diferentes processos operacionais ao longo do tempo."},{"id":"x-en-pt-03","query_language":"en","passage_language":"pt","domain":"education","query":"How can generative AI be used responsibly in academic writing?","positive_passage":"O uso responsável de IA generativa na escrita acadêmica exige revisão humana, verificação das fontes, transparência quando exigida e respeito às regras institucionais de integridade e autoria.","hard_negative":"Ferramentas de escrita podem auxiliar na correção gramatical, formatação e organização de documentos.","easy_negative":"Textos acadêmicos normalmente apresentam uma estrutura organizada em seções."},{"id":"x-es-pt-01","query_language":"es","passage_language":"pt","domain":"latin-america","query":"¿Por qué debe mantenerse consistencia entre las fuentes de un dashboard latinoamericano?","positive_passage":"A consistência das fontes evita que diferenças de metodologia, cobertura ou ciclos de revisão sejam confundidas com diferenças reais entre países da América Latina.","hard_negative":"Painéis regionais podem utilizar mapas e filtros para facilitar a comparação entre países.","easy_negative":"A América Latina apresenta grande diversidade econômica, social e geográfica."},{"id":"x-es-pt-02","query_language":"es","passage_language":"pt","domain":"research","query":"¿Qué aporta documentar las transformaciones realizadas sobre datos de investigación?","positive_passage":"Registrar as transformações dos dados cria uma trilha de auditoria que explica como os dados brutos foram convertidos em resultados, facilitando reprodução e detecção de erros.","hard_negative":"Uma revisão de literatura pode organizar estudos anteriores por tema, método ou período.","easy_negative":"Pesquisadores apresentam resultados em gráficos e tabelas."},{"id":"x-es-pt-03","query_language":"es","passage_language":"pt","domain":"ai","query":"¿Por qué una puntuación de recuperación no equivale a confianza factual?","positive_passage":"Uma pontuação de recuperação estima relevância entre consulta e texto, mas não prova que o conteúdo recuperado seja verdadeiro, atual, completo ou confiável.","hard_negative":"Modelos de linguagem geram texto a partir de padrões aprendidos durante o treinamento.","easy_negative":"Sistemas de inteligência artificial podem apoiar diferentes atividades."},{"id":"x-pt-es-01","query_language":"pt","passage_language":"es","domain":"business","query":"Para que serve testar cenários diferentes antes de uma decisão gerencial?","positive_passage":"El análisis de escenarios permite observar cómo se comporta una decisión bajo distintas condiciones futuras plausibles y ayuda a gestionar incertidumbre sin depender de una única proyección.","hard_negative":"Un dashboard ejecutivo puede combinar indicadores, gráficos, tablas y filtros para facilitar el seguimiento del negocio.","easy_negative":"Las organizaciones realizan reuniones para coordinar tareas y prioridades."},{"id":"x-pt-es-02","query_language":"pt","passage_language":"es","domain":"education","query":"Qual é o risco de comparar educação entre países sem revisar os metadados?","positive_passage":"Comparar indicadores educativos sin revisar metadatos puede confundir diferencias de definición, población, periodo o método de recolección con diferencias reales entre los sistemas educativos.","hard_negative":"Los estudiantes pueden organizar sus actividades mediante calendarios y técnicas de estudio.","easy_negative":"Las universidades desarrollan docencia, investigación y extensión."},{"id":"x-pt-es-03","query_language":"pt","passage_language":"es","domain":"ai","query":"Por que a similaridade semântica não demonstra que uma afirmação é verdadeira?","positive_passage":"La similitud semántica refleja cercanía entre representaciones de texto, pero no verifica si una afirmación es correcta, vigente, completa o respaldada por evidencia confiable.","hard_negative":"Los embeddings representan textos mediante vectores numéricos que permiten calcular similitudes.","easy_negative":"La inteligencia artificial se utiliza en distintos sectores económicos."}],"results":{"benchmark":"Research Retrieval Eval Mini","split":"cross-language","dataset_rows":18,"languages":["en","es","pt"],"language_pairs":["en->es","en->pt","es->en","es->pt","pt->en","pt->es"],"domains":["ai","business","education","latin-america","research"],"metrics":["accuracy_at_1","mrr","avg_latency_ms"],"models":[{"name":"char-tfidf","kind":"lexical","status":"executed","n":18,"accuracy_at_1":0.9444444444444444,"mrr":0.9629629629629629,"avg_latency_ms":1.5905663333089453,"load_seconds":null,"by_language":{"en":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.8888888888888888},"es":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":6,"accuracy_at_1":1.0,"mrr":1.0}},"by_domain":{"ai":{"n":5,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":4,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"latin-america":{"n":2,"accuracy_at_1":0.5,"mrr":0.6666666666666666},"research":{"n":4,"accuracy_at_1":1.0,"mrr":1.0}},"by_language_pair":{"en->es":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.7777777777777778},"en->pt":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"es->en":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"es->pt":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"pt->en":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"pt->es":{"n":3,"accuracy_at_1":1.0,"mrr":1.0}},"metadata":{}},{"name":"word-tfidf","kind":"lexical","status":"executed","n":18,"accuracy_at_1":0.2777777777777778,"mrr":0.5277777777777778,"avg_latency_ms":0.9695943333806807,"load_seconds":null,"by_language":{"en":{"n":6,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es":{"n":6,"accuracy_at_1":0.3333333333333333,"mrr":0.5555555555555555},"pt":{"n":6,"accuracy_at_1":0.5,"mrr":0.6944444444444445}},"by_domain":{"ai":{"n":5,"accuracy_at_1":0.2,"mrr":0.5},"business":{"n":4,"accuracy_at_1":0.25,"mrr":0.5},"education":{"n":3,"accuracy_at_1":0.3333333333333333,"mrr":0.5555555555555555},"latin-america":{"n":2,"accuracy_at_1":0.5,"mrr":0.6666666666666666},"research":{"n":4,"accuracy_at_1":0.25,"mrr":0.5}},"by_language_pair":{"en->es":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"en->pt":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es->en":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es->pt":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.7777777777777778},"pt->en":{"n":3,"accuracy_at_1":0.3333333333333333,"mrr":0.5555555555555555},"pt->es":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.8333333333333334}},"metadata":{}},{"name":"hybrid-tfidf","kind":"lexical","status":"executed","n":18,"accuracy_at_1":0.9444444444444444,"mrr":0.9629629629629629,"avg_latency_ms":2.3718803888894198,"load_seconds":null,"by_language":{"en":{"n":6,"accuracy_at_1":0.8333333333333334,"mrr":0.8888888888888888},"es":{"n":6,"accuracy_at_1":1.0,"mrr":1.0},"pt":{"n":6,"accuracy_at_1":1.0,"mrr":1.0}},"by_domain":{"ai":{"n":5,"accuracy_at_1":1.0,"mrr":1.0},"business":{"n":4,"accuracy_at_1":1.0,"mrr":1.0},"education":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"latin-america":{"n":2,"accuracy_at_1":0.5,"mrr":0.6666666666666666},"research":{"n":4,"accuracy_at_1":1.0,"mrr":1.0}},"by_language_pair":{"en->es":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.7777777777777778},"en->pt":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"es->en":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"es->pt":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"pt->en":{"n":3,"accuracy_at_1":1.0,"mrr":1.0},"pt->es":{"n":3,"accuracy_at_1":1.0,"mrr":1.0}},"metadata":{}},{"name":"bm25","kind":"lexical","status":"executed","n":18,"accuracy_at_1":0.2777777777777778,"mrr":0.537037037037037,"avg_latency_ms":0.051118666811412874,"load_seconds":null,"by_language":{"en":{"n":6,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es":{"n":6,"accuracy_at_1":0.3333333333333333,"mrr":0.5555555555555555},"pt":{"n":6,"accuracy_at_1":0.5,"mrr":0.7222222222222222}},"by_domain":{"ai":{"n":5,"accuracy_at_1":0.2,"mrr":0.5},"business":{"n":4,"accuracy_at_1":0.25,"mrr":0.5},"education":{"n":3,"accuracy_at_1":0.3333333333333333,"mrr":0.5555555555555555},"latin-america":{"n":2,"accuracy_at_1":0.5,"mrr":0.6666666666666666},"research":{"n":4,"accuracy_at_1":0.25,"mrr":0.5416666666666666}},"by_language_pair":{"en->es":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"en->pt":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es->en":{"n":3,"accuracy_at_1":0.0,"mrr":0.3333333333333333},"es->pt":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.7777777777777778},"pt->en":{"n":3,"accuracy_at_1":0.3333333333333333,"mrr":0.611111111111111},"pt->es":{"n":3,"accuracy_at_1":0.6666666666666666,"mrr":0.8333333333333334}},"metadata":{}},{"name":"multilingual-e5-small","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"intfloat/multilingual-e5-small","query_prefix":"query: ","passage_prefix":"passage: ","languages":94,"license":"MIT","role":"efficient multilingual retrieval model"}},{"name":"multilingual-minilm","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2","query_prefix":"","passage_prefix":"","languages":50,"license":"Apache-2.0","role":"compact multilingual sentence similarity baseline"}},{"name":"labse","kind":"semantic","status":"configured-not-executed","n":0,"accuracy_at_1":null,"mrr":null,"avg_latency_ms":null,"load_seconds":null,"by_language":{},"by_domain":{},"metadata":{"repo_id":"sentence-transformers/LaBSE","query_prefix":"","passage_prefix":"","languages":110,"license":"Apache-2.0","role":"high-coverage multilingual embedding reference"}}],"interpretation_note":"This is a small diagnostic benchmark. Results should not be generalized to broader retrieval quality without larger external evaluation."},"case_results":{"char-tfidf":[{"id":"x-es-en-01","positive_rank":1,"scores":[0.0807738,0.0125952,0.0236828]},{"id":"x-es-en-02","positive_rank":1,"scores":[0.0502601,0.0238225,0.0157694]},{"id":"x-es-en-03","positive_rank":1,"scores":[0.0934321,0.0162659,0.0146025]},{"id":"x-en-es-01","positive_rank":1,"scores":[0.0751076,0.0,0.0]},{"id":"x-en-es-02","positive_rank":3,"scores":[0.0636219,0.0743283,0.0696267]},{"id":"x-en-es-03","positive_rank":1,"scores":[0.0909874,0.0461703,0.0141567]},{"id":"x-pt-en-01","positive_rank":1,"scores":[0.0637187,0.0243217,0.0045759]},{"id":"x-pt-en-02","positive_rank":1,"scores":[0.0330784,0.026593,0.0105933]},{"id":"x-pt-en-03","positive_rank":1,"scores":[0.1292425,0.0617772,0.0217566]},{"id":"x-en-pt-01","positive_rank":1,"scores":[0.0357486,0.011103,0.0018188]},{"id":"x-en-pt-02","positive_rank":1,"scores":[0.0683442,0.0182084,0.0661012]},{"id":"x-en-pt-03","positive_rank":1,"scores":[0.1473545,0.0095871,0.0249959]},{"id":"x-es-pt-01","positive_rank":1,"scores":[0.1553526,0.036546,0.0510761]},{"id":"x-es-pt-02","positive_rank":1,"scores":[0.1056694,0.0259098,0.0287011]},{"id":"x-es-pt-03","positive_rank":1,"scores":[0.1484294,0.0151267,0.0053964]},{"id":"x-pt-es-01","positive_rank":1,"scores":[0.078413,0.040652,0.0393483]},{"id":"x-pt-es-02","positive_rank":1,"scores":[0.2401088,0.0240584,0.0103988]},{"id":"x-pt-es-03","positive_rank":1,"scores":[0.1223194,0.0657905,0.0047126]}],"word-tfidf":[{"id":"x-es-en-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-en-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-en-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-pt-en-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-pt-en-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-pt-en-03","positive_rank":1,"scores":[0.0362072,0.0,0.0]},{"id":"x-en-pt-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-pt-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-pt-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-pt-01","positive_rank":1,"scores":[0.0473426,0.0195815,0.0]},{"id":"x-es-pt-02","positive_rank":1,"scores":[0.0232308,0.0193717,0.0]},{"id":"x-es-pt-03","positive_rank":3,"scores":[0.0100862,0.0244878,0.0168629]},{"id":"x-pt-es-01","positive_rank":1,"scores":[0.0335026,0.0171949,0.0239833]},{"id":"x-pt-es-02","positive_rank":1,"scores":[0.0873419,0.0207366,0.0]},{"id":"x-pt-es-03","positive_rank":2,"scores":[0.0217837,0.0540243,0.0]}],"hybrid-tfidf":[{"id":"x-es-en-01","positive_rank":1,"scores":[0.0484643,0.0075571,0.0142097]},{"id":"x-es-en-02","positive_rank":1,"scores":[0.0301561,0.0142935,0.0094616]},{"id":"x-es-en-03","positive_rank":1,"scores":[0.0560593,0.0097595,0.0087615]},{"id":"x-en-es-01","positive_rank":1,"scores":[0.0450646,0.0,0.0]},{"id":"x-en-es-02","positive_rank":3,"scores":[0.0381731,0.044597,0.041776]},{"id":"x-en-es-03","positive_rank":1,"scores":[0.0545924,0.0277022,0.008494]},{"id":"x-pt-en-01","positive_rank":1,"scores":[0.0382312,0.014593,0.0027455]},{"id":"x-pt-en-02","positive_rank":1,"scores":[0.0198471,0.0159558,0.006356]},{"id":"x-pt-en-03","positive_rank":1,"scores":[0.0920284,0.0370663,0.013054]},{"id":"x-en-pt-01","positive_rank":1,"scores":[0.0214492,0.0066618,0.0010913]},{"id":"x-en-pt-02","positive_rank":1,"scores":[0.0410065,0.010925,0.0396607]},{"id":"x-en-pt-03","positive_rank":1,"scores":[0.0884127,0.0057522,0.0149975]},{"id":"x-es-pt-01","positive_rank":1,"scores":[0.1121486,0.0297602,0.0306457]},{"id":"x-es-pt-02","positive_rank":1,"scores":[0.072694,0.0232946,0.0172206]},{"id":"x-es-pt-03","positive_rank":1,"scores":[0.0930921,0.0188711,0.009983]},{"id":"x-pt-es-01","positive_rank":1,"scores":[0.0604488,0.0312691,0.0332023]},{"id":"x-pt-es-02","positive_rank":1,"scores":[0.179002,0.0227296,0.0062393]},{"id":"x-pt-es-03","positive_rank":1,"scores":[0.0821052,0.061084,0.0028276]}],"bm25":[{"id":"x-es-en-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-en-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-en-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-es-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-pt-en-01","positive_rank":2,"scores":[0.3790352,0.6714338,0.0]},{"id":"x-pt-en-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-pt-en-03","positive_rank":1,"scores":[1.5654133,0.0,0.0]},{"id":"x-en-pt-01","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-pt-02","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-en-pt-03","positive_rank":3,"scores":[0.0,0.0,0.0]},{"id":"x-es-pt-01","positive_rank":1,"scores":[1.5758294,0.5089901,0.0]},{"id":"x-es-pt-02","positive_rank":1,"scores":[0.5487352,0.5045547,0.0]},{"id":"x-es-pt-03","positive_rank":3,"scores":[0.1063417,1.2316793,0.167868]},{"id":"x-pt-es-01","positive_rank":1,"scores":[1.1881915,0.4868563,0.5997592]},{"id":"x-pt-es-02","positive_rank":1,"scores":[3.5616728,0.5071557,0.0]},{"id":"x-pt-es-03","positive_rank":2,"scores":[0.7624821,2.2103194,0.0]}]}}}} |