fact_check
Collection
5 items โข Updated
Model Card for NABLA-FC
This is a Japanese Fact-Check Large Language Model developed by NABLAS.
Model Details
Model Description
This model is a Japanese Large Language Model, developed by NABLAS for fact-checking. It supports text as inputs. With a given text, the model fact-checks its validity by carrying out multiple iterations of reasoning and web search. Based on search results it generates a report that summarizes related information and its reasoning process, and draws a final conclusion on the validity of the input text, including citations of information sources.
- Developed by: NABLAS
- Funded by: GENIAC
- Shared by: NABLAS
- Model type: LLM
- Language(s) (NLP): Japanese/English
- License: Apache License 2.0
- Finetuned from model: Qwen/Qwen3-8B
Benchmark Results
We constructed a dataset consisting of around 400 high quanlity samples as a benchmark for fact-check evaluation, curated from public datasets such as JSocialFact dataset, FEVEROUS dataset, and the official Google Fact Check website. Due to the complexity of evaluating fact-check results, we carried out manual evaluation on a subset of the benchmark against frontier models. The numbers of correctly fact-checked samples by different models are given below.
| JSocialFact (Total 33) | FEVEROUS (Total 50) | |
|---|---|---|
| GPT-4o-mini | 24 | 31 |
| GEMINI-3.1-lite-preview | 29 | 40 |
| NABLA-FC (Ours) | 32 | 45 |
Examples
Here are outputs of the three models for the claim:
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฏใๅฎๅ จใซๅผ้ใใใฎใงใ
The fact-check report generated by our model makes the correct judgement of the claim's validity, and includes the most comprehensive information regarding the topic.
NABLA-FC (Ours)
\boxed{No.}
...
4. ้ป่ฉฑไบคๆๆฉใฎไปๅพใฎ็ถๆณ
- 2024ๅนด็พๅจ๏ผNTTๆฑ่ฅฟใๅบๅฎ้ป่ฉฑใIP็ถฒใซๅฎๅ จ็งป่กใใๅพๆฅใฎ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใ็ตไบใใฆใใพใใใใใใไธ้จใฎใตใผใในใงใฏPSTNใไฝฟ็จใใใใใใๅฎๅ จใชๅปๆญขใซใฏ่ณใฃใฆใใพใใใ
- 2025ๅนดไปฅ้๏ผๆฎใใตใผใในใฏ้ ๆฌกIP็ถฒใซๅใๆฟใใใใ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใฏใใใซ็ธฎๅฐใใพใใ
- 2028ๅนด๏ฝ2030ๅนดใใ๏ผISDNใตใผใในใฎ็ตไบใจใจใใซใๆงๅผใฎ้ป่ฉฑไบคๆๆฉใๅ็ท่จญๅใฎๅคง้จๅใๅปๆญขใใใๅฏ่ฝๆงใ้ซใใงใใ
5. ็ต่ซ
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฏใ2024ๅนด12ๆๆ็นใงๅคใใฎๅบๅฎ้ป่ฉฑใตใผใในใซใใใฆๅฝนๅฒใ็ตใใฆใใพใใใใใใไธ้จใฎใตใผใในใ่จญๅใงใฏPSTNใไฝฟใใใฆใใใๅฎๅ จใชๅปๆญขใซใฏ่ณใฃใฆใใพใใใไปๅพใฏISDNใตใผใในใฎ็ตไบใๅฅๆฉใซใ้ป่ฉฑไบคๆๆฉใฎๆ็ต็ใชๅปๆญขใ้ฒใใจไบๆณใใใพใใ็ทๅ็ใNTTๆฑ่ฅฟใฎๆฟ็ญใซๅบใฅใใ2025ๅนดไปฅ้ใฏIPๅใ้ฒใฟใ้ป่ฉฑไบคๆๆฉใฎๅญๅจใฏ้ๅฎ็ใซใชใใพใใ
...
Complete Report
\boxed{No.}
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฎ็พ็ถใจไปๅพใซใคใใฆ
1. ๅบๅฎ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใจ็งป่กใฎ็ต็ทฏ
ๆฅๆฌใฎๅบๅฎ้ป่ฉฑใตใผใในใฏ้ทๅนดใซใใใใๅ ฌ่กไบคๆ้ป่ฉฑ็ถฒ๏ผPSTN๏ผใๅบ็คใจใใฆใใใ้ป่ฉฑไบคๆๆฉใไธญๅฟ็ใชๅฝนๅฒใๆใใใฆใใพใใใใใใใ่ฟๅนดใฏใคใณใฟใผใใใๆ่กใฎๆฎๅใ้ไฟก้่ฆใฎๅคๅใ่ๆฏใซใๅบๅฎ้ป่ฉฑใฎๅ็ทๆนๅผใIP๏ผใคใณใฟใผใใใใใญใใณใซ๏ผใใผในใฎใใใใฏใผใฏใธใจ็งป่กใใๅใใๅ ้ใใฆใใพใใ
NTTๆฑๆฅๆฌใจNTT่ฅฟๆฅๆฌ๏ผไปฅไธใNTTๆฑ่ฅฟใ๏ผใฏใ2024ๅนด12ๆ25ๆฅใซใๅบๅฎ้ป่ฉฑ็จใฎใใใใฏใผใฏใๅ ฌ่กไบคๆ้ป่ฉฑ็ถฒ๏ผPSTN๏ผใใIP็ถฒใซๅ จใฆ็งป่กใใใใจ็บ่กจใใพใใใใใใฏใไธปใซใ0AB๏ฝJ็ชๅทใใจๅผใฐใใๅบๅฎ้ป่ฉฑใตใผใในใซใคใใฆใๅพๆฅใฎ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใ็ตไบใใใใจใๆๅณใใพใใใใฎ็งป่กใซใใใๅคใใฎๅบๅฎ้ป่ฉฑใฆใผใถใผใฏ้ป่ฉฑ็ชๅทใฎไฟๆใจๅฉ็จใฎ็ถ็ถใๅฏ่ฝใจใชใใ้ไฟกๅ่ณชใฎๅไธใใณในใๅๆธใๆๅพ ใใใฆใใพใใ
2. ๆฎใใตใผใในใจๆ็ต็ใชๅปๆญขๆๆ
ไธๆนใงใไธ้จใฎใตใผใในใฏPSTNใ็ต็ฑใใฆใใพใใไพใใฐใใ0120ใใใ0800ใใใๅงใพใ็ไฟก่ชฒ้ใตใผใในใใใใณใ0570ใใใๅงใพใใใใใคใคใซๅฎใฆใฎ้่ฉฑใชใฉใฏใ2024ๅนด4ๆไปฅ้ใPSTNใ็ต็ฑใใฆใใพใใใใใใใใฎใตใผใในใซใคใใฆใ2025ๅนด1ๆใพใงใซIP็ถฒใธใฎๅใๆฟใใๅฎไบใใ่ฆ่พผใฟใงใใ
ใใใซใISDNใตใผใใน๏ผINSใใใ๏ผใฏใ2028ๅนด12ๆ31ๆฅใใใฃใฆใตใผใใน็ตไบใ่ฟใใไบๅฎใงใใISDNใตใผใในใฏใไผๆฅญใไธญๅฟใซๅน ๅบใๅฉ็จใใใฆใใใใธใฟใซ้ไฟกใขใผใใงใใใใ้่ฆใฎไฝไธใ่จญๅใฎ่ๆฝๅใซไผดใใใใฎไพ็ตฆใฏๅๆญขใใใใใจใซใชใฃใฆใใพใใ
3. ็ทๅ็ใฎ่ฆ่งฃใจๆฟ็ญ
็ทๅ็ใฏใๅบๅฎ้ป่ฉฑ็ถฒใฎIPๅ็งป่กใ2025ๅนด1ๆใพใงใซๅฎไบใใใใใจใ็ฎๆจใจใใฆใใพใใ็พ่กใฎใกใฟใซๅ็ทใฏ็ถญๆใใใพใใใๆ็ต็ใซใฏIPๅใซไผดใๅปๆญขใ่กใใใๆน้ใงใใใพใใใกใฟใซๅ็ทใๆดป็จใใใใกใฟใซIP้ป่ฉฑใใตใผใในใใใฐใใใฏๆไพใใใใใจใไบๆณใใใฆใใพใใ
4. ้ป่ฉฑไบคๆๆฉใฎไปๅพใฎ็ถๆณ
- 2024ๅนด็พๅจ๏ผNTTๆฑ่ฅฟใๅบๅฎ้ป่ฉฑใIP็ถฒใซๅฎๅ จ็งป่กใใๅพๆฅใฎ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใ็ตไบใใฆใใพใใใใใใไธ้จใฎใตใผใในใงใฏPSTNใไฝฟ็จใใใใใใๅฎๅ จใชๅปๆญขใซใฏ่ณใฃใฆใใพใใใ
- 2025ๅนดไปฅ้๏ผๆฎใใตใผใในใฏ้ ๆฌกIP็ถฒใซๅใๆฟใใใใ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒใฏใใใซ็ธฎๅฐใใพใใ
- 2028ๅนด๏ฝ2030ๅนดใใ๏ผISDNใตใผใในใฎ็ตไบใจใจใใซใๆงๅผใฎ้ป่ฉฑไบคๆๆฉใๅ็ท่จญๅใฎๅคง้จๅใๅปๆญขใใใๅฏ่ฝๆงใ้ซใใงใใ
5. ็ต่ซ
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฏใ2024ๅนด12ๆๆ็นใงๅคใใฎๅบๅฎ้ป่ฉฑใตใผใในใซใใใฆๅฝนๅฒใ็ตใใฆใใพใใใใใใไธ้จใฎใตใผใในใ่จญๅใงใฏPSTNใไฝฟใใใฆใใใๅฎๅ จใชๅปๆญขใซใฏ่ณใฃใฆใใพใใใไปๅพใฏISDNใตใผใในใฎ็ตไบใๅฅๆฉใซใ้ป่ฉฑไบคๆๆฉใฎๆ็ต็ใชๅปๆญขใ้ฒใใจไบๆณใใใพใใ็ทๅ็ใNTTๆฑ่ฅฟใฎๆฟ็ญใซๅบใฅใใ2025ๅนดไปฅ้ใฏIPๅใ้ฒใฟใ้ป่ฉฑไบคๆๆฉใฎๅญๅจใฏ้ๅฎ็ใซใชใใพใใ
ๅ่ๆ ๅ ฑใพใจใ
ๅนดๅบฆ ไธป่ฆใตใผใใน็ถๆณ ไบคๆๆฉใฎๅฝนๅฒ 2024ๅนด ๅบๅฎ้ป่ฉฑใตใผใในใฎIPๅๅฎไบ ๅคงๅใฎๅฝนๅฒ็ตไบ 2025ๅนด ๆฎใใตใผใในใฎIPๅๅฎไบ ้ป่ฉฑไบคๆๆฉใฎๅฝนๅฒ็ธฎๅฐ 2028ๅนด ISDNใตใผใใน็ตไบ ๆงๅผ่จญๅใฎๅปๆญข 2030ๅนดไปฅ้ ้ป่ฉฑไบคๆๆฉใฎๆ็ต็ใชๅปๆญข IPๅใๅฎไบ
GPT-4o-mini
\boxed{No.}
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฏใๅฎๅ จใซๅผ้ใใฆใใพใใใNTTๆฑๆฅๆฌใใใณNTT่ฅฟๆฅๆฌใฏใๅ ๅ ฅ้ป่ฉฑใฎใตใผใในๅ่ณช็ถญๆใฎใใใๆงๅไบคๆๆฉใใๆฐๅไบคๆๆฉใธใฎๅๆฟๅทฅไบใๅฎๆฝใใฆใใพใใ (ntt-east.co.jp)ใพใใNTTๆฑๆฅๆฌ็ฆๅณถๆฏๅบใงใฏใ้ป่ฉฑไบคๆๆฉใฎๅๆฟๅทฅไบใ่กใใไธๆ็ใซ้่ฉฑใป้ไฟกใใๅฉ็จใงใใชใใชใๅ ดๅใใใใพใใ (ntt-east.co.jp)ใใใใฎๆ ๅ ฑใใใๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉใฏ็พๅจใ้็จใใใฆใใใๅฎๅ จใซๅผ้ใใฆใใชใใใจใ็ขบ่ชใงใใพใใ
GEMINI-3.1-lite-preview
\boxed{Yes.}
ๆค่จผใฌใใผใ
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉ๏ผๅ ฌ่กไบคๆ้ป่ฉฑ็ถฒ๏ผPSTN๏ผใฏใๅฎๅ จใซๅผ้๏ผๅปๆญข๏ผใใใพใใใ
...
ใชใใISDNใตใผใใน๏ผINSใใใ๏ผใฎใใใธใฟใซ้ไฟกใขใผใใใฏ2024ๅนด1ๆใซ็ตไบใใพใใใใใ้่ฉฑใขใผใใใซใคใใฆใฏ2028ๅนด12ๆๆซใพใงใฎๆไพใไบๅฎใใใฆใใพใใใใใใIP็ถฒไธใงๆไพใใใๅฝขใจใชใฃใฆใใใๅพๆฅใฎไบคๆๆฉ็ถฒใใใฏๅฎๅ จใซ่ฑๅดใใฆใใพใใ
Complete Report
\boxed{Yes.}
ๆค่จผใฌใใผใ
ๆฅๆฌใฎ้ป่ฉฑไบคๆๆฉ๏ผๅ ฌ่กไบคๆ้ป่ฉฑ็ถฒ๏ผPSTN๏ผใฏใๅฎๅ จใซๅผ้๏ผๅปๆญข๏ผใใใพใใใ
็็ฑใจๆ นๆ :
- PSTNใใคใฐใฌใผใทใงใณใฎๅฎไบ: NTTๆฑๆฅๆฌใใใณNTT่ฅฟๆฅๆฌใฏใ่ๆฝๅใใๅพๆฅใฎ้ป่ฉฑไบคๆๆฉ็ถฒ๏ผPSTN๏ผใ็ถญๆใใใใจใๅฐ้ฃใซใชใฃใใใใIP็ถฒใธใฎๅใๆฟใ๏ผPSTNใใคใฐใฌใผใทใงใณ๏ผใ้ฒใใฆใใพใใใใใฎๅใๆฟใใฏ2024ๅนด1ๆใซ้ๅงใใใใใงใซๅฎไบใใฆใใพใใ
- ๆ่ก็ใช่ปขๆ: ใใใพใง้ณๅฃฐ้่ฉฑใฎๆฅ็ถใๆ ใฃใฆใใใขใใญใฐๆนๅผใฎ้ป่ฉฑไบคๆๆฉใฏๅปๆญขใใใ็พๅจใฏใคใณใฟใผใใใใจๅใๆ่ก๏ผIP้ไฟก๏ผใ็จใใใใใใฏใผใฏใซ็ฝฎใๆใใฃใฆใใพใใ
- ๅฉ็จ่ ใฎๅฝฑ้ฟ: ใใฎ็งป่กใฏใใใใฏใผใฏๅ ้จใฎไป็ตใฟใฎๅคๆดใงใใใใใๅฉ็จ่ ใ็พๅจไฝฟ็จใใฆใใๅบๅฎ้ป่ฉฑๆฉใ้ป่ฉฑ็ชๅทใฏใใใฎใพใพ็ถ็ถใใฆๅฉ็จๅฏ่ฝใงใใใใฎใใใๅบๅฎ้ป่ฉฑใใชใใชใฃใใใใใงใฏใใใพใใใใ้ไฟกใๆฏใใๅบ็คๆ่กใจใใฆใฎใ้ป่ฉฑไบคๆๆฉใใฏๅฝนๅฒใ็ตใใๅผ้ใใพใใใ
ใชใใISDNใตใผใใน๏ผINSใใใ๏ผใฎใใใธใฟใซ้ไฟกใขใผใใใฏ2024ๅนด1ๆใซ็ตไบใใพใใใใใ้่ฉฑใขใผใใใซใคใใฆใฏ2028ๅนด12ๆๆซใพใงใฎๆไพใไบๅฎใใใฆใใพใใใใใใIP็ถฒไธใงๆไพใใใๅฝขใจใชใฃใฆใใใๅพๆฅใฎไบคๆๆฉ็ถฒใใใฏๅฎๅ จใซ่ฑๅดใใฆใใพใใ
Developers (Alphabetical Order)
- Haoxiang Shi
- Shuheng You
- Zijie Jiang
Acknowledgement
The development of this model was supported by the "GENIAC (Generative AI Accelerator Challenge)" project, conducted by Japan's Ministry of Economy, Trade and Industry (METI) and the New Energy and Industrial Technology Development Organization (NEDO), aimed at strengthening domestic capabilities in generative AI development.
- Downloads last month
- 327