willystumblr commited on
Commit
74c89ca
ยท
verified ยท
1 Parent(s): 3c799fc

Added an example

Browse files
Files changed (1) hide show
  1. README.md +38 -6
README.md CHANGED
@@ -17,7 +17,7 @@ A response is considered:
17
  - `valid`: The interviewee's answers are logically consistent with each otherโ€” there are no contradictions.
18
  - `invalid`: There is a clear contradiction or inconsistency between the intervieweeโ€™s responses.
19
 
20
- **Example**
21
  ```markdown
22
  Q: What was your favorite subject during the school year?
23
  A: *I loved science and math.*
@@ -26,7 +26,24 @@ Q: In which subject did you excel the most?
26
  A: English. I always got low grades in science and maths because *I never enjoyed them.*
27
 
28
  Label: `invalid`
29
- Reason: The interviewee initially stated they loved science and math, but later claimed they never enjoyed them and received low gradesโ€”this is a contradiction (Refer to the italicised text.).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ```
31
 
32
  Please read each conversation carefullyโ€“ it's easy to overlook subtle contradictions!
@@ -37,7 +54,7 @@ You do **not** need to consider consistency across different conversationsโ€” ev
37
 
38
  You also do **not** need any external or real-world knowledgeโ€”basic reasoning (like simple arithmetic) is sufficient.
39
 
40
- If needed, you may look up general background knowledge (e.g., grade levels in the U.S. education system).
41
 
42
  We sincerely appreciate your time.
43
 
@@ -48,12 +65,12 @@ If you have any inquiries or want to report issues, feel free to reach out at an
48
  ---
49
 
50
  ๋ ˆ์ด๋ธ”๋ง์— ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ์ง„์‹ฌ์œผ๋กœ ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค! ๐Ÿค—
51
- ๋‘ ์‚ฌ๋žŒ์˜ ๋Œ€ํ™”๋ฅผ ์ฝ๊ณ , ์ธํ„ฐ๋ทฐ์ด(ํŒŒ๋ž‘์ƒ‰ ์ฑ„ํŒ… ๋ฉ”์‹œ์ง€)์˜ ์‘๋‹ต๋“ค์ด ๋ชจ์ˆœ ์—†์ด ์ผ๊ด€๋˜๋Š”์ง€๋ฅผ ๋ ˆ์ด๋ธ”๋ง ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
52
 
53
  - `valid`: ์‘๋‹ต๋“ค ๊ฐ„์— ๋ชจ์ˆœ์ด ์—†๊ณ , ๋…ผ๋ฆฌ์ ์œผ๋กœ ํƒ€๋‹นํ•œ ๊ฒฝ์šฐ.
54
  - `invalid`: ์ผ๋ถ€ ์‘๋‹ต๋“ค์— ํ™•์‹คํ•œ ๋ชจ์ˆœ์ ์ด ๋ฐœ๊ฒฌ๋˜์—ˆ์„ ๋•Œ.
55
 
56
- **์˜ˆ์‹œ)**
57
  ```markdown
58
  Q: ํ•™์ฐฝ ์‹œ์ ˆ ์ข‹์•„ํ–ˆ๋˜ ๊ณผ๋ชฉ์ด ์žˆ๋‚˜์š”?
59
  A: *์ˆ˜ํ•™๊ณผ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ์–ด์š”.*
@@ -65,6 +82,21 @@ Label: `invalid`
65
  Reason: ์ฒ˜์Œ์—” ์ˆ˜ํ•™์ด๋ž‘ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ, ์ดํ›„์— ์‹ซ์–ดํ•˜๋Š” ๊ณผ๋ชฉ๋“ค์ด๋ผ๊ณ  ๋งํ•จ.
66
  ```
67
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68
  ๋ˆˆ์น˜์ฑ„๊ธฐ ์–ด๋ ค์šด ๋ชจ์ˆœ์ ๋“ค์ด ์žˆ์„ ์ˆ˜ ์žˆ์œผ๋‹ˆ, ๊ผผ๊ผผํžˆ ์ฃผ์˜๊นŠ๊ฒŒ ์ฝ์–ด์ฃผ์‹œ๊ธธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.
69
 
70
  โš ๏ธ **์ฃผ์˜์‚ฌํ•ญ**: ๋ ˆ์ด๋ธ”๋งํ•  ๋•Œ, ํ™”๋ฉด ์ƒ์— ๋ณด์—ฌ์ง€๋Š” ํ•˜๋‚˜์˜ ๋Œ€ํ™”์—๋งŒ ๊ทผ๊ฑฐํ•˜์—ฌ ๋ ˆ์ด๋ธ”์„ ๊ฒฐ์ •ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค(์„œ๋กœ ๋‹ค๋ฅธ ์ƒ˜ํ”Œ๋“ค์€ ์ธํ„ฐ๋ทฐ์ด๊ฐ€ ๋‹ค๋ฅผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค).
@@ -72,7 +104,7 @@ Reason: ์ฒ˜์Œ์—” ์ˆ˜ํ•™์ด๋ž‘ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ, ์ดํ›„์—
72
 
73
  ๋˜ํ•œ, ์ผ๊ด€์„ฑ์„ ํŒ๋‹จํ•˜๊ธฐ ์œ„ํ•œ ์™ธ๋ถ€ ์ง€์‹(์‹ค์ œ ๋ฐœ์ƒํ•œ ์‚ฌ๊ฑด ๋“ฑ)์€ ์ „ํ˜€ ํ•„์š”ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ๊ธฐ์ดˆ์ ์ธ ์‚ฐ์ˆ  ์ •๋„๋ฉด ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค.
74
 
75
- ๊ฐ„๋‹จํ•œ ๋ฐฐ๊ฒฝ ์ง€์‹์ด ํ•„์š”ํ•œ ์ƒ˜ํ”Œ๋“ค์ด ์žˆ๋Š”๋ฐ, ์ด๋Ÿฐ ๊ฒƒ๋“ค์€ ๊ฒ€์ƒ‰ํ•ด์„œ ํ™•์ธํ•˜์…”๋„ ๋ฌด๋ฐฉํ•ฉ๋‹ˆ๋‹ค(์˜ˆ: ๋ฏธ๊ตญ์˜ ํ•™๋…„ ์ฒด๊ณ„ ๋“ฑ).
76
 
77
  ์‹œ๊ฐ„ ๋‚ด์–ด ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ๋‹ค์‹œ ํ•œ ๋ฒˆ ๊ฐ์‚ฌ๋“œ๋ฆฝ๋‹ˆ๋‹ค :)
78
 
 
17
  - `valid`: The interviewee's answers are logically consistent with each otherโ€” there are no contradictions.
18
  - `invalid`: There is a clear contradiction or inconsistency between the intervieweeโ€™s responses.
19
 
20
+ **Example 1**
21
  ```markdown
22
  Q: What was your favorite subject during the school year?
23
  A: *I loved science and math.*
 
26
  A: English. I always got low grades in science and maths because *I never enjoyed them.*
27
 
28
  Label: `invalid`
29
+ Reason: The interviewee initially stated they loved science and math,
30
+ but later claimed they never enjoyed them and received low gradesโ€”this is a contradiction (Refer to the italicised text.).
31
+ ```
32
+
33
+ **Example 2**
34
+ ```markdown
35
+ Q: When did you learn Spanish?
36
+ A: I learned Spanish in *2019-2020 AY*, when I was *a freshman* at ABC High School.
37
+ โ€ฆ
38
+ Q: When is your expected graduation date?
39
+ A: It will be May *2026*.
40
+
41
+ Q: Have you ever taken a leave of absence during the high school year?
42
+ A: No, I havenโ€™t. Iโ€™ve never taken any time off โ€” not even missed a class.
43
+
44
+ Label: `invalid`
45
+ Reason: Based on the intervieweeโ€™s initial response, they were a freshman during the 2019โ€“2020 academic year.
46
+ Since they have never taken a semester off, their expected graduation year should be earlier than 2026 โ€” likely around 2023 โ€” assuming a typical education timeline.
47
  ```
48
 
49
  Please read each conversation carefullyโ€“ it's easy to overlook subtle contradictions!
 
54
 
55
  You also do **not** need any external or real-world knowledgeโ€”basic reasoning (like simple arithmetic) is sufficient.
56
 
57
+ Some samples, such as Example 2, may require basic background knowledge. In such cases, you may consult external sources (e.g., typical grade levels in an education system).
58
 
59
  We sincerely appreciate your time.
60
 
 
65
  ---
66
 
67
  ๋ ˆ์ด๋ธ”๋ง์— ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ์ง„์‹ฌ์œผ๋กœ ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค! ๐Ÿค—
68
+ ๋‘ ์‚ฌ๋žŒ์˜ ๋Œ€ํ™”๋ฅผ ์ฝ๊ณ , ๋‹ต๋ณ€์ž(ํŒŒ๋ž‘์ƒ‰ ์ฑ„ํŒ… ๋ฉ”์‹œ์ง€)์˜ ์‘๋‹ต๋“ค์ด ๋ชจ์ˆœ ์—†์ด ์ผ๊ด€๋˜๋Š”์ง€๋ฅผ ๋ ˆ์ด๋ธ”๋ง ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
69
 
70
  - `valid`: ์‘๋‹ต๋“ค ๊ฐ„์— ๋ชจ์ˆœ์ด ์—†๊ณ , ๋…ผ๋ฆฌ์ ์œผ๋กœ ํƒ€๋‹นํ•œ ๊ฒฝ์šฐ.
71
  - `invalid`: ์ผ๋ถ€ ์‘๋‹ต๋“ค์— ํ™•์‹คํ•œ ๋ชจ์ˆœ์ ์ด ๋ฐœ๊ฒฌ๋˜์—ˆ์„ ๋•Œ.
72
 
73
+ **์˜ˆ์‹œ 1)**
74
  ```markdown
75
  Q: ํ•™์ฐฝ ์‹œ์ ˆ ์ข‹์•„ํ–ˆ๋˜ ๊ณผ๋ชฉ์ด ์žˆ๋‚˜์š”?
76
  A: *์ˆ˜ํ•™๊ณผ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ์–ด์š”.*
 
82
  Reason: ์ฒ˜์Œ์—” ์ˆ˜ํ•™์ด๋ž‘ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ, ์ดํ›„์— ์‹ซ์–ดํ•˜๋Š” ๊ณผ๋ชฉ๋“ค์ด๋ผ๊ณ  ๋งํ•จ.
83
  ```
84
 
85
+ **์˜ˆ์‹œ 2)**
86
+ ```markdown
87
+ Q: ์ŠคํŽ˜์ธ์–ด๋ฅผ ์–ธ์ œ ๋ฐฐ์› ๋‚˜์š”?
88
+ A: *2019๋…„, ์ œ๊ฐ€ ๊ณ ๋“ฑํ•™๊ต 1ํ•™๋…„์ด์—ˆ์„ ๋•Œ* ๋ฐฐ์› ์–ด์š”.
89
+ โ€ฆ
90
+ Q: ์กธ์—… ์˜ˆ์ •์ผ์ด ์–ธ์ œ์ธ๊ฐ€์š”?
91
+ A: *2026๋…„* ๊ฒจ์šธ์ด์š”.
92
+
93
+ Q: ๊ณ ๋“ฑํ•™๊ต ์žฌํ•™ ์ค‘ ํœดํ•™์„ ํ•œ ์ ์ด ์žˆ๋‚˜์š”?
94
+ A: ์•„๋‹ˆ์š”, ๊ฐœ๊ทผํ–ˆ์–ด์š”.
95
+
96
+ Label: `invalid`
97
+ Reason: ๋‹ต๋ณ€์ž์˜ ๋ง์— ๋”ฐ๋ฅด๋ฉด 2019๋…„์— ๊ณ ๋“ฑํ•™๊ต 1ํ•™๋…„์ด์—ˆ๊ณ , ํœดํ•™์„ ํ•œ ์ ์ด ์—†์œผ๋ฏ€๋กœ ์ผ๋ฐ˜์ ์ธ ํ•™๋…„ ์ฒด๊ณ„๋ฅผ ๋”ฐ๋ฅธ๋‹ค๋ฉด 2026๋…„ ์ด์ „์— ์กธ์—…ํ–ˆ์–ด์•ผ ํ•จ.
98
+ ```
99
+
100
  ๋ˆˆ์น˜์ฑ„๊ธฐ ์–ด๋ ค์šด ๋ชจ์ˆœ์ ๋“ค์ด ์žˆ์„ ์ˆ˜ ์žˆ์œผ๋‹ˆ, ๊ผผ๊ผผํžˆ ์ฃผ์˜๊นŠ๊ฒŒ ์ฝ์–ด์ฃผ์‹œ๊ธธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.
101
 
102
  โš ๏ธ **์ฃผ์˜์‚ฌํ•ญ**: ๋ ˆ์ด๋ธ”๋งํ•  ๋•Œ, ํ™”๋ฉด ์ƒ์— ๋ณด์—ฌ์ง€๋Š” ํ•˜๋‚˜์˜ ๋Œ€ํ™”์—๋งŒ ๊ทผ๊ฑฐํ•˜์—ฌ ๋ ˆ์ด๋ธ”์„ ๊ฒฐ์ •ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค(์„œ๋กœ ๋‹ค๋ฅธ ์ƒ˜ํ”Œ๋“ค์€ ์ธํ„ฐ๋ทฐ์ด๊ฐ€ ๋‹ค๋ฅผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค).
 
104
 
105
  ๋˜ํ•œ, ์ผ๊ด€์„ฑ์„ ํŒ๋‹จํ•˜๊ธฐ ์œ„ํ•œ ์™ธ๋ถ€ ์ง€์‹(์‹ค์ œ ๋ฐœ์ƒํ•œ ์‚ฌ๊ฑด ๋“ฑ)์€ ์ „ํ˜€ ํ•„์š”ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ๊ธฐ์ดˆ์ ์ธ ์‚ฐ์ˆ  ์ •๋„๋ฉด ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค.
106
 
107
+ ๊ฐ„ํ˜น ์˜ˆ์‹œ 2์ฒ˜๋Ÿผ ๊ฐ„๋‹จํ•œ ๋ฐฐ๊ฒฝ ์ง€์‹์ด ํ•„์š”ํ•œ ์ƒ˜ํ”Œ๋“ค์ด ์žˆ๋Š”๋ฐ, ์ด๋Ÿฐ ๊ฒƒ๋“ค์€ ๊ฒ€์ƒ‰ํ•ด์„œ ํ™•์ธํ•˜์…”๋„ ๋ฌด๋ฐฉํ•ฉ๋‹ˆ๋‹ค(์˜ˆ: ์ผ๋ฐ˜์ ์ธ ๊ณ ๋“ฑํ•™๊ต ํ•™๋…„ ์ฒด๊ณ„ ๋“ฑ).
108
 
109
  ์‹œ๊ฐ„ ๋‚ด์–ด ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ๋‹ค์‹œ ํ•œ ๋ฒˆ ๊ฐ์‚ฌ๋“œ๋ฆฝ๋‹ˆ๋‹ค :)
110