willystumblr commited on
Commit
c9b2aa1
ยท
verified ยท
1 Parent(s): 74c89ca

Update interview guideline

Browse files
Files changed (1) hide show
  1. README.md +34 -83
README.md CHANGED
@@ -7,107 +7,58 @@ colorTo: indigo
7
  pinned: false
8
  ---
9
 
10
- # Labeling Guidelines
11
 
12
- Thank you for contributing to our project! ๐Ÿค—
13
- Your task is to read a conversation between two people and assess whether the intervieweeโ€™s responses (shown in blue chat bubbles) are **valid**.
14
 
15
- A response is considered:
16
 
17
- - `valid`: The interviewee's answers are logically consistent with each otherโ€” there are no contradictions.
18
- - `invalid`: There is a clear contradiction or inconsistency between the intervieweeโ€™s responses.
 
 
19
 
20
- **Example 1**
21
- ```markdown
22
- Q: What was your favorite subject during the school year?
23
- A: *I loved science and math.*
24
- โ€ฆ
25
- Q: In which subject did you excel the most?
26
- A: English. I always got low grades in science and maths because *I never enjoyed them.*
27
 
28
- Label: `invalid`
29
- Reason: The interviewee initially stated they loved science and math,
30
- but later claimed they never enjoyed them and received low gradesโ€”this is a contradiction (Refer to the italicised text.).
31
- ```
32
 
33
- **Example 2**
34
- ```markdown
35
- Q: When did you learn Spanish?
36
- A: I learned Spanish in *2019-2020 AY*, when I was *a freshman* at ABC High School.
37
- โ€ฆ
38
- Q: When is your expected graduation date?
39
- A: It will be May *2026*.
40
-
41
- Q: Have you ever taken a leave of absence during the high school year?
42
- A: No, I havenโ€™t. Iโ€™ve never taken any time off โ€” not even missed a class.
43
-
44
- Label: `invalid`
45
- Reason: Based on the intervieweeโ€™s initial response, they were a freshman during the 2019โ€“2020 academic year.
46
- Since they have never taken a semester off, their expected graduation year should be earlier than 2026 โ€” likely around 2023 โ€” assuming a typical education timeline.
47
- ```
48
-
49
- Please read each conversation carefullyโ€“ it's easy to overlook subtle contradictions!
50
-
51
- โš ๏ธ **Important:** When evaluating consistency, rely only on the information provided within **a single conversation**.
52
- You do **not** need to consider consistency across different conversationsโ€” even if they feature the same interviewee.
53
- (Some samples come from different interviewers and are unrelated.)
54
-
55
- You also do **not** need any external or real-world knowledgeโ€”basic reasoning (like simple arithmetic) is sufficient.
56
-
57
- Some samples, such as Example 2, may require basic background knowledge. In such cases, you may consult external sources (e.g., typical grade levels in an education system).
58
 
59
  We sincerely appreciate your time.
60
-
61
  If you have any inquiries or want to report issues, feel free to reach out at any time:
62
 
63
  ๐Ÿ“ง minskim010203@gmail.com
64
 
65
  ---
 
66
 
67
- ๋ ˆ์ด๋ธ”๋ง์— ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ์ง„์‹ฌ์œผ๋กœ ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค! ๐Ÿค—
68
- ๋‘ ์‚ฌ๋žŒ์˜ ๋Œ€ํ™”๋ฅผ ์ฝ๊ณ , ๋‹ต๋ณ€์ž(ํŒŒ๋ž‘์ƒ‰ ์ฑ„ํŒ… ๋ฉ”์‹œ์ง€)์˜ ์‘๋‹ต๋“ค์ด ๋ชจ์ˆœ ์—†์ด ์ผ๊ด€๋˜๋Š”์ง€๋ฅผ ๋ ˆ์ด๋ธ”๋ง ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
69
 
70
- - `valid`: ์‘๋‹ต๋“ค ๊ฐ„์— ๋ชจ์ˆœ์ด ์—†๊ณ , ๋…ผ๋ฆฌ์ ์œผ๋กœ ํƒ€๋‹นํ•œ ๊ฒฝ์šฐ.
71
- - `invalid`: ์ผ๋ถ€ ์‘๋‹ต๋“ค์— ํ™•์‹คํ•œ ๋ชจ์ˆœ์ ์ด ๋ฐœ๊ฒฌ๋˜์—ˆ์„ ๋•Œ.
72
 
73
- **์˜ˆ์‹œ 1)**
74
- ```markdown
75
- Q: ํ•™์ฐฝ ์‹œ์ ˆ ์ข‹์•„ํ–ˆ๋˜ ๊ณผ๋ชฉ์ด ์žˆ๋‚˜์š”?
76
- A: *์ˆ˜ํ•™๊ณผ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ์–ด์š”.*
77
- โ€ฆ
78
- Q: ๊ฐ€์žฅ ์ž˜ ํ–ˆ๋˜ ๊ณผ๋ชฉ์ด ๋ฌด์—‡์ธ๊ฐ€์š”?
79
- A: ์˜์–ด์š”. ์ˆ˜ํ•™์ด๋ž‘ ๊ณผํ•™์€ *์ œ๊ฐ€ ์‹ซ์–ดํ•˜๋Š” ๊ณผ๋ชฉ๋“ค์ด๋ผ* ์ ์ˆ˜๊ฐ€ ํ•ญ์ƒ ๋‚ฎ์•˜์–ด์š”.
80
 
81
- Label: `invalid`
82
- Reason: ์ฒ˜์Œ์—” ์ˆ˜ํ•™์ด๋ž‘ ๊ณผํ•™์„ ์ข‹์•„ํ–ˆ๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ, ์ดํ›„์— ์‹ซ์–ดํ•˜๋Š” ๊ณผ๋ชฉ๋“ค์ด๋ผ๊ณ  ๋งํ•จ.
83
- ```
84
 
85
- **์˜ˆ์‹œ 2)**
86
- ```markdown
87
- Q: ์ŠคํŽ˜์ธ์–ด๋ฅผ ์–ธ์ œ ๋ฐฐ์› ๋‚˜์š”?
88
- A: *2019๋…„, ์ œ๊ฐ€ ๊ณ ๋“ฑํ•™๊ต 1ํ•™๋…„์ด์—ˆ์„ ๋•Œ* ๋ฐฐ์› ์–ด์š”.
89
- โ€ฆ
90
- Q: ์กธ์—… ์˜ˆ์ •์ผ์ด ์–ธ์ œ์ธ๊ฐ€์š”?
91
- A: *2026๋…„* ๊ฒจ์šธ์ด์š”.
92
 
93
- Q: ๊ณ ๋“ฑํ•™๊ต ์žฌํ•™ ์ค‘ ํœดํ•™์„ ํ•œ ์ ์ด ์žˆ๋‚˜์š”?
94
- A: ์•„๋‹ˆ์š”, ๊ฐœ๊ทผํ–ˆ์–ด์š”.
 
 
 
 
95
 
96
- Label: `invalid`
97
- Reason: ๋‹ต๋ณ€์ž์˜ ๋ง์— ๋”ฐ๋ฅด๋ฉด 2019๋…„์— ๊ณ ๋“ฑํ•™๊ต 1ํ•™๋…„์ด์—ˆ๊ณ , ํœดํ•™์„ ํ•œ ์ ์ด ์—†์œผ๋ฏ€๋กœ ์ผ๋ฐ˜์ ์ธ ํ•™๋…„ ์ฒด๊ณ„๋ฅผ ๋”ฐ๋ฅธ๋‹ค๋ฉด 2026๋…„ ์ด์ „์— ์กธ์—…ํ–ˆ์–ด์•ผ ํ•จ.
98
- ```
99
 
100
- ๋ˆˆ์น˜์ฑ„๊ธฐ ์–ด๋ ค์šด ๋ชจ์ˆœ์ ๋“ค์ด ์žˆ์„ ์ˆ˜ ์žˆ์œผ๋‹ˆ, ๊ผผ๊ผผํžˆ ์ฃผ์˜๊นŠ๊ฒŒ ์ฝ์–ด์ฃผ์‹œ๊ธธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.
101
-
102
- โš ๏ธ **์ฃผ์˜์‚ฌํ•ญ**: ๋ ˆ์ด๋ธ”๋งํ•  ๋•Œ, ํ™”๋ฉด ์ƒ์— ๋ณด์—ฌ์ง€๋Š” ํ•˜๋‚˜์˜ ๋Œ€ํ™”์—๋งŒ ๊ทผ๊ฑฐํ•˜์—ฌ ๋ ˆ์ด๋ธ”์„ ๊ฒฐ์ •ํ•ด์ฃผ์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค(์„œ๋กœ ๋‹ค๋ฅธ ์ƒ˜ํ”Œ๋“ค์€ ์ธํ„ฐ๋ทฐ์ด๊ฐ€ ๋‹ค๋ฅผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค).
103
- ์„ค๋ น ๊ฐ™์€ ์ธํ„ฐ๋ทฐ์ด์ฒ˜๋Ÿผ ๋А๊ปด์ง€๋Š” ๋Œ€ํ™”๋“ค์ด ์žˆ๋”๋ผ๋„, ํ˜„์žฌ ๋ ˆ์ด๋ธ”๋ง ์ค‘์ธ ํ•˜๋‚˜์˜ ๋Œ€ํ™”๋กœ๋งŒ ํŒ๋‹จํ•ด์ฃผ์„ธ์š”!
104
-
105
- ๋˜ํ•œ, ์ผ๊ด€์„ฑ์„ ํŒ๋‹จํ•˜๊ธฐ ์œ„ํ•œ ์™ธ๋ถ€ ์ง€์‹(์‹ค์ œ ๋ฐœ์ƒํ•œ ์‚ฌ๊ฑด ๋“ฑ)์€ ์ „ํ˜€ ํ•„์š”ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ๊ธฐ์ดˆ์ ์ธ ์‚ฐ์ˆ  ์ •๋„๋ฉด ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค.
106
-
107
- ๊ฐ„ํ˜น ์˜ˆ์‹œ 2์ฒ˜๋Ÿผ ๊ฐ„๋‹จํ•œ ๋ฐฐ๊ฒฝ ์ง€์‹์ด ํ•„์š”ํ•œ ์ƒ˜ํ”Œ๋“ค์ด ์žˆ๋Š”๋ฐ, ์ด๋Ÿฐ ๊ฒƒ๋“ค์€ ๊ฒ€์ƒ‰ํ•ด์„œ ํ™•์ธํ•˜์…”๋„ ๋ฌด๋ฐฉํ•ฉ๋‹ˆ๋‹ค(์˜ˆ: ์ผ๋ฐ˜์ ์ธ ๊ณ ๋“ฑํ•™๊ต ํ•™๋…„ ์ฒด๊ณ„ ๋“ฑ).
108
-
109
- ์‹œ๊ฐ„ ๋‚ด์–ด ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ๋‹ค์‹œ ํ•œ ๋ฒˆ ๊ฐ์‚ฌ๋“œ๋ฆฝ๋‹ˆ๋‹ค :)
110
-
111
- ๋ฌธ์˜์‚ฌํ•ญ์ด ์žˆ์œผ์‹œ๊ฑฐ๋‚˜ ๋ฌธ์ œ๋ฅผ ๋ฐœ๊ฒฌํ•˜์‹œ๋ฉด ์–ธ์ œ๋“  ํŽธํ•˜๊ฒŒ ์—ฐ๋ฝ์ฃผ์„ธ์š”.
112
-
113
- ๐Ÿ“ง minskim010203@gmail.com
 
7
  pinned: false
8
  ---
9
 
10
+ # Interview Guidelines
11
 
12
+ Thank you for contributing to our project! ๐Ÿค—
 
13
 
14
+ This interview will take up to a maximum of 1 hour. During the interview, you'll be asked 112 questions in total:
15
 
16
+ 0. 1 question regarding cutoff date
17
+ 1. 10 demographic questions
18
+ 2. 90 follow-up questions
19
+ 3. repeating 0 and 1 for clarification
20
 
21
+ The interviewer is designed to persistently ask questions to get to know you better.
22
+ Before you start the interview, **please make sure to read the following**!
 
 
 
 
 
23
 
24
+ # โš ๏ธ Warning
 
 
 
25
 
26
+ - If the questions are inappropriate or uncomfortable in any sense (e.g., invasion of privacy), you may refuse to provide the response.
27
+ - Collecting your information is solely for research purposes. We ensure that your information **will be protected and NOT be used in any way.**
28
+ - Your information will be deleted as the research project is over.
29
+ - Please be truthful in all questions, and if you do not want to provide further information, clearly express your refusal.
30
+ - You can abstain from providing response and even change the topic by saying, for example, 'can we talk about something else?'
31
+ - **Please do NOT reload or exit the page**, or your interview log will be lost, and you will need to start over.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
  We sincerely appreciate your time.
 
34
  If you have any inquiries or want to report issues, feel free to reach out at any time:
35
 
36
  ๐Ÿ“ง minskim010203@gmail.com
37
 
38
  ---
39
+ # Interview Guidelines
40
 
41
+ ์ธํ„ฐ๋ทฐ์— ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ์ง„์‹ฌ์œผ๋กœ ๊ฐ์‚ฌ๋“œ๋ฆฝ๋‹ˆ๋‹ค! ๐Ÿค—
 
42
 
43
+ ์ธํ„ฐ๋ทฐ๋Š” ์ตœ๋Œ€ 1์‹œ๊ฐ„ ๊ฐ€๋Ÿ‰ ์ง„ํ–‰๋˜๋ฉฐ, ์ด 112๊ฐœ์˜ ์งˆ๋ฌธ์— ๋‹ตํ•˜๊ฒŒ ๋ฉ๋‹ˆ๋‹ค.
 
44
 
45
+ 0. Cutoff date ์งˆ๋ฌธ 1๊ฐœ
46
+ 1. ์ธ๊ตฌํ†ต๊ณ„ํ•™์ (demographic) ์งˆ๋ฌธ 10๊ฐœ
47
+ 2. 1์— ๊ธฐ๋ฐ˜ํ•œ ๊ผฌ๋ฆฌ ์งˆ๋ฌธ 90๊ฐœ
48
+ 3. 0, 1 ์žฌ์งˆ๋ฌธ (ํ™•์ธ ๋ชฉ์ )
 
 
 
49
 
50
+ ์งˆ๋ฌธ์ž๋Š” ์ธํ„ฐ๋ทฐ ์ฐธ์—ฌ์ž์— ๋Œ€ํ•ด ์ž์„ธํžˆ ํŒŒ์•…ํ•˜๊ธฐ ์œ„ํ•ด ๋งค์šฐ ์ž์„ธํžˆ, ์ง‘์š”ํ•˜๊ฒŒ ์งˆ๋ฌธ์„ ๋˜์ง€๋„๋ก ์„ค๊ณ„๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
51
+ ์ธํ„ฐ๋ทฐ๋ฅผ ์‹œ์ž‘ํ•˜์‹œ๊ธฐ ์ „์—, **์•„๋ž˜ ์ฃผ์˜์‚ฌํ•ญ์„ ๋ฐ˜๋“œ์‹œ ์ˆ™์ง€ํ•˜์‹œ๊ธธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค.**
 
52
 
53
+ # โš ๏ธ ์ฃผ์˜์‚ฌํ•ญ
 
 
 
 
 
 
54
 
55
+ - ์–ด๋–ค ์‹์œผ๋กœ๋“  ์งˆ๋ฌธ์ž์˜ ์งˆ๋ฌธ์ด ๋ถ€์ ์ ˆํ•˜๋ฉด(์‚ฌ์ƒํ™œ ์นจํ•ด ๋“ฑ) ์ฐธ์—ฌ์ž๋Š” ์‘๋‹ต์„ ๊ฑฐ๋ถ€ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
56
+ - ์ฐธ์—ฌ์ž์˜ ๊ฐœ์ธ์ •๋ณด๋Š” ์˜ค๋กœ์ง€ ์—ฐ๊ตฌ ๋ชฉ์ ์œผ๋กœ๋งŒ ์ˆ˜์ง‘ํ•˜๋ฉฐ, **์–ด๋–ค ๋ฐฉ์‹์œผ๋กœ๋“  ํ™œ์šฉ๋˜์ง€ ์•Š๊ณ  ๋ณดํ˜ธ๋จ**์„ ๋‹น๋ถ€๋“œ๋ฆฝ๋‹ˆ๋‹ค.
57
+ - ์ˆ˜์ง‘๋œ ๊ฐœ์ธ์ •๋ณด๋Š” ํ”„๋กœ์ ํŠธ์˜ ์ข…๋ฃŒ์— ๋”ฐ๋ผ ์ฆ‰์‹œ ์‚ญ์ œ๋ฉ๋‹ˆ๋‹ค.
58
+ - ์งˆ๋ฌธ์— ๋‹ตํ•  ๋•Œ์—๋Š” ์ง„์‹ค๋˜๊ฒŒ ๋‹ตํ•˜๋˜, ๋‹ต๋ณ€์„ ๊ฑฐ๋ถ€ํ•  ๋•Œ์—๋Š” ํ™•์‹คํ•˜๊ฒŒ ์˜์‚ฌํ‘œํ˜„์„ ํ•˜์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
59
+ - ๋‹จ์ˆœํžˆ ์งˆ๋ฌธ์— ์‘๋‹ต์„ ๊ฑฐ๋ถ€ํ•  ์ˆ˜๋„ ์žˆ๊ณ , ํ™”์ œ๋ฅผ ๋ฐ”๊ฟ€ ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค(์˜ˆ: ๋‹ค๋ฅธ ์ฃผ์ œ๋กœ ๋Œ€ํ™”ํ•  ์ˆ˜ ์žˆ์„๊นŒ์š”?).
60
+ - **ํŽ˜์ด์ง€๋ฅผ ์ƒˆ๋กœ๊ณ ์นจํ•˜๊ฑฐ๋‚˜ ์ฐฝ์„ ๋‹ซ์ง€ ๋งˆ์„ธ์š”!** ์ธํ„ฐ๋ทฐ ๊ธฐ๋ก์ด ์†Œ์‹ค๋˜์–ด ์ฒ˜์Œ๋ถ€ํ„ฐ ๋‹ค์‹œ ์‹œ์ž‘ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
61
 
62
+ ์‹œ๊ฐ„ ๋‚ด์–ด ์ฐธ์—ฌํ•ด์ฃผ์…”์„œ ๋‹ค์‹œ ํ•œ ๋ฒˆ ๊ฐ์‚ฌ๋“œ๋ฆฌ๋ฉฐ, ๋ฌธ์˜์‚ฌํ•ญ์ด๋‚˜ ์˜ค๋ฅ˜๊ฐ€ ์žˆ์„ ๊ฒฝ์šฐ ์•„๋ž˜ ์ด๋ฉ”์ผ ์ฃผ์†Œ๋กœ ์–ธ์ œ๋“  ์—ฐ๋ฝ์ฃผ์„ธ์š”.
 
 
63
 
64
+ ๐Ÿ“ง minskim010203@gmail.com