Spaces:
Runtime error
Runtime error
Update README.md
Browse files
README.md
CHANGED
|
@@ -167,6 +167,10 @@ Simply put, this downloads the file as a temp file, we load it in with `TextFile
|
|
| 167 |
|
| 168 |
Why do we want to support streaming? What about streaming is important, or useful?
|
| 169 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 170 |
### On Chat Start:
|
| 171 |
|
| 172 |
The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
|
|
@@ -209,6 +213,11 @@ Now, we'll save that into our user session!
|
|
| 209 |
|
| 210 |
Why are we using User Session here? What about Python makes us need to use this? Why not just store everything in a global variable?
|
| 211 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 212 |
### On Message
|
| 213 |
|
| 214 |
First, we load our chain from the user session:
|
|
@@ -330,10 +339,21 @@ Upload a PDF file of the recent DeepSeek-R1 paper and ask the following question
|
|
| 330 |
|
| 331 |
1. What is RL and how does it help reasoning?
|
| 332 |
2. What is the difference between DeepSeek-R1 and DeepSeek-R1-Zero?
|
| 333 |
-
3. What is this paper about?
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 334 |
|
| 335 |
Does this application pass your vibe check? Are there any immediate pitfalls you're noticing?
|
| 336 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 337 |
## 🚧 CHALLENGE MODE 🚧
|
| 338 |
|
| 339 |
For the challenge mode, please instead create a simple FastAPI backend with a simple React (or any other JS framework) frontend.
|
|
|
|
| 167 |
|
| 168 |
Why do we want to support streaming? What about streaming is important, or useful?
|
| 169 |
|
| 170 |
+
This is useful for user-experience. Otherwise we have to wait for the entire response to complete and return which can lead to poor user-experience.
|
| 171 |
+
Other uses include the ability for early stopping if an issue is detected (including the user themselves saying stop-generation) which provides some control over how many tokens are used which is potentially resource/cost-saving.
|
| 172 |
+
|
| 173 |
+
|
| 174 |
### On Chat Start:
|
| 175 |
|
| 176 |
The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
|
|
|
|
| 213 |
|
| 214 |
Why are we using User Session here? What about Python makes us need to use this? Why not just store everything in a global variable?
|
| 215 |
|
| 216 |
+
Isolating the environment for each user ensures that each user's data is isolated. If we store everything in global environments we risk a situation where there are concurrent users of the site and one user uploads a PDF which overrides the other user's PDF.
|
| 217 |
+
From a privacy perspective this isolation ensures users don't have access to each other's data and cant see each other's chats
|
| 218 |
+
Given Python has a Global
|
| 219 |
+
I do not believe there is anything Python-specific that requires this. Using user sessions is considered good engineering design whether Node app or a Python app.
|
| 220 |
+
|
| 221 |
### On Message
|
| 222 |
|
| 223 |
First, we load our chain from the user session:
|
|
|
|
| 339 |
|
| 340 |
1. What is RL and how does it help reasoning?
|
| 341 |
2. What is the difference between DeepSeek-R1 and DeepSeek-R1-Zero?
|
| 342 |
+
3. What is this paper about? <-- fails
|
| 343 |
+
|
| 344 |
+

|
| 345 |
+
|
| 346 |
+

|
| 347 |
+
|
| 348 |
+

|
| 349 |
|
| 350 |
Does this application pass your vibe check? Are there any immediate pitfalls you're noticing?
|
| 351 |
|
| 352 |
+
- You cannot ask it questions where particular words do not exist in the PDF and this fails even if the concept exists in the PDF.
|
| 353 |
+
- E.g. "How does DeepSeek compare to SOTA" fails but "How does DeepSeek compare to State-of-the-art?" succeeds
|
| 354 |
+
- This is a very prevalent failure (as evident in that I cant even ask what the paper is about!) and severely restricts how well you can interact and ask questions.
|
| 355 |
+
- From a UX perspective copy-paste doesn't work
|
| 356 |
+
|
| 357 |
## 🚧 CHALLENGE MODE 🚧
|
| 358 |
|
| 359 |
For the challenge mode, please instead create a simple FastAPI backend with a simple React (or any other JS framework) frontend.
|