Frikster42 commited on
Commit
d993709
·
verified ·
1 Parent(s): 0db3afc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -167,6 +167,10 @@ Simply put, this downloads the file as a temp file, we load it in with `TextFile
167
 
168
  Why do we want to support streaming? What about streaming is important, or useful?
169
 
 
 
 
 
170
  ### On Chat Start:
171
 
172
  The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
@@ -209,6 +213,11 @@ Now, we'll save that into our user session!
209
 
210
  Why are we using User Session here? What about Python makes us need to use this? Why not just store everything in a global variable?
211
 
 
 
 
 
 
212
  ### On Message
213
 
214
  First, we load our chain from the user session:
@@ -330,10 +339,21 @@ Upload a PDF file of the recent DeepSeek-R1 paper and ask the following question
330
 
331
  1. What is RL and how does it help reasoning?
332
  2. What is the difference between DeepSeek-R1 and DeepSeek-R1-Zero?
333
- 3. What is this paper about?
 
 
 
 
 
 
334
 
335
  Does this application pass your vibe check? Are there any immediate pitfalls you're noticing?
336
 
 
 
 
 
 
337
  ## 🚧 CHALLENGE MODE 🚧
338
 
339
  For the challenge mode, please instead create a simple FastAPI backend with a simple React (or any other JS framework) frontend.
 
167
 
168
  Why do we want to support streaming? What about streaming is important, or useful?
169
 
170
+ This is useful for user-experience. Otherwise we have to wait for the entire response to complete and return which can lead to poor user-experience.
171
+ Other uses include the ability for early stopping if an issue is detected (including the user themselves saying stop-generation) which provides some control over how many tokens are used which is potentially resource/cost-saving.
172
+
173
+
174
  ### On Chat Start:
175
 
176
  The next scope is where "the magic happens". On Chat Start is when a user begins a chat session. This will happen whenever a user opens a new chat window, or refreshes an existing chat window.
 
213
 
214
  Why are we using User Session here? What about Python makes us need to use this? Why not just store everything in a global variable?
215
 
216
+ Isolating the environment for each user ensures that each user's data is isolated. If we store everything in global environments we risk a situation where there are concurrent users of the site and one user uploads a PDF which overrides the other user's PDF.
217
+ From a privacy perspective this isolation ensures users don't have access to each other's data and cant see each other's chats
218
+ Given Python has a Global
219
+ I do not believe there is anything Python-specific that requires this. Using user sessions is considered good engineering design whether Node app or a Python app.
220
+
221
  ### On Message
222
 
223
  First, we load our chain from the user session:
 
339
 
340
  1. What is RL and how does it help reasoning?
341
  2. What is the difference between DeepSeek-R1 and DeepSeek-R1-Zero?
342
+ 3. What is this paper about? <-- fails
343
+
344
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6709e00db992dee2c33f85d2/8fJn8UQEUB2tQwpRymS3b.png)
345
+
346
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6709e00db992dee2c33f85d2/WKjrd4Kq0ltSxHYJaX_Vu.png)
347
+
348
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6709e00db992dee2c33f85d2/9co6kecsU2G1uJs7ZWGJj.png)
349
 
350
  Does this application pass your vibe check? Are there any immediate pitfalls you're noticing?
351
 
352
+ - You cannot ask it questions where particular words do not exist in the PDF and this fails even if the concept exists in the PDF.
353
+ - E.g. "How does DeepSeek compare to SOTA" fails but "How does DeepSeek compare to State-of-the-art?" succeeds
354
+ - This is a very prevalent failure (as evident in that I cant even ask what the paper is about!) and severely restricts how well you can interact and ask questions.
355
+ - From a UX perspective copy-paste doesn't work
356
+
357
  ## 🚧 CHALLENGE MODE 🚧
358
 
359
  For the challenge mode, please instead create a simple FastAPI backend with a simple React (or any other JS framework) frontend.