MythicalCow commited on
Commit
a22ab3e
·
1 Parent(s): da7ef9d

readme update

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -104,6 +104,21 @@ widget:
104
 
105
  '
106
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
107
 
108
  # SentenceTransformer based on Snowflake/snowflake-arctic-embed-m
109
 
 
104
 
105
  '
106
  ---
107
+ # Github and Technical Report
108
+ To view our technical report and for access to other model and dataset related scripts visit our github [Github](https://github.com/khoj-ai/timely/tree/main)
109
+
110
+ # Timely: An Embeddings Model For Temporal Reasoning
111
+
112
+ At Khoj, we develop open-source personal AI to simplify how people engage with machines. The RAG component in modern AI systems commonly uses an embedding model to retrieve relevant documents for a user query. This retrieved-context enables accurate and personalized responses.
113
+
114
+ However, most of these models struggle with temporal reasoning. For instance, if asked "Where was I last summer?", the model would struggle to understand the framing of that question. It requires us to understand the relativity of time (that 2010 is before 2011), and when summer might be (between May - September).
115
+
116
+ When we express dates, we often use shorthands like ‘back in June’, ‘on summer break’, and ‘06/15’; all syntaxes that models don’t presently handle well. As such, your embedding model may not find documents with dates within that specific period. This limitation is significant, given the importance of time and date in language and daily life.
117
+
118
+ To address this problem, we propose **Timely**, a comprehensive pipeline for date-aware dataset generation, model fine-tuning, and benchmarking. Specifically, our goal is to create models that can:
119
+
120
+ 1. Identify natural language dates in queries and documents better
121
+ 2. Can handle relative and soft data filters more naturally (e.g. discerning that June is closer than November when talking about Spring).
122
 
123
  # SentenceTransformer based on Snowflake/snowflake-arctic-embed-m
124