vinmlops commited on
Commit
5cd5fbb
·
verified ·
1 Parent(s): aa7a472

Delete base_vs_cpt.json

Browse files
Files changed (1) hide show
  1. base_vs_cpt.json +0 -39
base_vs_cpt.json DELETED
@@ -1,39 +0,0 @@
1
- {
2
- "method": "full",
3
- "base": [
4
- {
5
- "prompt": "What is attention in a transformer?",
6
- "answer": "How does it work? What is the role of attention in a transformer? How does attention work in a transformer? What is the difference between attention and a transformer? How does attention work in a transformer? What is the role of attention in a transformer? How does attention work in a transformer? What is the difference between attention and a transformer? How does attention work in a transformer? What is the role of attention in a transformer? How does attention work in a transformer? What is the difference between attention and a transformer? How does attention work in a transformer? What is the role of attention in a transformer? How does attention work in"
7
- },
8
- {
9
- "prompt": "Explain what a tokenizer does, simply.",
10
- "answer": "A tokenizer is a tool that breaks down a text into smaller units, such as words or phrases, for easier processing and analysis."
11
- },
12
- {
13
- "prompt": "Give me three tips for fine-tuning an LLM.",
14
- "answer": "The first tip should be about the model architecture. The second tip should be about the training data. The third tip should be about the training process. The first tip for fine-tuning an LLM is to use a model architecture that is well-suited for the specific task at hand. This may involve using a transformer-based architecture, such as BERT or GPT, or a more specialized architecture, such as a sequence-to-sequence model or a graph neural network. The choice of architecture will depend on the nature of the task and the available data.\n\nThe second tip for fine-tuning an LLM is to use high-quality training"
15
- },
16
- {
17
- "prompt": "Who are you?",
18
- "answer": "What is your background? What is your role in the company? What is your job title? What is your job description? What is your salary? What is your job performance? What is your job performance evaluation? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What is your job performance rating? What"
19
- }
20
- ],
21
- "cpt": [
22
- {
23
- "prompt": "What is attention in a transformer?",
24
- "answer": "How does it work? How can we implement it in PyTorch?\n\nAttention is a mechanism in transformers that allows the model to focus on different parts of the input sequence when generating each output token. It works by computing a weighted sum of the input sequence, where the weights are determined by the attention scores between the input and output sequences. In PyTorch, we can implement attention using the `torch.nn.MultiheadAttention` module, which provides a flexible and efficient way to compute attention scores and weights. Here's an example of how to use it:\n\n```python\nimport torch\nfrom torch.nn import MultiheadAttention\n\n# Define"
25
- },
26
- {
27
- "prompt": "Explain what a tokenizer does, simply.",
28
- "answer": "Tokenizers are responsible for breaking down text into smaller units, such as words or subwords, which can then be processed by machine learning models."
29
- },
30
- {
31
- "prompt": "Give me three tips for fine-tuning an LLM.",
32
- "answer": "The first tip should be about the model architecture, the second should be about the training data, and the third should be about the training process. The tips should be in the form of a list, with each tip on a new line. The tips should be in the order of importance, with the most important tip first. The tips should be in the form of a list, with each tip on a new line. The tips should be in the form of a list, with each tip on a new line. The tips should be in the form of a list, with each tip on a new line. The tips should be in the"
33
- },
34
- {
35
- "prompt": "Who are you?",
36
- "answer": "What do you do? What do you like? What do you hate? What do you want? What do you need? What do you fear? What do you hope? What do you believe? What do you know? What do you think? What do you feel? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you do? What do you"
37
- }
38
- ]
39
- }