Update README.md

README.md

@@ -314,6 +314,154 @@ Model Response: Artificial intelligence promises increased efficiency and innova
 Artificial intelligence promises increased efficiency and innovative solutions, but also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape
 
 ```
+
+
+
+```
+python
+# Ensure the base model is in evaluation mode
+base_model.eval()
+
+# Function to format prompts consistently with training data
+def format_prompt(instruction, context=None):
+    if context:
+        return f"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Input:\n{context}\n\n### Response:\n"
+    else:
+        return f"Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response:\n"
+
+# Reuse the test_prompts defined previously
+# (Assuming test_prompts is available from previous execution or defined globally)
+
+print("\n--- Generating Responses from BASE MODEL ---\n")
+with torch.no_grad():
+    for i, prompt_data in enumerate(test_prompts):
+        instruction = prompt_data["instruction"]
+        context = prompt_data["context"]
+
+        formatted_input = format_prompt(instruction, context)
+
+        # Tokenize the input prompt
+        inputs = tokenizer(formatted_input, return_tensors="pt").to(base_model.device)
+
+        # Generate response using the BASE MODEL
+        outputs = base_model.generate(
+            **inputs,
+            max_new_tokens=150,
+            do_sample=True,
+            temperature=0.7,
+            top_k=50,
+            top_p=0.95,
+            eos_token_id=tokenizer.eos_token_id,
+            pad_token_id=tokenizer.pad_token_id
+        )
+
+        generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
+        response = generated_text[len(formatted_input):].strip()
+
+        print(f"### Test Prompt {i+1} (BASE MODEL): ###")
+        print(f"Instruction: {instruction}")
+        if context:
+            print(f"Context: {context}")
+        print(f"Base Model Response: {response}\n")
+
+
+```
+
+```
+
+--- Generating Responses from BASE MODEL ---
+
+### Test Prompt 1 (BASE MODEL): ###
+Instruction: Explain the concept of photosynthesis in simple terms.
+Base Model Response: Photosynthesis is a process that uses sunlight and a photosynthetic pigment called chlorophyll to convert carbon dioxide into organic molecules called carbohydrates.  In this process, oxygen is converted to water and carbon dioxide.  The oxygen and carbon dioxide are then split into two molecules called O2 and C2.  The two molecules are then used to split the water into hydrogen and oxygen.  The hydrogen and oxygen are then combined to form glucose, which is the sugar that is used as a source of energy.  The process of photosynthesis is extremely important in the life of plants.  It allows plants to convert sunlight into energy that can be used to make food.  The process of photosynthesis is extremely important to the survival of plants.  It allows
+
+### Test Prompt 2 (BASE MODEL): ###
+Instruction: What is the capital of France?
+Base Model Response: Paris is the capital of France.
+
+If you are traveling to France, you should be aware of the following facts:
+
+1. The French language is spoken on both sides of the Atlantic Ocean.
+2. Paris is a city of over 1 million people.
+3. The capital of France is located in Paris, just south of the city of Lyon.
+4. The French capital is home to the Eiffel Tower, the Grand Tour, the Louvre, the Champs Elysees, the Arc de Triomphe, and the Pont Neuf.
+5. The first French colony was established in the New World in the 16th century.
+6. The French Riviera is a beautiful and historic
+
+### Test Prompt 3 (BASE MODEL): ###
+Instruction: Summarize the main idea of the following text:
+Context: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+Base Model Response: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+
+This is an example of a pangram. A pangram is a single-word, single-character word.
+
+A pangram is composed of one or more of the following:
+
+A pangram consists of only the letters in the English alphabet. The letters are always in the order in which they appear in the sentence.
+
+A pangram consists of only the letters in the English alphabet, as in the example.
+
+The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English
+
+### Test Prompt 4 (BASE MODEL): ###
+Instruction: List three benefits of regular exercise.
+Base Model Response: - Improve metabolism
+- Increase muscle mass
+- Improve your immune system
+- Increase your overall energy levels
+- Improve your mood
+- Reduce stress
+- Improve your sleep
+- Improve your memory
+- Reduce your risk of chronic health problems
+- Increase your longevity
+- Lower your blood pressure
+- Lower your cholesterol
+- Increase your energy
+- Increase your heart rate
+- Improve your cognitive function
+- Improve your ability to concentrate
+- Improve your memory
+- Improve your mood
+- Improve your overall energy levels
+- Improve your sleep
+- Improve your memory
+- Improve your ability to concentrate
+- Improve your cognitive function
+- Improve your memory
+- Improve your ability to concentrate
+- Improve your memory
+-
+
+### Test Prompt 5 (BASE MODEL): ###
+Instruction: Write a short, imaginative story about a cat who discovers a secret portal to another dimension under its owner's bed.
+Base Model Response: The cat, who had been living in the home for many years, was so used to being alone that when he was moved to a new room, he didn't know what to do. In the middle of the night, he heard the sound of something moving under the bed. When he looked under the bed, he saw a strange creature in the middle of the bed. He thought it was a ghost and was scared. He tried to get out of the bed, but his feet were too big. He tried to run, but he got stuck on the floor. He thought he would die if he didn't get out of the bed. So, he got out of bed and he ran around the room, looking for a way to get out
+
+### Test Prompt 6 (BASE MODEL): ###
+Instruction: If a train leaves New York at 10 AM traveling at 60 mph and another train leaves Chicago at 11 AM traveling at 50 mph, and the cities are 800 miles apart, at what time do they meet? (Assume they are traveling towards each other on the same track).
+Base Model Response: The train from New York will arrive at the Chicago station around 10 AM. The train from Chicago will arrive at the New York station around 11 AM. At that time, the trains will meet. The exact time will depend on the speed of the train. If the speed of the train is 60 mph, then the time of arrival will be 11:30 AM. If the speed of the train is 50 mph, then the time of arrival will be 10:30 AM. 
+The time of arrival is always the same, regardless of the speed of the train. The only time a train will arrive at the other side of the track is when the speed of the train is zero. 
+
+The train from New York will arrive at the Chicago
+
+### Test Prompt 7 (BASE MODEL): ###
+Instruction: What is the capital of Australia?
+Base Model Response: Sydney, Australia is the capital of Australia. It is also the largest city in Australia. The city is well known for having the tallest bridge in the world. The city is also home to the Australian Museum which is one of the world’s best museums. It is located in the suburb of Manly, a suburb in the city of Bondi Junction. The city is about 20 minutes away from the Gold Coast. It has a large beach and also has a famous surf board. The city has a lot of shopping opportunities like the famous shopping district of Bondi Junction. The city also has a big number of famous bars and restaurants. The city is a great place to visit when you are in Australia. It has many
+
+### Test Prompt 8 (BASE MODEL): ###
+Instruction: Explain the difference between supervised and unsupervised learning in machine learning, and provide an example of when each would be used.
+Base Model Response: In supervised learning, a model is trained with labeled data and then used to predict new data. In unsupervised learning, data is not labeled but is learned based on some information. For example, if we are given a large dataset of customers and we have the ability to predict whether a customer is a good customer, we can use this information to train a model to predict whether a customer is a good customer. In addition, data from the training set can be used to determine which customers are good customers, and so on.
+
+In supervised learning, the model is trained on a labeled dataset and then used to predict new data. In unsupervised learning, the data is not labeled but is learned based on some information. For example, if we
+
+### Test Prompt 9 (BASE MODEL): ###
+Instruction: Summarize the following passage:
+Context: The advent of artificial intelligence has brought forth a new era of technological advancement, impacting various sectors from healthcare to finance. While AI promises increased efficiency and innovative solutions, it also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
+Base Model Response: Artificial intelligence promises increased efficiency and innovative solutions, but also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
+
+The main challenge for society today is to balance progress with human values, and AI is a major part of this effort. We will never be able to fully harness the potential of AI, and its applications will always be subject to the same ethical issues that we face today. AI is already changing the way we do things. Its impact is already being
+
+```
 ---
 
 ## 📊 Why QLoRA?