Update README.md

README.md

@@ -130,190 +130,6 @@ model = PeftModel.from_pretrained(base_model, lora_repo)
 
 ```
 
-```python
-import torch
-
-# Ensure the model is in evaluation mode
-model.eval()
-
-# Function to format prompts consistently with training data
-def format_prompt(instruction, context=None):
-    if context:
-        return f"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Input:\n{context}\n\n### Response:\n"
-    else:
-        return f"Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response:\n"
-
-# Define a few test prompts
-test_prompts = [
-    {
-        "instruction": "Explain the concept of photosynthesis in simple terms.",
-        "context": None
-    },
-    {
-        "instruction": "What is the capital of France?",
-        "context": None
-    },
-    {
-        "instruction": "Summarize the main idea of the following text:",
-        "context": "The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram."
-    },
-    {
-        "instruction": "List three benefits of regular exercise.",
-        "context": None
-    }
-]
-
-# Add the new test prompts (assuming `new_test_prompts` is defined as in the previous step)
-new_test_prompts = [
-    {
-        "instruction": "Write a short, imaginative story about a cat who discovers a secret portal to another dimension under its owner's bed.",
-        "context": None
-    },
-    {
-        "instruction": "If a train leaves New York at 10 AM traveling at 60 mph and another train leaves Chicago at 11 AM traveling at 50 mph, and the cities are 800 miles apart, at what time do they meet? (Assume they are traveling towards each other on the same track).",
-        "context": None
-    },
-    {
-        "instruction": "What is the capital of Australia?",
-        "context": None
-    },
-    {
-        "instruction": "Explain the difference between supervised and unsupervised learning in machine learning, and provide an example of when each would be used.",
-        "context": None
-    },
-    {
-        "instruction": "Summarize the following passage:",
-        "context": "The advent of artificial intelligence has brought forth a new era of technological advancement, impacting various sectors from healthcare to finance. While AI promises increased efficiency and innovative solutions, it also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests."
-    }
-]
-test_prompts.extend(new_test_prompts)
-
-# Generate responses for each test prompt
-print("\n--- Generating Responses ---\n")
-with torch.no_grad():
-    for i, prompt_data in enumerate(test_prompts):
-        instruction = prompt_data["instruction"]
-        context = prompt_data["context"]
-
-        formatted_input = format_prompt(instruction, context)
-
-        # Tokenize the input prompt
-        inputs = tokenizer(formatted_input, return_tensors="pt").to(model.device)
-
-        # Generate response, explicitly using both eos_token_id and pad_token_id
-        outputs = model.generate(
-            **inputs,
-            max_new_tokens=150,  # Limit the length of the generated response
-            do_sample=True,      # Enable sampling for more diverse responses
-            temperature=0.7,     # Control randomness (lower means less random)
-            top_k=50,            # Consider only top 50 probable tokens
-            top_p=0.95,          # Nucleus sampling
-            eos_token_id=tokenizer.eos_token_id,
-            pad_token_id=tokenizer.pad_token_id # Explicitly set pad_token_id
-        )
-
-        # Decode the generated tokens
-        # Exclude the input prompt from the decoded text to get only the model's response
-        generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
-        response = generated_text[len(formatted_input):].strip()
-
-        print(f"### Test Prompt {i+1}: ###")
-        print(f"Instruction: {instruction}")
-        if context:
-            print(f"Context: {context}")
-        print(f"Model Response: {response}\n")
-
-```
----
-```
-
---- Generating Responses ---
-
-### Test Prompt 1: ###
-Instruction: Explain the concept of photosynthesis in simple terms.
-Model Response: Photosynthesis is a process in which green plants absorb sunlight and convert it to energy to be used by the living plant. The process of photosynthesis is the process of converting the energy from the sun's rays into an organic compound called a molecule. The process of photosynthesis occurs when the energy from the sun is transformed into chemical energy in the form of energy-rich molecules called pigments. The pigments of the plant are the photosynthetic products and they are absorbed by the plant. The process of photosynthesis is the process of converting the energy from the sun into organic compounds called pigments and absorbing them. In plants, the process of photosynthesis is the process of converting the energy from the sun into organic compounds and converting them into pigments.
-
-### Test Prompt 2: ###
-Instruction: What is the capital of France?
-Model Response: Paris is the capital of France. The city is located on the Mediterranean coast of France and is considered to be the most densely populated city in the world. It has an estimated population of about 8.3 million people. It is the fourth most populous city in Europe and the second most populous city in North America. The city's economy is based on tourism, with most of the tourists coming from around the world. It is also a major international hub for finance and technology. The city has hosted many notable people, including the Pope, who is the longest serving Catholic leader in the world.
-
-The city is the seat of the region of Paris, which has its own government and a parliament called the National Assembly. It is the largest
-
-### Test Prompt 3: ###
-Instruction: Summarize the main idea of the following text:
-Context: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
-Model Response: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
-
-In a pangram, the letters of the alphabet are grouped in a set of groups called "pangrams". The word "pangram" means "a pangram" or "a pangram-like structure".
-
-In the sentence "The quick brown fox jumps over the lazy dog" there are four groups of characters:
-
-The quick brown fox jumps over the lazy dog.
-
-The lazy dog is lazy.
-
-The quick brown fox jumps over the lazy dog.
-
-The lazy dog is not lazy.
-
-The quick brown
-
-### Test Prompt 4: ###
-Instruction: List three benefits of regular exercise.
-Model Response: 1. It helps you stay fit.
-2. It helps you relax.
-3. It helps you lose weight.
-4. It helps you lose your bad habits.
-5. It helps you stay healthy.
-6. It helps you improve your mood.
-7. It helps you sleep better.
-8. It helps you lose your extra weight.
-9. It helps you lose your bad habits.
-10. It helps you live longer.
-11. It helps you live a healthier lifestyle.
-12. It helps you live a healthier lifestyle.
-13. It helps you live a healthier lifestyle.
-14. It helps you live a healthier lifestyle.
-15. It helps you live a healthier lifestyle.
-
-### Test Prompt 5: ###
-Instruction: Write a short, imaginative story about a cat who discovers a secret portal to another dimension under its owner's bed.
-Model Response: Cat, a cat, was sleeping in her bed when she heard a loud noise. She woke up to find her owner, Mr. J, who was out of bed. He said that he heard a loud noise and wondered where the noise was coming from. He then saw the cat's paw print and realized that he was sleeping under his bed. The cat asked him why he was sleeping there and he explained that he had a secret portal to another dimension where he could escape. The cat then told him that he would have to share this secret with him. Mr. J agreed to share this secret with the cat. The cat explained to Mr. J that he would have to find a portal to get to this dimension. Mr. J looked for
-
-### Test Prompt 6: ###
-Instruction: If a train leaves New York at 10 AM traveling at 60 mph and another train leaves Chicago at 11 AM traveling at 50 mph, and the cities are 800 miles apart, at what time do they meet? (Assume they are traveling towards each other on the same track).
-Model Response: The time of arrival is the same. The time of departure is different because the train leaving New York is traveling faster than the train leaving Chicago. If the train leaving New York is at 10 AM and the train leaving Chicago is at 11 AM, then the time of arrival is at 10:00 AM and the time of departure is at 11:00 AM. If the train leaving New York is at 10 AM and the train leaving Chicago is at 11 AM, then the time of arrival is at 10:00 AM and the time of departure is at 11:00 AM. So, the time of arrival is at 10:00 AM and the time of departure is at 11:00 AM.
-
-If the trains are traveling toward each other on
-
-### Test Prompt 7: ###
-Instruction: What is the capital of Australia?
-Model Response: The capital of Australia is Sydney.
-
-Sydney is a city in Australia. It is a major city in Australia. It is the most populous city in Australia.
-
-Sydney is a major financial centre. It is the world's most populous city by a wide margin. It is the world's most populous city by a wide margin.
-
-Sydney is home to the Sydney Opera House and the National Library of Australia.
-
-Sydney is home to the Sydney Harbour Bridge and the Sydney Opera House.
-
-Sydney is home to the Sydney Cricket Ground and the Sydney Football Stadium.
-
-Sydney is home to the Sydney Tower and the Sydney Aquarium.
-
-### Test Prompt 8: ###
-Instruction: Explain the difference between supervised and unsupervised learning in machine learning, and provide an example of when each would be used.
-Model Response: In machine learning, supervised learning requires a dataset that has been labelled by a human. This is often done by manually creating a labelled dataset that has to be annotated with a set of labels that a machine can understand. For example, a machine might be given a dataset of people's names and asked to categorize them. It might be possible for a machine to learn a person's name and then use it to classify the rest of the person's name. It's very easy to train a machine that can do this. However, there are a number of limitations with this approach. For example, a machine that can categorize a person's name may be unable to understand the person's ethnicity, nationality, or any other characteristics that a person might have
-
-### Test Prompt 9: ###
-Instruction: Summarize the following passage:
-Context: The advent of artificial intelligence has brought forth a new era of technological advancement, impacting various sectors from healthcare to finance. While AI promises increased efficiency and innovative solutions, it also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
-Model Response: Artificial intelligence promises increased efficiency and innovative solutions, but also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
-
-Artificial intelligence promises increased efficiency and innovative solutions, but also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape
-
-```
 
 
 
@@ -461,6 +277,116 @@ Base Model Response: Artificial intelligence promises increased efficiency and i
 
 The main challenge for society today is to balance progress with human values, and AI is a major part of this effort. We will never be able to fully harness the potential of AI, and its applications will always be subject to the same ethical issues that we face today. AI is already changing the way we do things. Its impact is already being
 
+```
+
+
+```
+python
+# Ensure the LoRA-tuned model is in evaluation mode
+model.eval()
+
+# Reuse the format_prompt function and test_prompts
+
+print("\n--- Generating Responses from LO-RA TUNED MODEL ---\n")
+with torch.no_grad():
+    for i, prompt_data in enumerate(test_prompts):
+        instruction = prompt_data["instruction"]
+        context = prompt_data["context"]
+
+        formatted_input = format_prompt(instruction, context)
+
+        # Tokenize the input prompt
+        inputs = tokenizer(formatted_input, return_tensors="pt").to(model.device)
+
+        # Generate response using the LO-RA TUNED MODEL
+        outputs = model.generate(
+            **inputs,
+            max_new_tokens=150,
+            do_sample=True,
+            temperature=0.7,
+            top_k=50,
+            top_p=0.95,
+            eos_token_id=tokenizer.eos_token_id,
+            pad_token_id=tokenizer.pad_token_id
+        )
+
+        generated_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
+        response = generated_text[len(formatted_input):].strip()
+
+        print(f"### Test Prompt {i+1} (LO-RA MODEL): ###")
+        print(f"Instruction: {instruction}")
+        if context:
+            print(f"Context: {context}")
+        print(f"LoRA Model Response: {response}\n")
+
+```
+
+```
+
+--- Generating Responses from LO-RA TUNED MODEL ---
+
+### Test Prompt 1 (LO-RA MODEL): ###
+Instruction: Explain the concept of photosynthesis in simple terms.
+LoRA Model Response: Photosynthesis is the process of photosynthesis and the conversion of light energy into chemical energy in the form of ATP. Photosynthesis is a very complicated process and requires a lot of energy to work. It involves converting light energy into chemical energy in the form of ATP. There are many different types of photosynthesis including photosynthesis of plant cells and photosynthesis of living organisms.
+
+Photosynthesis is also the process that converts energy of the sun into fuel. The most common way that photosynthesis is accomplished is through the use of a process called photosynthesis. It is this process that is responsible for photosynthesis. In photosynthesis, the energy of the sun is converted into chemical energy in the form of ATP. The energy of the sun is converted into
+
+### Test Prompt 2 (LO-RA MODEL): ###
+Instruction: What is the capital of France?
+LoRA Model Response: Paris is the capital of France. It is also the largest city in the world by population. The city was founded in the 11th century and has been the seat of the French government since 1831. Paris has a population of around 3.7 million people. The city has over 100 museums, including the Louvre, the Eiffel Tower, the Orsay, the Sacré-Coeur, the Pompidou, and the Gare de Lyon. The French capital has a number of famous landmarks including the Arc de Triomphe, the Eiffel Tower, and the Petit Palais. Paris is the most visited city in the world by tourists. The city is home to some of the most famous artists, including
+
+### Test Prompt 3 (LO-RA MODEL): ###
+Instruction: Summarize the main idea of the following text:
+Context: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+LoRA Model Response: The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+
+The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+
+The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+
+The quick brown fox jumps over the lazy dog. This sentence is often used to display all letters of the English alphabet, making it a pangram.
+
+The quick brown fox jumps over the lazy dog. This sentence is often used to display all
+
+### Test Prompt 4 (LO-RA MODEL): ###
+Instruction: List three benefits of regular exercise.
+LoRA Model Response: Regular exercise is one of the most important things you can do for your health.  Exercise is important for your brain and nervous system.  Regular exercise is also important for your bones.  It will help you sleep better.  It will help you avoid many illnesses, including diabetes.  It will help you get a good night's sleep.  It will help you lose weight.  It will help you keep your muscles strong.  It will help you stay healthy.  It will help you avoid many diseases, including heart disease, cancer, and stroke.  It will help you avoid many illnesses, including asthma, emphysema, and some types of dementia.  It will help you avoid many illnesses, including diabetes, heart
+
+### Test Prompt 5 (LO-RA MODEL): ###
+Instruction: Write a short, imaginative story about a cat who discovers a secret portal to another dimension under its owner's bed.
+LoRA Model Response: Cat's owner is reading a book on the couch, and her cat is watching her. Suddenly, the cat looks up from the book, and says, "I can see the portal!" The owner is so excited that she reaches for the book, and the cat opens it, revealing the portal. The owner is so excited that she falls into the portal and disappears. The cat is so sad that he missed the portal, but he is glad that he was able to get back. The owner runs through the portal, and the cat watches her disappear, and then he runs through the portal too. He is so happy that he was able to get back, but he is sad that he missed the portal. The cat is sad that he missed the
+
+### Test Prompt 6 (LO-RA MODEL): ###
+Instruction: If a train leaves New York at 10 AM traveling at 60 mph and another train leaves Chicago at 11 AM traveling at 50 mph, and the cities are 800 miles apart, at what time do they meet? (Assume they are traveling towards each other on the same track).
+LoRA Model Response: The answer is: they meet at 8:05 AM.
+
+The reason is because the time it takes for one train to travel a given distance is a function of the speed of the train.  If the speed of the train is 60 mph, then the time it takes for one train to travel 800 miles is 8 hours, or about 8 hours and 50 minutes.
+
+If the speed of the train is 50 mph, then the time it takes for one train to travel 800 miles is 14 hours, or about 14 hours and 20 minutes.
+
+So, by the time the train meets, it will have traveled 800 miles.
+
+In this example, Chicago is at 8:05 AM, New York is at 10:05
+
+### Test Prompt 7 (LO-RA MODEL): ###
+Instruction: What is the capital of Australia?
+LoRA Model Response: Canberra is the capital of Australia. It is located in the state of Australia's north east and is about 250 miles (400 km) from Sydney. The city of Sydney is the main city in Australia and the fourth most populous city. Australia is one of the largest countries in the world by area and has a population of about 24 million people.
+
+The city of Canberra is known for being home to the Australian Parliament and the National Library of Australia. The Australian Parliament was moved to the National Library in 2016. It is also home to the Australian Capital Territory Library and the Australian National University Library. The National Library of Australia is the largest library in Australia. The National Library of Australia has more than 1.3 million books
+
+### Test Prompt 8 (LO-RA MODEL): ###
+Instruction: Explain the difference between supervised and unsupervised learning in machine learning, and provide an example of when each would be used.
+LoRA Model Response: In supervised learning, the training data is used to train the model. In unsupervised learning, the model is not trained on the data, but rather, it learns to use data to predict unknown future events.  For example, if you were to use a machine learning algorithm to classify a person's age, you would use a supervised algorithm to train your model to predict when the person will be 30, and you would use an unsupervised algorithm to predict when the person will be 60.  You would then use the trained model to predict when the person will be 90, and you would use the trained model to predict when the person will be 120.  In this example, you would use the model to predict when the person will be 30,
+
+### Test Prompt 9 (LO-RA MODEL): ###
+Instruction: Summarize the following passage:
+Context: The advent of artificial intelligence has brought forth a new era of technological advancement, impacting various sectors from healthcare to finance. While AI promises increased efficiency and innovative solutions, it also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
+LoRA Model Response: AI has brought forth a new era of technological advancement, impacting various sectors from healthcare to finance. While AI promises increased efficiency and innovative solutions, it also raises ethical concerns regarding job displacement, privacy, and bias in algorithms. Societies worldwide are grappling with how to regulate and integrate AI responsibly, balancing progress with human values. This calls for a multidisciplinary approach involving policymakers, technologists, ethicists, and the public to shape a future where AI serves humanity's best interests.
+
+Artificial intelligence has made it possible for computers to think. This has created a new generation of machines that are able to do things that humans are not. Some of these machines are capable of doing more than humans are able to do.
+
+The first
+
 ```
 ---