Update README.md

README.md

@@ -63,9 +63,62 @@ if final_tokenizer.pad_token is None:
     final_tokenizer.pad_token = final_tokenizer.eos_token
 print("Padding token has been set.")
 
-
 # Set the model to evaluation mode
 final_model.eval()
+
+# Run Inference
+print("Preparing prompt and running generation...")
+messages = [{"role": "user", "content": "Please suggest me some mindfullness relaxation techniques to overcome the frustration I have when I deal with Triton kernels."}]
+
+prompt_string = final_tokenizer.apply_chat_template(
+    messages, add_generation_prompt=True, tokenize=False
+)
+
+inputs = final_tokenizer(
+    prompt_string,
+    return_tensors="pt"
+).to(final_model.device)
+
+with torch.no_grad():
+    outputs = final_model.generate(**inputs, max_new_tokens=512)
+    output_ids = outputs[0][len(inputs.input_ids[0]) :]
+
+response_text = final_tokenizer.decode(output_ids, skip_special_tokens=True)
+print("\n--- Generated Response ---")
+print(response_text)
+```
+
+Example text generation:
+
+```
+--- Generated Response ---
+1. Mindful breathing: Take a few deep breaths and focus on your breath. Feel the air entering and leaving your body. This can help you calm down and focus on the present moment.
+
+2. Body scan: Lie down or sit comfortably and focus on each part of your body, starting from your toes and moving up to your head. Notice any tension or discomfort and try to release it.
+
+3. Visualization: Close your eyes and imagine yourself in a peaceful place, such as a beach or forest. Focus on the sights, sounds, and smells around you. This can help you relax and reduce stress.
+
+4. Progressive muscle relaxation: Tense and then relax each muscle group in your body, starting from your toes and moving up to your head. This can help you release tension and relax your body.
+
+5. Mantra repetition: Repeat a calming phrase or mantra to yourself, such as "I am calm" or "I am relaxed." This can help you focus your mind and reduce stress.
+
+6. Walking meditation: Take a slow, mindful walk and focus on each step you take. Notice the feeling of your feet touching the ground and the movement of your legs. This can help you reduce stress and increase mindfulness.
+
+7. Yoga: Practice yoga poses that focus on relaxation and mindfulness, such as child's pose, downward facing dog, and savasana. This can help you reduce stress and increase mindfulness.
+
+8. Guided meditation: Listen to a guided meditation or relaxation exercise. This can help you focus your mind and reduce stress.
+
+9. Mindful eating: Take a few deep breaths and focus on the taste, texture, and smell of your food. This can help you reduce stress and increase mindfulness.
+
+10. Nature walk: Take a slow, mindful walk in nature and focus on the sights, sounds, and smells around you. This can help you reduce stress and increase mindfulness.
+
+Remember to practice these techniques regularly to reduce stress and increase mindfulness.
+
+You can also try using apps such as Headspace, Calm, or Insight Timer to help you practice mindfulness and relaxation techniques. These apps offer guided meditations, breathing exercises, and other mindfulness practices.
+
+Remember to be patient and consistent with your practice, and don't be afraid to try different techniques to find what works best for you.
+
+You can also try seeking support from a therapist or counselor if you are struggling with
 ```
 
 ## Training procedure