Create README.md

README.md

@@ -0,0 +1,10 @@
+This repo contains a low-rank adapter for LLaMA-7b fit on the Stanford Alpaca Odia dataset.
+
+This version of the weights was trained with the following hyperparameters:
+
+Epochs: 3 (load from best epoch) 
+Batch size: 128 
+Cutoff length: 512 
+Learning rate: 3e-4 Lora 
+r: 16 
+Lora target modules: q_proj, k_proj, v_proj, o_proj