TitleOS
/

GalacticReasoning-1.3b

text-generation-inference

Model card Files Files and versions

TitleOS commited on Jul 4

Commit

b8a8a59

·

verified ·

1 Parent(s): 1a292c5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -62,7 +62,7 @@ A proper inference script will be provided eventually™ but for the time being,
     print(f"New embed_tokens shape: {model.get_input_embeddings().weight.shape}")
     print(f"New lm_head shape: {model.get_output_embeddings().weight.shape}")
     print("\nLoading adapter...")
-    model.load_adapter(MODEL_NAME, adapter_name="default", device_map="auto")
     print("Adapter loaded successfully!")
     def evaluate(instruction, input=None):

     print(f"New embed_tokens shape: {model.get_input_embeddings().weight.shape}")
     print(f"New lm_head shape: {model.get_output_embeddings().weight.shape}")
     print("\nLoading adapter...")
+    model.load_adapter(ADAPTER_PATH, adapter_name="default", device_map="auto")
     print("Adapter loaded successfully!")
     def evaluate(instruction, input=None):