Export --lisa_interval_steps

OptimalScale · Mar 30, 2024 · 97bb791 · 97bb791
1 parent ed064d5
commit 97bb791
Showing 1 changed file with 2 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -120,7 +120,8 @@ cd data && ./download.sh alpaca && cd -
   --model_name_or_path meta-llama/Llama-2-7b-hf \
   --dataset_path data/alpaca/train \
   --output_model_path output_models/finetuned_llama \
-  --lisa_activated_layers 1
+  --lisa_activated_layers 1 \
+  --lisa_interval_steps 20
 ```
 
 ### Finetuning (LoRA)