Add explanation for LISA with model-parallelism

OptimalScale · Apr 2, 2024 · 1f329f3 · 1f329f3
1 parent 9492b1b
commit 1f329f3
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -124,6 +124,8 @@ cd data && ./download.sh alpaca && cd -
   --lisa_interval_steps 20
 ```
 
+We are still working on integrating official model-parallelism support for LISA. Please stay tuned :smile:
+
 ### Finetuning (LoRA)
 LoRA is a parameter-efficient finetuning algorithm and is more efficient than full finetuning.
 ```sh