Skip to content

Commit

Permalink
changed config
Browse files Browse the repository at this point in the history
  • Loading branch information
Jasonqi146 committed Nov 7, 2023
1 parent 9db6bbe commit 2441021
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm_rl/finetune-llama-2-13b.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ deepspeed src/train_bash.py \
--save_strategy "epoch" \
--save_total_limit 5 \
--learning_rate 5e-5 \
--num_train_epochs 10.0 \
--num_train_epochs 15.0 \
--plot_loss \
--bf16 \
--deepspeed ./deepspeed_config_s2.json \
Expand Down

0 comments on commit 2441021

Please sign in to comment.