Load LLMs in FP16 for Faster Inference#10
Open
Kyle1668 wants to merge 10 commits intomasterfrom users/kyobrien/model-optim
+905-119
Commits
Commits on Jul 5, 2023
Commits on Jul 15, 2023
Commits on Aug 7, 2023
- committed
Commits on Aug 9, 2023
- committed
- committed
Commits on Aug 18, 2023
- committed
Commits on Sep 14, 2023
Commits on Sep 15, 2023
- committed
- committed
- committed