Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dont always compile with fp8, bf16 for cuda #920

Merged
merged 3 commits into from
Nov 20, 2024
Merged

Conversation

EricLBuehler
Copy link
Owner

@EricLBuehler EricLBuehler commented Nov 20, 2024

Should improve CUDA compute cap support.

EricLBuehler/candle#42

Copy link

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           41           22           10            9
 Happy                   1          442          369            0           73
 JSON                   12          105          104            0            1
 Python                 53         2274         1949           63          262
 Shell                   1           57           22           18           17
 TOML                   18          583          520            2           61
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          196          169            1           26
 (Total)                            273          201           32           40
-------------------------------------------------------------------------------
 Markdown               40         3009            0         2286          723
 |- BASH                 6          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               6          114          102            0           12
 |- Rust                10          361          306            0           55
 |- TOML                 2           75           63            0           12
 (Total)                           3672          581         2286          805
-------------------------------------------------------------------------------
 Rust                  280        84868        76146         1762         6960
 |- Markdown           136         1435           25         1306          104
 (Total)                          86303        76171         3068         7064
===============================================================================
 Total                 415        91435        79179         4143         8113
===============================================================================
  

@EricLBuehler EricLBuehler merged commit b408994 into master Nov 20, 2024
12 checks passed
@EricLBuehler EricLBuehler deleted the dont_always_fp8 branch November 20, 2024 19:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant