Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR #20911: [XLA:GPU] Update cudnn frontend version to 1.9 #21200

Merged
merged 1 commit into from
Jan 11, 2025

Conversation

copybara-service[bot]
Copy link

PR #20911: [XLA:GPU] Update cudnn frontend version to 1.9

Imported from GitHub PR #20911

cudnn frontend 1.9 is released, there are some new features that cudnn flash attention will incorporate, hence this PR.

  • flex attention with arbitrary pointwise operations after softmax in cudnn flash attention graph.
  • sequence packing enhancement with reduced workspace size.

Release note: https://github.com/NVIDIA/cudnn-frontend/releases/tag/v1.9.0
Copybara import of the project:

--
07a0d7a by cjkkkk [email protected]:

update

Merging this change closes #20911

FUTURE_COPYBARA_INTEGRATE_REVIEW=#20911 from Cjkkkk:update_cudnn_fe_1.9 07a0d7a

Imported from GitHub PR #20911

cudnn frontend 1.9 is released, there are some new features that cudnn flash attention will incorporate, hence this PR.
* flex attention with arbitrary pointwise operations after softmax in cudnn flash attention graph.
* [sequence packing](#20861) enhancement with reduced workspace size.

Release note: https://github.com/NVIDIA/cudnn-frontend/releases/tag/v1.9.0
Copybara import of the project:

--
07a0d7a by cjkkkk <[email protected]>:

update

Merging this change closes #20911

COPYBARA_INTEGRATE_REVIEW=#20911 from Cjkkkk:update_cudnn_fe_1.9 07a0d7a
PiperOrigin-RevId: 714287512
@copybara-service copybara-service bot merged commit 39b0baa into main Jan 11, 2025
1 check passed
@copybara-service copybara-service bot deleted the test_713680032 branch January 11, 2025 02:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant