Code

Add Flash decoding kernel ROCm#2855

Code

Merged

danieldk merged 7 commits intomainhuggingface/text-generation-inference:mainfrom flash_decoding_rocmhuggingface/text-generation-inference:flash_decoding_rocmCopy head branch name to clipboardJan 13, 2025

+53-11

Commits

Commits on Dec 10, 2024

• (vllm) updated vllm rocm kernels

  mht-sharma

  committed
  2cca808

  Copy full SHA for 2cca808

• revert silu

  mht-sharma

  committed
  ca071bd

  Copy full SHA for ca071bd

• update partition size

  mht-sharma

  committed
  07e9ec2

  Copy full SHA for 07e9ec2

• remove grouped_topk

  mht-sharma

  committed
  1194cdb

  Copy full SHA for 1194cdb

Commits on Dec 11, 2024

• (nit) remove log

  mht-sharma

  committed
  999eba8

  Copy full SHA for 999eba8

Commits on Dec 13, 2024

• add flash decoding

  mht-sharma

  committed
  12cb6aa

  Copy full SHA for 12cb6aa

Commits on Dec 18, 2024

• Merge branch 'main' into flash_decoding_rocm

  mht-sharma

  committed
  8936a03

  Copy full SHA for 8936a03