Add Group Query Attention support with OV base OPs#28163

Draft

sgbihu wants to merge 8 commits intoopenvinotoolkit:masterfrom sgbihu:gqa_enabling

+1,989-1

Commits on Jan 17, 2025

Add Group Query Attention support with OV base OPs

sgbihu
authored and
wine99
committed
Update the transformation code

sgbihu
authored and
wine99
committed
Use scaled_dot_product_attention to improve the perfomance

sgbihu
authored and
wine99
committed
Add OV GQA op and decomposition pass
wine99
committed
clean code
wine99
committed

Commits on Jan 21, 2025

'fix: GQA decomp works on CPU'
wine99
committed

Commits on Jan 22, 2025

Add Null op, GQA decomp works on GPU
wine99
committed

Commits on Jan 23, 2025

Fix GQA decomp interleave; Add onnx frontend tests
wine99
committed