Skip to content

Full attention option

Compare
Choose a tag to compare
@tatp22 tatp22 released this 27 Jun 17:44
· 58 commits to master since this release

Added an option to the linformer to compare it with full attention. Watch out, this takes O(n^2) time and space complexity now, where n is the sequence length