Skip to content

Able to use convolutional nets instead of linear

Compare
Choose a tag to compare
@tatp22 tatp22 released this 31 Jul 09:28
· 20 commits to master since this release

Now, the linformer supports convolution as a way to downsample the input, instead of relying on linear layers. This may reduce the amount of parameters necessary.