Code

add transformer class for review#11491

Code

Closed

paarthneekhara wants to merge 78 commits intoNVIDIA:mainNVIDIA/NeMo:mainfrom paarthneekhara:tts_new_transformerpaarthneekhara/NeMo:tts_new_transformerCopy head branch name to clipboard

+1,144

Commits

Commits on Dec 5, 2024

• add transformer class for review

  Show description for 1aa3ee3
  paarthneekhara

  committed
  1aa3ee3

  Copy full SHA for 1aa3ee3

• Apply isort and black reformatting

  Show description for bc30ac9
  paarthneekhara

  committed
  bc30ac9

  Copy full SHA for bc30ac9

Commits on Dec 14, 2024

• Addressed most comments, tested it with t5 training locally, but would suggest careful review of changes

  Show description for 2878850
  paarthneekhara

  committed
  2878850

  Copy full SHA for 2878850

• Apply isort and black reformatting

  Show description for 8c2443d
  paarthneekhara

  committed
  8c2443d

  Copy full SHA for 8c2443d

Commits on Dec 16, 2024

• rename

  Show description for 53827ed
  blisc

  committed
  53827ed

  Copy full SHA for 53827ed

• rename ConvNorm; add docstrings; unest context_xattn params dict; remove remove_self_attention param

  Show description for c9c2365
  blisc

  committed
  c9c2365

  Copy full SHA for c9c2365

• remove init_gain from ConvolutionLayer since it gets over-written in TransformerLayer init

  Show description for 5bafb67
  blisc

  committed
  5bafb67

  Copy full SHA for 5bafb67

• Apply isort and black reformatting

  Show description for 6be554a
  blisc

  committed
  6be554a

  Copy full SHA for 6be554a

• style

  Show description for fdc28a6
  blisc

  committed
  fdc28a6

  Copy full SHA for fdc28a6

• replace non_linearity options from string to callable

  Show description for 8bf3736
  blisc

  committed
  8bf3736

  Copy full SHA for 8bf3736

• Apply isort and black reformatting

  Show description for b3171f1
  blisc

  committed
  b3171f1

  Copy full SHA for b3171f1

• remove init_weight_method

  Show description for 62b3490
  blisc

  committed
  62b3490

  Copy full SHA for 62b3490

• Merge branch 'tts_new_transformer' of github.com:paarthneekhara/NeMo into tts_new_transformer

  blisc

  committed
  147be91

  Copy full SHA for 147be91

• change copyright header

  Show description for 074e192
  blisc

  committed
  074e192

  Copy full SHA for 074e192

Commits on Dec 19, 2024

• fixed learnable position embedding, pos embedding args, removed x-attn pos emb and x-attn causal mask args

  Show description for d4793c3
  paarthneekhara

  committed
  d4793c3

  Copy full SHA for d4793c3

• Apply isort and black reformatting

  Show description for ca6b8e7
  paarthneekhara

  committed
  ca6b8e7

  Copy full SHA for ca6b8e7

Commits on Dec 20, 2024

• Apply suggestions from code review from Xuesong

  Show description for bb26ec9
  

  paarthneekhara

  and

  XuesongYang

  authored
  bb26ec9

  Copy full SHA for bb26ec9

• remove flash attn, fix residual attn bug, remove rope, test with t5tts

  Show description for 3a28bf4
  paarthneekhara

  committed
  3a28bf4

  Copy full SHA for 3a28bf4

• Apply isort and black reformatting

  Show description for 4d44246
  paarthneekhara

  committed
  4d44246

  Copy full SHA for 4d44246

Commits on Dec 21, 2024

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for b1cd511
  XuesongYang

  authored
  b1cd511

  Copy full SHA for b1cd511

• fixed typos, add type hints.

  Show description for 98c9496
  XuesongYang

  committed
  98c9496

  Copy full SHA for 98c9496

Commits on Jan 3, 2025

• split Self and Cross Attention

  Show description for 76595ed
  blisc

  committed
  76595ed

  Copy full SHA for 76595ed

• Apply isort and black reformatting

  Show description for b5a2e63
  blisc

  committed
  b5a2e63

  Copy full SHA for b5a2e63

Commits on Jan 7, 2025

• add more documentation

  Show description for 9bcc15f
  blisc

  committed
  9bcc15f

  Copy full SHA for 9bcc15f

• Apply isort and black reformatting

  Show description for 96b66d6
  blisc

  committed
  96b66d6

  Copy full SHA for 96b66d6

Commits on Jan 8, 2025

• fix is_causal param; remove post layernorm

  Show description for 4a826ad
  blisc

  committed
  4a826ad

  Copy full SHA for 4a826ad

Commits on Jan 9, 2025

• fixed typos and remove redudant vairable declaration.

  Show description for 1a25a3b
  XuesongYang

  committed
  1a25a3b

  Copy full SHA for 1a25a3b

• bugfix: missing B, T when self.is_causal is False.

  Show description for f533749
  XuesongYang

  committed
  f533749

  Copy full SHA for f533749

• combine the addition and multiplication ops into a single one.

  Show description for 7d32c0c
  XuesongYang

  committed
  7d32c0c

  Copy full SHA for 7d32c0c

Commits on Jan 10, 2025

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for 894aaee
  XuesongYang

  authored
  894aaee

  Copy full SHA for 894aaee

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for aed46c9
  XuesongYang

  authored
  aed46c9

  Copy full SHA for aed46c9

Commits on Jan 18, 2025

• flip mask

  Show description for 66a1709
  blisc

  committed
  66a1709

  Copy full SHA for 66a1709

• Selfvc ICML (#26)

  Show description for 20b7f8d
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  20b7f8d

  Copy full SHA for 20b7f8d

• self vc updates

  Show description for ca90fe5
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  ca90fe5

  Copy full SHA for ca90fe5

• ci: Fix release tag (NVIDIA#10402)

  Show description for 752c14f
  

  ko3n1g

  authored and

  XuesongYang

  committed
  752c14f

  Copy full SHA for 752c14f

• [🤠]: Howdy folks, let's bump Dockerfile.ci to 73e7b58 ! (NVIDIA#10779)

  Show description for ad5b4b9
  

  2 peopleauthored and

  XuesongYang

  committed
  ad5b4b9

  Copy full SHA for ad5b4b9

• fix: Resolve mutable default issue in MultiModalSampleConfig dataclass (NVIDIA#11061)

  

  michal2409

  authored and

  XuesongYang

  committed
  5f21a9d

  Copy full SHA for 5f21a9d

• add transformer class for review

  Show description for 006c6df
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  006c6df

  Copy full SHA for 006c6df

• Apply isort and black reformatting

  Show description for ce184c6
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  ce184c6

  Copy full SHA for ce184c6

• Addressed most comments, tested it with t5 training locally, but would suggest careful review of changes

  Show description for 83c864a
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  83c864a

  Copy full SHA for 83c864a

• Apply isort and black reformatting

  Show description for 8f2d95b
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  8f2d95b

  Copy full SHA for 8f2d95b

• rename

  Show description for 0e87ca4
  

  blisc

  authored and

  XuesongYang

  committed
  0e87ca4

  Copy full SHA for 0e87ca4

• rename ConvNorm; add docstrings; unest context_xattn params dict; remove remove_self_attention param

  Show description for 769a5a8
  

  blisc

  authored and

  XuesongYang

  committed
  769a5a8

  Copy full SHA for 769a5a8

• remove init_gain from ConvolutionLayer since it gets over-written in TransformerLayer init

  Show description for 4c96021
  

  blisc

  authored and

  XuesongYang

  committed
  4c96021

  Copy full SHA for 4c96021

• Apply isort and black reformatting

  Show description for 1781f20
  

  blisc

  authored and

  XuesongYang

  committed
  1781f20

  Copy full SHA for 1781f20

• style

  Show description for 1e57504
  

  blisc

  authored and

  XuesongYang

  committed
  1e57504

  Copy full SHA for 1e57504

• replace non_linearity options from string to callable

  Show description for 9e62b1c
  

  blisc

  authored and

  XuesongYang

  committed
  9e62b1c

  Copy full SHA for 9e62b1c

• remove init_weight_method

  Show description for d6fb4b0
  

  blisc

  authored and

  XuesongYang

  committed
  d6fb4b0

  Copy full SHA for d6fb4b0

• Apply isort and black reformatting

  Show description for 3937d8a
  

  blisc

  authored and

  XuesongYang

  committed
  3937d8a

  Copy full SHA for 3937d8a

• change copyright header

  Show description for 209ae01
  

  blisc

  authored and

  XuesongYang

  committed
  209ae01

  Copy full SHA for 209ae01

• fixed learnable position embedding, pos embedding args, removed x-attn pos emb and x-attn causal mask args

  Show description for 3a20080
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  3a20080

  Copy full SHA for 3a20080

• Apply isort and black reformatting

  Show description for 2608548
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  2608548

  Copy full SHA for 2608548

• Apply suggestions from code review from Xuesong

  Show description for 63f71ec
  

  paarthneekhara

  and

  XuesongYang

  committed
  63f71ec

  Copy full SHA for 63f71ec

• remove flash attn, fix residual attn bug, remove rope, test with t5tts

  Show description for 354916b
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  354916b

  Copy full SHA for 354916b

• Apply isort and black reformatting

  Show description for 70d68b6
  

  paarthneekhara

  authored and

  XuesongYang

  committed
  70d68b6

  Copy full SHA for 70d68b6

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for 39e96d0
  XuesongYang

  committed
  39e96d0

  Copy full SHA for 39e96d0

• fixed typos, add type hints.

  Show description for 762de59
  XuesongYang

  committed
  762de59

  Copy full SHA for 762de59

• split Self and Cross Attention

  Show description for 1203bf9
  

  blisc

  authored and

  XuesongYang

  committed
  1203bf9

  Copy full SHA for 1203bf9

• Apply isort and black reformatting

  Show description for a013a2c
  

  blisc

  authored and

  XuesongYang

  committed
  a013a2c

  Copy full SHA for a013a2c

• add more documentation

  Show description for 16a994c
  

  blisc

  authored and

  XuesongYang

  committed
  16a994c

  Copy full SHA for 16a994c

• Apply isort and black reformatting

  Show description for 2ba67c2
  

  blisc

  authored and

  XuesongYang

  committed
  2ba67c2

  Copy full SHA for 2ba67c2

• fix is_causal param; remove post layernorm

  Show description for 64f9205
  

  blisc

  authored and

  XuesongYang

  committed
  64f9205

  Copy full SHA for 64f9205

• fixed typos and remove redudant vairable declaration.

  Show description for be0f2a7
  XuesongYang

  committed
  be0f2a7

  Copy full SHA for be0f2a7

• bugfix: missing B, T when self.is_causal is False.

  Show description for b971ed6
  XuesongYang

  committed
  b971ed6

  Copy full SHA for b971ed6

• combine the addition and multiplication ops into a single one.

  Show description for 06a02a1
  XuesongYang

  committed
  06a02a1

  Copy full SHA for 06a02a1

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for debab72
  XuesongYang

  committed
  debab72

  Copy full SHA for debab72

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for 4f23bbe
  XuesongYang

  committed
  4f23bbe

  Copy full SHA for 4f23bbe

• flip mask

  Show description for 34b8bf9
  

  blisc

  authored and

  XuesongYang

  committed
  34b8bf9

  Copy full SHA for 34b8bf9

• Apply isort and black reformatting

  Show description for 0573be8
  

  blisc

  authored and

  XuesongYang

  committed
  0573be8

  Copy full SHA for 0573be8

• Update nemo/collections/tts/modules/transformer_2412.py

  Show description for 1aad73e
  XuesongYang

  committed
  1aad73e

  Copy full SHA for 1aad73e

• add unit tests.

  Show description for d6b05ac
  XuesongYang

  committed
  d6b05ac

  Copy full SHA for d6b05ac

• Apply isort and black reformatting

  Show description for fdc2fa8
  XuesongYang

  committed
  fdc2fa8

  Copy full SHA for fdc2fa8

• rm files that were accidentally added when rebasing.

  Show description for f9bf5b6
  XuesongYang

  committed
  f9bf5b6

  Copy full SHA for f9bf5b6

• revert modified files when rebasing

  Show description for 7fa7295
  XuesongYang

  committed
  7fa7295

  Copy full SHA for 7fa7295

Commits on Jan 19, 2025

• bug fix and multi-encoder test comments

  Show description for 59f137c
  paarthneekhara

  committed
  59f137c

  Copy full SHA for 59f137c

• Apply isort and black reformatting

  Show description for 42c7ee3
  paarthneekhara

  committed
  42c7ee3

  Copy full SHA for 42c7ee3

Commits on Jan 21, 2025

• merge

  Show description for d2c6c7d
  blisc

  committed
  d2c6c7d

  Copy full SHA for d2c6c7d

• move mask to front

  Show description for dcda0a2
  blisc

  committed
  dcda0a2

  Copy full SHA for dcda0a2