Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Backward register #423

Draft
wants to merge 20 commits into
base: master
Choose a base branch
from
Draft

Backward register #423

wants to merge 20 commits into from
+1,386 −1,210

Conversation

StrongSpoon
Copy link
Collaborator

PR Category

Operator

Type of Change

New Feature

Description

register backward functions as aten interfaces
implement threshold operator incidentally

Issue

Progress

  • Change is properly reviewed (1 reviewer required, 2 recommended).
  • Change is responded to an issue.
  • Change is fully covered by a UT.

Performance

@StrongSpoon
[Operator] register backward independently for tanh
bf57f51
@StrongSpoon
[Operator] register backward independently for gelu
86499af
@StrongSpoon
[Operator] implement threshold fwd and bwd, as bwd of relu at the sam…
0bbf7ea 
…e time
@StrongSpoon
[Operator] register sigmoid independently
3adf24a
@StrongSpoon
[Operator] register silu backward independently
f30f6c5
@StrongSpoon
[Operator] register dropout backward independently
c601d39
@StrongSpoon
[Operator] register embedding backward
77e16f3
@StrongSpoon
[Operator] register group_norm backward
5da76a4
@StrongSpoon
[Operator] register layer_norm backward
c7a1a30
@StrongSpoon
[Test] test backward with torch.ops.aten functions
64476bc
@StrongSpoon
[Operator] optimize group_norm_backward to allow larger input
1ed5433
@StrongSpoon
[Bugfix] wrong call of threshold_backward
02c8683
@StrongSpoon
[Operator] register backward of softmax
321b3b2
@StrongSpoon
[Operator] register log_softmax backward
e2be412
@StrongSpoon
[Operator] register batch_norm backward
01bee17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@StrongSpoon