Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

profiling: use debug=1 for goroutine profile to avoid STW #1614

Merged
merged 5 commits into from
Dec 14, 2023

Conversation

djshow832
Copy link
Contributor

Refer to pingcap/tidb#48695. With debug=2, there are some huge STWs, which cause latency spikes in TiDB and PD.

@ti-chi-bot ti-chi-bot bot requested a review from Renkai November 25, 2023 09:50
Copy link

netlify bot commented Nov 25, 2023

Deploy Preview for tidb-dashboard ready!

Name Link
🔨 Latest commit 87910a8
🔍 Latest deploy log https://app.netlify.com/sites/tidb-dashboard/deploys/657ad85534be2700087f3242
😎 Deploy Preview https://deploy-preview-1614--tidb-dashboard.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@CLAassistant
Copy link

CLAassistant commented Nov 25, 2023

CLA assistant check
All committers have signed the CLA.

@ti-chi-bot ti-chi-bot bot added the size/XS label Nov 25, 2023
Copy link

codecov bot commented Nov 25, 2023

Codecov Report

Merging #1614 (87910a8) into master (5aec71c) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1614      +/-   ##
==========================================
- Coverage   24.59%   24.59%   -0.01%     
==========================================
  Files         169      169              
  Lines       15314    15315       +1     
==========================================
  Hits         3766     3766              
- Misses      11265    11266       +1     
  Partials      283      283              
Flag Coverage Δ
backend_integration 9.22% <0.00%> (-0.01%) ⬇️
backend_ut 26.43% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5aec71c...87910a8. Read the comment docs.

@mornyx
Copy link
Collaborator

mornyx commented Nov 27, 2023

LGTM

/cc @XuHuaiyu PTAL, we'll revert the change introduced by #1401, so the goroutine profile with stacktrace is no longer available.

@djshow832 djshow832 changed the title profiling: use debug=2 for goroutine profile to avoid STW profiling: use debug=1 for goroutine profile to avoid STW Nov 29, 2023
Copy link
Contributor

ti-chi-bot bot commented Dec 14, 2023

@mornyx: adding LGTM is restricted to approvers and reviewers in OWNERS files.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Copy link
Contributor

ti-chi-bot bot commented Dec 14, 2023

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: mornyx
Once this PR has been reviewed and has the lgtm label, please assign deardrops for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mornyx mornyx merged commit f13291e into pingcap:master Dec 14, 2023
11 of 13 checks passed
mornyx added a commit that referenced this pull request Dec 18, 2023
* use debug=2 for goroutines

* add comment

---------

Co-authored-by: Yexiang Zhang <[email protected]>
Co-authored-by: Sparkle <[email protected]>
@mornyx mornyx mentioned this pull request Dec 18, 2023
mornyx added a commit that referenced this pull request Dec 18, 2023
* feat(slow-query): show org and cluster info in clinic (#1621)

* profiling: Pass the TLS certificate to jeprof (#1624)

* support tls for tikv heap profile

Signed-off-by: Connor1996 <[email protected]>

* add log

Signed-off-by: Connor1996 <[email protected]>

* move log

Signed-off-by: Connor1996 <[email protected]>

* use quote

Signed-off-by: Connor1996 <[email protected]>

* add log

Signed-off-by: Connor1996 <[email protected]>

* change

Signed-off-by: Connor1996 <[email protected]>

* clean

Signed-off-by: Connor1996 <[email protected]>

* fix lint

Signed-off-by: Connor1996 <[email protected]>

---------

Signed-off-by: Connor1996 <[email protected]>

* profiling: use debug=1 for goroutine profile to avoid STW (#1614)

* use debug=2 for goroutines

* add comment

---------

Co-authored-by: Yexiang Zhang <[email protected]>
Co-authored-by: Sparkle <[email protected]>

* add ticdc topology in apiserver (#1622)

* support ticdc in apiserver

* address comment

* fix lint

---------

Co-authored-by: Yexiang Zhang <[email protected]>

* update release-version

Signed-off-by: mornyx <[email protected]>

---------

Signed-off-by: Connor1996 <[email protected]>
Signed-off-by: mornyx <[email protected]>
Co-authored-by: Sparkle <[email protected]>
Co-authored-by: Connor <[email protected]>
Co-authored-by: djshow832 <[email protected]>
Co-authored-by: CharlesCheung <[email protected]>
@djshow832 djshow832 deleted the goroutine_debug branch May 27, 2024 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants