Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Draft] Split unit tests in CI #17608

Draft
wants to merge 27 commits into
base: master
Choose a base branch
from

Conversation

Akshat-Jain
Copy link
Contributor

@Akshat-Jain Akshat-Jain commented Jan 7, 2025

Description

Currently, the following unit tests take around 50 minutes to run in our CI pipeline:

  • processing_modules_test
  • indexing_modules_test
  • other_modules_test

We can achieve more parallelism by leveraging more GitHub runners, and splitting the tests across them.

This PR splits the unit tests for each of the above 3 modules based on the first character of the test class name into 2 groups:

  • First group: Test classes starting with A-K
  • Second group: Test classes starting with L-Z

The results can be seen with the test runs taking half the duration compared to before.


This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

@github-actions github-actions bot added the GHA label Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant