1) [chromium] › change-course-language.spec.ts:10:5 › Changing course language works › Expect screenshots to match snapshots "course-lang-selection-eng-to-fi" Error: expect(page).toHaveScreenshot(expected) 30027 pixels (ratio 0.07 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/src/__screenshots__/change-course-language.spec.ts/course-lang-selection-eng-to-fi-mobile-tall.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/change-course-language-Changing-course-language-works-chromium/course-lang-selection-eng-to-fi-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/change-course-language-Changing-course-language-works-chromium/course-lang-selection-eng-to-fi-mobile-tall-1-diff.png Call log: - expect.toHaveScreenshot(course-lang-selection-eng-to-fi-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 30027 pixels (ratio 0.07 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 30027 pixels (ratio 0.07 of all image pixels) are different. 19 | await page.getByRole("button", { name: "Settings", exact: true }).click() 20 | > 21 | await expectScreenshotsToMatchSnapshots({ | ^ 22 | screenshotTarget: page, 23 | headless, 24 | testInfo, at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/change-course-language.spec.ts:21:42

2) [chromium] › course-instance-management/course-instance-management.spec.ts:11:5 › Managing course instances works › Expect screenshots to match snapshots "initial-course-management-page" Error: expect(page).toHaveScreenshot(expected) 12250 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/src/__screenshots__/course-instance-management/course-instance-management.spec.ts/initial-course-management-page-mobile-tall.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-instance-management-fee82-ging-course-instances-works-chromium/initial-course-management-page-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-instance-management-fee82-ging-course-instances-works-chromium/initial-course-management-page-mobile-tall-1-diff.png Call log: - expect.toHaveScreenshot(initial-course-management-page-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 12250 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 12250 pixels (ratio 0.03 of all image pixels) are different. 24 | ) 25 | > 26 | await expectScreenshotsToMatchSnapshots({ | ^ 27 | headless, 28 | testInfo, 29 | snapshotName: "initial-course-management-page", at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-instance-management/course-instance-management.spec.ts:26:42

3) [chromium] › draft.spec.ts:54:7 › admin › can create a draft course and change it to a non-draft course › Expect screenshots to match snapshots "draft-course" Error: expect(page).toHaveScreenshot(expected) 10607 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/src/__screenshots__/draft.spec.ts/draft-course-mobile-tall.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/draft-admin-can-create-a-d-e7a07-ge-it-to-a-non-draft-course-chromium/draft-course-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/draft-admin-can-create-a-d-e7a07-ge-it-to-a-non-draft-course-chromium/draft-course-mobile-tall-1-diff.png Call log: - expect.toHaveScreenshot(draft-course-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 10607 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 10607 pixels (ratio 0.03 of all image pixels) are different. 76 | await page.locator("[aria-label=\"Manage\\ course\\ \\'Advanced\\ drafts\\'\"] svg").click() 77 | > 78 | await expectScreenshotsToMatchSnapshots({ | ^ 79 | screenshotTarget: page, 80 | headless, 81 | testInfo, at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/draft.spec.ts:78:44

Process completed with exit code 1.

The job was canceled because "_1" failed.

The operation was canceled.

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

system-tests/[chromium] › history/history.spec.ts took 41.2s

system-tests/[chromium] › course-modules/course-modules.spec.ts took 38.5s

system-tests/[chromium] › glossary.spec.ts took 35.3s

system-tests/[chromium] › course-instance-management/add-completions.spec.ts took 28.8s

system-tests/[chromium] › automatic-completion.spec.ts took 27.9s