This repository has been archived by the owner on Feb 14, 2024. It is now read-only.
Test on webkit
#22
ui-tests.yml
on: pull_request
Build
3m 25s
Matrix: Visual Regression
Annotations
12 errors, 2 warnings, and 4 notices
[webkit] › test/general.test.ts:17:7 › General › Kernel is registered:
ui-tests/test/general.test.ts#L23
1) [webkit] › test/general.test.ts:17:7 › General › Kernel is registered ─────────────────────────
Error: Screenshot comparison failed:
3093 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/general.test.ts-snapshots/launcher-webkit-linux.png
Received: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test-results/test-general-General-Kernel-is-registered-webkit/launcher-actual.png
Diff: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test-results/test-general-General-Kernel-is-registered-webkit/launcher-diff.png
21 | throw new Error('Launcher not found');
22 | }
> 23 | expect(await launcherElement.screenshot()).toMatchSnapshot(imageName);
| ^
24 | });
25 | });
26 |
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/general.test.ts:23:48
|
[webkit] › test/general.test.ts:17:7 › General › Kernel is registered:
ui-tests/test/general.test.ts#L23
1) [webkit] › test/general.test.ts:17:7 › General › Kernel is registered ─────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
3093 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/general.test.ts-snapshots/launcher-webkit-linux.png
Received: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test-results/test-general-General-Kernel-is-registered-webkit-retry1/launcher-actual.png
Diff: /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test-results/test-general-General-Kernel-is-registered-webkit-retry1/launcher-diff.png
21 | throw new Error('Launcher not found');
22 | }
> 23 | expect(await launcherElement.screenshot()).toMatchSnapshot(imageName);
| ^
24 | });
25 | });
26 |
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/general.test.ts:23:48
|
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution:
ui-tests/test/execute.test.ts#L27
2) [webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ──────────────────
Error: expect(received).toBeTruthy()
Received: null
25 | const output = await page.notebook.getCellTextOutput(0);
26 |
> 27 | expect(output).toBeTruthy();
| ^
28 | expect(output![0]).toBe('4');
29 | });
30 | });
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/execute.test.ts:27:20
|
Visual Regression (webkit)
Process completed with exit code 1.
|
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution:
ui-tests/test/execute.test.ts#L27
1) [webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ──────────────────
Error: expect(received).toBeTruthy()
Received: null
25 | const output = await page.notebook.getCellTextOutput(0);
26 |
> 27 | expect(output).toBeTruthy();
| ^
28 | expect(output![0]).toBe('4');
29 | });
30 | });
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/execute.test.ts:27:20
|
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution:
ui-tests/test/execute.test.ts#L1
1) [webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ──────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 180000ms exceeded.
|
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution:
ui-tests/test/execute.test.ts#L24
1) [webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ──────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.waitFor: Page closed
=========================== logs ===========================
waiting for locator('#jp-main-statusbar').locator('text=Idle') to be visible
============================================================
22 | await page.notebook.createNew();
23 | await page.notebook.setCell(0, 'code', '2 + 2');
> 24 | await page.notebook.run();
| ^
25 | const output = await page.notebook.getCellTextOutput(0);
26 |
27 | expect(output).toBeTruthy();
at NotebookHelper.waitForRun (/home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:385:23)
at NotebookHelper.run (/home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:276:16)
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/execute.test.ts:24:5
|
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution:
ui-tests/test/execute.test.ts#L1
1) [webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ──────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Pending operations:
- locator.waitFor at node_modules/@jupyterlab/galata/src/helpers/notebook.ts:385:23
|
[webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab:
ui-tests/test/files.test.ts#L1
2) [webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab
Test timeout of 180000ms exceeded.
|
[webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab:
ui-tests/test/files.test.ts#L39
2) [webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab
Error: locator.waitFor: Page closed
=========================== logs ===========================
waiting for locator('#jp-main-statusbar').locator('text=Idle') to be visible
============================================================
37 |
38 | // execute the cells
> 39 | await page.notebook.run();
| ^
40 |
41 | // the first cell output should contain the name of the notebook
42 | const output = await page.notebook.getCellTextOutput(0);
at NotebookHelper.waitForRun (/home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:385:23)
at NotebookHelper.run (/home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:276:16)
at /home/runner/work/xeus-python-kernel/xeus-python-kernel/ui-tests/test/files.test.ts:39:5
|
[webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab:
ui-tests/test/files.test.ts#L1
2) [webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab
Pending operations:
- locator.waitFor at node_modules/@jupyterlab/galata/src/helpers/notebook.ts:385:23
|
Visual Regression (webkit)
Process completed with exit code 1.
|
Visual Regression (firefox)
No files were found with the provided path: ui-tests/test-results. No artifacts will be uploaded.
|
Visual Regression (chromium)
No files were found with the provided path: ui-tests/test-results. No artifacts will be uploaded.
|
🎭 Playwright Run Summary
3 passed (1.7m)
|
🎭 Playwright Run Summary
3 passed (1.2m)
|
🎭 Playwright Run Summary
1 failed
[webkit] › test/general.test.ts:17:7 › General › Kernel is registered ──────────────────────────
1 flaky
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ───────────────────
1 passed (2.1m)
|
🎭 Playwright Run Summary
1 failed
[webkit] › test/execute.test.ts:17:7 › Code execution › Basic code execution ───────────────────
1 flaky
[webkit] › test/files.test.ts:20:7 › File system › Create files from the notebook and open them in JupyterLab
1 passed (7.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
jupyterlite-xeus-python-chromium-test-report
Expired
|
451 KB |
|
jupyterlite-xeus-python-firefox-test-report
Expired
|
452 KB |
|
jupyterlite-xeus-python-ui-tests-app-22
Expired
|
61.5 MB |
|
jupyterlite-xeus-python-webkit-test-report
Expired
|
18 MB |
|
jupyterlite-xeus-python-webkit-updated-snapshots
Expired
|
28 KB |
|
jupyterlite-xeux-python-webkit-test-assets
Expired
|
16.7 MB |
|