Skip to content
Triggered via push November 21, 2023 23:34
Status Cancelled
Total duration 15h 1m 39s
Artifacts 7
AMD mi210  /  Check Runner Status
5s
AMD mi210 / Check Runner Status
AMD mi250  /  Check Runner Status
5s
AMD mi250 / Check Runner Status
Matrix: AMD mi210 / Check Runners
Matrix: AMD mi250 / Check Runners
Matrix: AMD mi210 / Setup
Matrix: AMD mi250 / Setup
Matrix: AMD mi210 / Torch ROCm deepspeed tests
Matrix: AMD mi210 / Examples tests
Matrix: AMD mi210 / PyTorch pipelines tests
Matrix: AMD mi210 / Multi GPU tests
Matrix: AMD mi210 / Single GPU tests
Matrix: AMD mi250 / Torch ROCm deepspeed tests
Matrix: AMD mi250 / Examples tests
Matrix: AMD mi250 / PyTorch pipelines tests
Matrix: AMD mi250 / Multi GPU tests
Matrix: AMD mi250 / Single GPU tests
AMD mi210  /  Extract warnings in CI artifacts
20s
AMD mi210 / Extract warnings in CI artifacts
AMD mi250  /  Extract warnings in CI artifacts
26s
AMD mi250 / Extract warnings in CI artifacts
AMD mi210  /  Send results to webhook
10s
AMD mi210 / Send results to webhook
AMD mi250  /  Send results to webhook
35s
AMD mi250 / Send results to webhook
Fit to window
Zoom out
Zoom in

Annotations

16 errors and 10 warnings
AMD mi250 / PyTorch pipelines tests (multi-gpu)
Process completed with exit code 139.
AMD mi250 / PyTorch pipelines tests (multi-gpu)
Process completed with exit code 1.
AMD mi250 / PyTorch pipelines tests (single-gpu)
System.IO.IOException: No space left on device : '/opt/github-runners/github-runner6/_diag/Worker_20231122-140621-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) Unhandled exception. System.IO.IOException: No space left on device : '/opt/github-runners/github-runner6/_diag/Worker_20231122-140621-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/opt/github-runners/github-runner6/_diag/Worker_20231122-140621-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args)
AMD mi250 / Single GPU tests (models/albert, single-gpu)
System.IO.IOException: No space left on device : '/opt/github-runners/github-runner4/_diag/Worker_20231122-140628-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() Unhandled exception. System.IO.IOException: No space left on device : '/opt/github-runners/github-runner4/_diag/Worker_20231122-140628-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/opt/github-runners/github-runner4/_diag/Worker_20231122-140628-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args)
AMD mi210 / Check Runners (single-gpu)
Process completed with exit code 139.
AMD mi210 / Check Runners (multi-gpu)
The job was canceled because "single-gpu" failed.
AMD mi210 / Check Runners (multi-gpu)
Process completed with exit code 139.
AMD mi250 / Examples tests (single-gpu)
Process completed with exit code 1.
AMD mi250 / Torch ROCm deepspeed tests (single-gpu)
The run was canceled by @echarlaix.
AMD mi250 / Torch ROCm deepspeed tests (single-gpu)
The operation was canceled.
AMD mi250 / Torch ROCm deepspeed tests (multi-gpu)
The run was canceled by @echarlaix.
AMD mi250 / Torch ROCm deepspeed tests (multi-gpu)
The operation was canceled.
AMD mi250 / Single GPU tests (models/bark, single-gpu)
The run was canceled by @echarlaix.
AMD mi250 / Single GPU tests (models/bark, single-gpu)
The operation was canceled.
AMD mi250 / Multi GPU tests (models/albert, multi-gpu)
The run was canceled by @echarlaix.
AMD mi250 / Multi GPU tests (models/albert, multi-gpu)
The operation was canceled.
AMD mi250 / PyTorch pipelines tests (multi-gpu)
No files were found with the provided path: /transformers/reports/multi-gpu_tests_torch_pipeline_gpu. No artifacts will be uploaded.
AMD mi250 / PyTorch pipelines tests (single-gpu)
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 0 MB
AMD mi210 / Send results to webhook
No files were found with the provided path: test_failure_tables. No artifacts will be uploaded.
AMD mi250 / Torch ROCm deepspeed tests (single-gpu)
No files were found with the provided path: /transformers/reports/single-gpu_tests_torch_rocm_deepspeed_gpu. No artifacts will be uploaded.
AMD mi250 / Torch ROCm deepspeed tests (single-gpu)
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 0 MB
AMD mi250 / Torch ROCm deepspeed tests (multi-gpu)
No files were found with the provided path: /transformers/reports/multi-gpu_tests_torch_rocm_deepspeed_gpu. No artifacts will be uploaded.
AMD mi250 / Single GPU tests (models/bark, single-gpu)
No files were found with the provided path: /transformers/reports/single-gpu_tests_gpu_models/bark. No artifacts will be uploaded.
AMD mi250 / Multi GPU tests (models/albert, multi-gpu)
No files were found with the provided path: /transformers/reports/multi-gpu_tests_gpu_models/albert. No artifacts will be uploaded.
AMD mi250 / Multi GPU tests (models/albert, multi-gpu)
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 0 MB
AMD mi250 / Send results to webhook
No files were found with the provided path: test_failure_tables. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
single-gpu_run_all_tests_gpu_models_align_test_reports Expired
30.9 KB
single-gpu_run_all_tests_gpu_models_altclip_test_reports Expired
33.4 KB
single-gpu_run_all_tests_gpu_models_audio_spectrogram_transformer_test_reports Expired
27.4 KB
single-gpu_run_all_tests_gpu_models_auto_test_reports Expired
27.4 KB
single-gpu_run_all_tests_gpu_models_autoformer_test_reports Expired
19.3 KB
single-gpu_run_examples_gpu Expired
117 KB
warnings_in_ci Expired
8.97 KB