Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v2.321.0 linux-x64 Runner.Listener fails with segfault when emulated on s390x system #3583

Open
theihor opened this issue Nov 19, 2024 · 4 comments
Open

v2.321.0 linux-x64 Runner.Listener fails with segfault when emulated on s390x system #3583

theihor opened this issue Nov 19, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@theihor
Copy link

theihor commented Nov 19, 2024

Describe the bug

v2.321.0 linux-x64 Runner.Listener fails with segfault on startup when running emulated on s390x system.

To Reproduce

The docker image is ghcr.io/kernel-patches/runner:main-noble-s390x@sha256:0e7347243a42f87e06520ab71dbe44250a7e59ba45f569b16c9cf001d2f7f236

Dockerfile

We get this failure on a Linux s390x host with binfmt configured to execute x86_64 binaries via qemu.

Expected behavior

The setup with binfmt has been used successfully for quite a while by Linux Kernel BPF CI.

Revert to v2.320.0 mitigates the issue, which suggests that the cause was introduced recently.

Runner Version and Platform

  • Runner version: v2.321.0
  • Platform: runner binary is linux-x64, host s390x, interpreter qemu

What's not working?

The runner fails to start.

Job Log Output

Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: main-noble-s390x: Pulling from kernel-patches/runner
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: Digest: sha256:0e7347243a42f87e06520ab71dbe44250a7e59ba45f569b16c9cf001d2f7f236
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: Status: Image is up to date for ghcr.io/kernel-patches/runner:main-noble-s390x
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: ghcr.io/kernel-patches/runner:main-noble-s390x
Nov 18 18:30:01 bpf-ci-runner-s390x-03 systemd[1]: Started [email protected] - Ephemeral GitHub Actions Runner Container for kernel-patches - 00.
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Runner reusage is disabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Obtaining the token of the runner
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Ephemeral option is enabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Disable auto update option is enabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Configuring
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: --------------------------------------------------------------------------------
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |        ____ _ _   _   _       _          _        _   _                      |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |       / ___(_) |_| | | |_   _| |__      / \   ___| |_(_) ___  _ __  ___      |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |      | |  _| | __| |_| | | | | '_ \    / _ \ / __| __| |/ _ \| '_ \/ __|     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |      | |_| | | |_|  _  | |_| | |_) |  / ___ \ (__| |_| | (_) | | | \__ \     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |       \____|_|\__|_| |_|\__,_|_.__/  /_/   \_\___|\__|_|\___/|_| |_|___/     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                                                                              |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                       Self-hosted runner registration                        |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                                                                              |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: --------------------------------------------------------------------------------
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: # Authentication
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]: Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.UTF8Encoding.GetCharsWithFallback(System.ReadOnlySpan`1<Byte>, Int32, System.Span`1<Char>, Int32, System.Text.DecoderNLS, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.Encoding.GetCharsWithFallback(Byte*, Int32, Char*, Int32, Int32, Int32, System.Text.DecoderNLS)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.DecoderNLS.Convert(Byte*, Int32, Char*, Int32, Boolean, Int32 ByRef, Int32 ByRef, Boolean ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.DecoderNLS.Convert(Byte[], Int32, Int32, Char[], Int32, Int32, Boolean, Int32 ByRef, Int32 ByRef, Boolean ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.GetChars(Int32)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ReadData()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseQName(Boolean, Int32, Int32 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseElement()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseElementContent()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlLoader.LoadNode(Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlLoader.LoadDocSequence(System.Xml.XmlDocument)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlDocument.Load(System.Xml.XmlReader)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.Internal.XmlUtility.OpenFileHelper(System.String, System.IO.FileShare, Boolean, Boolean, System.Xml.XmlDocument ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.Internal.XmlUtility.OpenXmlFile(System.IO.FileStream ByRef, System.String, System.IO.FileShare, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.EnsureDiskCacheLoadedHelper()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.EnsureDiskCacheLoaded()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.GetLastChangeId()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<FindServiceDefinitionAsync>d__35 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<FindServiceDefinitionAsync>d__35 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider.FindServiceDefinitionAsync(System.String, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<LocationForCurrentConnectionAsync>d__29 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<LocationForCurrentConnectionAsync>d__29 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider.LocationForCurrentConnectionAsync(System.String, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<ResolveLocationDataAsync>d__3 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<ResolveLocationDataAsync>d__3 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService.ResolveLocationDataAsync(System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetLocationDataAsync>d__2 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetLocationDataAsync>d__2 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService.GetLocationDataAsync(System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientInstanceAsync>d__13 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientInstanceAsync>d__13 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientInstanceAsync(System.Type, System.Guid, System.Threading.CancellationToken, GitHub.Services.Common.VssHttpRequestSettings, System.Net.Http.DelegatingHandler[])
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientInstanceAsync(System.Type, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientServiceImplAsync>d__11 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientServiceImplAsync>d__11 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientServiceImplAsync(System.Type, System.Guid, System.Func`4<System.Type,System.Guid,System.Threading.CancellationToken,System.Threading.Tasks.Task`1<System.Object>>, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientAsync>d__10`1<System.__Canon> ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientAsync>d__10`1<System.__Canon> ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientAsync[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]](System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClient[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]]()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task+WhenAllPromise`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Invoke(System.Threading.Tasks.Task)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.Threading.Tasks.VoidTaskResult>, System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.SetResult()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.DecompressionHandler+<SendAsync>d__16.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnection+<SendAsync>d__57.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.Threading.Tasks.VoidTaskResult>, System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncValueTaskMethodBuilder.SetResult()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnection+<InitialFillAsync>d__82.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Sockets.SocketAsyncEventArgs.TransferCompletionCallbackCore(Int32, System.Memory`1<Byte>, System.Net.Sockets.SocketFlags, System.Net.Sockets.SocketError)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Sockets.SocketAsyncEngine.System.Threading.IThreadPoolWorkItem.Execute()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.PortableThreadPool+WorkerThread.WorkerThreadStart()
Nov 18 18:30:21 bpf-ci-runner-s390x-03 docker[3005352]: ./config.sh: line 81:    39 Aborted                 (core dumped) ./bin/Runner.Listener configure "$@"
Nov 18 18:30:28 bpf-ci-runner-s390x-03 docker[3005352]: An error occurred: Not configured. Run config.(sh/cmd) to configure the runner.
Nov 18 18:30:30 bpf-ci-runner-s390x-03 systemd[1]: [email protected]: Main process exited, code=exited, status=1/FAILURE
Nov 18 18:30:30 bpf-ci-runner-s390x-03 systemd[1]: [email protected]: Failed with result 'exit-code'.

Runner and Worker's Diagnostic Logs

Unfortunately these are lost, because unhealthy runners are automatically restarted.
@theihor theihor added the bug Something isn't working label Nov 19, 2024
@theihor
Copy link
Author

theihor commented Nov 19, 2024

CC: @chantra

This issue puts Kernel BPF CI in an unfortunate position:

  • we can't run latest runner release on s390x because of this failure
  • we are forced to update the runners
  • there is no official or even experimental support for native s390x build of the latest runner version

Best case for us: this is just a bug in the application code and it's fixed.

I realize that s390x is not an officially supported platform at the moment, although people did request it: #2263

And there have been attempts to add the support for s390x, but they all seem to be out of date:

.NET is officially supported by Canonical for Ubuntu s390x, and .NET platform is cross-arch. So official s390x runner binaries seem at least feasible.

It would be great to hear from the Github team what is their stance on s390x support. Are there any plans to implement it? A clear "no" would also be helpful, if that is the answer.

Thank you!

@ChristopherHX
Copy link
Contributor

FYI You have still ca. 20 days left with the last .net6.0 runner v2.230.
Make shure to use the disableupdate configuration option for config.sh, after these timespan it won't process any jobs (if this happens earlier it is a bug, because you should have 30 days after a new release to hold back the update)

The current agent switched to .net8, by v.2.231.0, because of end of live of .net6.0.

I do my best to keep my unofficial custom actions runner compatible that has native binaries out of box (aka https://github.com/christopherhx/github-act-runner), but in December it will possible have an outage due to github actions service updates that alters the protocol until I'm affected myself

@ChristopherHX
Copy link
Contributor

Did you try emulating the arm64 binary? I mean it's a .net8 framework issue not application code

@theihor
Copy link
Author

theihor commented Nov 20, 2024

Did you try emulating the arm64 binary? I mean it's a .net8 framework issue not application code

Hi. Thank you for suggestion. I've tried arm64 binary, and it does not crash with segfault. So now we at least have a workaround.

Still, would be great to get a comment on the issue from the GitHub team.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@theihor @ChristopherHX