Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The hosted runner encountered an error while running your job. (Error Type: Disconnect). #1919

Open
3 tasks
lewing opened this issue Jan 30, 2024 · 6 comments
Open
3 tasks

Comments

@lewing
Copy link
Member

lewing commented Jan 30, 2024

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=545844

Build leg reported

Build / osx-x64 Release AllSubsets_Mono_LLVMJIT

Pull Request

https://github.com/dotnet/runtime.git/pull/97694

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The hosted runner encountered an error while running your job. (Error Type: Disconnect).",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
902432 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110888
902217 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110915
902223 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45621
902066 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110856
901257 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110845
2605711 dotnet-runtime osx-arm64 release Mono
900030 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110842
899914 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#108542
899891 dotnet/runtime osx-x64 release Installer_Build_And_Test
898601 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110641
897902 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#101356
897613 dotnet/runtime maccatalyst-x64 release MonoAOTOffsets dotnet/runtime#110688
897504 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44611
897226 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45497
895916 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44862
895127 dotnet/runtime osx-x64 Release AllSubsets_Mono dotnet/runtime#110676
894212 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45430
893832 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110627
893066 dotnet/runtime osx-x64 Debug AllSubsets_Mono_LLVMAOT dotnet/runtime#110632
892857 dotnet/sdk TestBuild: macOS (x64) dotnet/sdk#45298
892798 dotnet/runtime osx-x64 release Installer_Build_And_Test
892733 dotnet/runtime tvos-arm64 Release AllSubsets_NativeAOT dotnet/runtime#110580
892604 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110550
890849 dotnet/sdk TestBuild: macOS (arm64) Log dotnet/sdk#45327
891420 dotnet/sdk AoT: macOS (x64) dotnet/sdk#44268
891154 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110569
890908 dotnet/sdk iOSSimulator_Shortstack_arm64 dotnet/sdk#45352
890588 dotnet/runtime osx-arm64 Debug AllSubsets_CoreCLR dotnet/runtime#110540
890496 dotnet/runtime ios-arm64 Release AllSubsets_NativeAOT dotnet/runtime#110550
889958 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110528
889910 dotnet/aspnetcore Test: macOS dotnet/aspnetcore#59373
888617 dotnet/runtime osx-arm64 release CrossAOT_Mono crossaot dotnet/runtime#110448
888242 dotnet/runtime osx-x64 Release AllSubsets_Mono dotnet/runtime#110475
888132 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110432
888192 dotnet/runtime osx-x64 Release NativeAOT dotnet/runtime#110119
888035 dotnet/runtime Libraries Test Run release coreclr osx x64 Debug dotnet/runtime#108513
887442 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110449
887323 dotnet/runtime osx-x64 Release AllSubsets_Mono dotnet/runtime#110417
886812 dotnet/sdk TestBuild: macOS (arm64) Log dotnet/sdk#45265
886283 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110333
885805 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110105
885563 dotnet/runtime CoreCLR Product Build osx arm64 release
885113 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110344
884815 dotnet/runtime Libraries Test Run release coreclr osx x64 Debug dotnet/runtime#109152
884652 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110344
884466 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45258
881973 dotnet/runtime osx-x64 release Installer_Build_And_Test
881525 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#104503
881166 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110230
881140 dotnet/runtime ios-arm64 Release AllSubsets_NativeAOT dotnet/runtime#110227
880817 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#103950
880619 dotnet/performance windows 22H2 x64 scenarios Open 8.0 dotnet/performance#4594
879554 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#108732
878645 dotnet/runtime osx-x64 release Installer_Build_And_Test dotnet/runtime#110155
878386 dotnet/sdk TestBuild: macOS (x64) dotnet/sdk#45107
878193 dotnet/sdk AoT: macOS (x64) dotnet/sdk#45102

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 11 56

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=545844
Error message validated: The hosted runner encountered an error while running your job. (Error Type: Disconnect).
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/5/2024 8:24:46 PM UTC

@dougbu
Copy link
Member

dougbu commented Jan 30, 2024

this looks a bunch like a low-level and transient issue in AzDO. they provide the macOS-12 images and, somehow, they're responsible for something (somewhere) deciding to deprovision the agent the job started on. have you seen this more than once❔

@garath
Copy link
Member

garath commented Jan 31, 2024

Are you trying to use the "known error" feature here to find other occurances? There is no error message or pattern listed in the configuration blob of this issue, so it won't match to anything.

@dougbu
Copy link
Member

dougbu commented Feb 1, 2024

not sure but we may not have any telemetry containing the interesting lines because they occur between build steps

##[error]The hosted runner encountered an error while running your job. (Error Type: Disconnect).
,##[warning]Received request to deprovision: The request was cancelled by the remote provider.

and, in place of a step's log

Nothing to show. Final logs are missing. This can happen when the job is cancelled or times out.

@garath, @AlitzelMendez, @missymessa, do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

@garath
Copy link
Member

garath commented Feb 1, 2024

do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

No. If AzDO isn't showing the log, then it's likely the data never got captured into AzDO's database. Everything else is driven from that.

@lewing
Copy link
Member Author

lewing commented Feb 6, 2024

not sure but we may not have any telemetry containing the interesting lines because they occur between build steps

##[error]The hosted runner encountered an error while running your job. (Error Type: Disconnect).
,##[warning]Received request to deprovision: The request was cancelled by the remote provider.

and, in place of a step's log

Nothing to show. Final logs are missing. This can happen when the job is cancelled or times out.

@garath, @AlitzelMendez, @missymessa, do we preserve any logs other than those for individual build steps (and Helix work items) for known issue matching❔

I didn't expect it to work so I didn't add the message at first but it does appear to be able to match on that so I updated it and now some results are showing up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants