Error reported in diagnostic logs. Please examine the log for more details

[jeffschwMSFT]

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532

Error:

System.Net.Http.HttpRequestException: No route to host (dev.azure.com:443)
 ---> System.Net.Sockets.SocketException (65): No route to host
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
   at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at Microsoft.VisualStudio.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Agent.TaskServer.ConnectAsync(VssConnection jobConnection) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/TaskServer.cs:line 42
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 224
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 397
   at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 97
   at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52

Error reported in diagnostic logs. Please examine the log for more details

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "",
    "BuildRetry": false,
    "ErrorPattern": "Error reported in diagnostic logs. Please examine the log for more details",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532
Error message validated: Error reported in diagnostic logs. Please examine the log for more details
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/1/2024 3:50:06 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
901000	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading
899293	dotnet/runtime	windows-x86 checked CoreCLR_ReleaseLibraries	Log	dotnet/runtime#110827
899348	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110824
897529	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#110781
896299	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110688
895768	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#110690
894186	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110671
893752	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110567
893629	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110647
893205	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110476
893149	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110591
892563	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110567
892378	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#110534
892128	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#110477
891546	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110554
891469	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110576
890401	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110491
890425	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#110544
889165	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#110342
887984	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108732
887530	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading
886864	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110384
884899	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110083
884037	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110229
883455	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109087
882454	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109928
882012	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#110254
879353	dotnet/runtime	browser-wasm linux Release LibraryTests
878074	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109996

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	3	29

[lewing]

Looks like mostly macs? not sure where Build Source Index runs

[epananth]

Looked at the latest builds all are failing cos out of space on the device

[epananth]

##[error]Error reported in diagnostic logs. Please examine the log for more details. - /Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log System.IO.IOException: No space left on device : '/Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan1 buffer, Int64 fileOffset)
at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite()
at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
at System.Diagnostics.TextWriterTraceListener.Flush()
at Microsoft.VisualStudio.Services.Agent.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 151
at Microsoft.VisualStudio.Services.Agent.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 81
at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message)
at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 93
at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52`

[epananth]

I am going to go ahead an add a check for disk utilization, to know more why this is failing.

[epananth]

Is it possible to add this check to your pipeline to get more data (like aspnet-core team did)

https://github.com/dotnet/aspnetcore/blob/42af9fe6ddd7c3f9cde04ac003bf97509881873b/.azure/pipelines/jobs/default-build.yml#L163-L165