Skip to content

[Apple][TVOS][release/6.0-staging] Unhandled exception. System.IO.IOException: No space left on device #105146

Description

@richlander

I am seeing this. Either our tests are doing something wrong, our infra isn't cleaning things up, or someone downloaded too many shows.

Leg: Build tvOSSimulator x64 Release AllSubsets_Mono

   at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52
System.IO.IOException: No space left on device : '/Users/runner/runners/3.241.0/_diag/Worker_20240718-051117-utc.log'
   at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset)
   at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite()
   at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
   at System.Diagnostics.TextWriterTraceListener.Flush()
   at Microsoft.VisualStudio.Services.Agent.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 81
   at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message)
   at Microsoft.VisualStudio.Services.Agent.Tracing.Error(Exception exception) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/Tracing.cs:line 56
   at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 66
Unhandled exception. System.IO.IOException: No space left on device : '/Users/runner/runners/3.241.0/_diag/Worker_20240718-051117-utc.log'
   at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset)
   at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite()
   at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
   at System.Diagnostics.TextWriterTraceListener.Flush()
   at System.Diagnostics.TraceSource.Flush()
   at Microsoft.VisualStudio.Services.Agent.TraceManager.Dispose(Boolean disposing) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/TraceManager.cs:line 66
   at Microsoft.VisualStudio.Services.Agent.TraceManager.Dispose() in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/TraceManager.cs:line 58
   at Microsoft.VisualStudio.Services.Agent.HostContext.Dispose(Boolean disposing) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostContext.cs:line 589
   at Microsoft.VisualStudio.Services.Agent.HostContext.Dispose() in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostContext.cs:line 531
   at Microsoft.VisualStudio.Services.Agent.Worker.Program.Main(String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 24
,##[error]We stopped hearing from agent Azure Pipelines 13. Verify the agent machine is running and has a healthy network connection. Anything that terminates an agent process, starves it for CPU, or blocks its network access can cause this error. For more information, see: https://go.microsoft.com/fwlink/?linkid=846610
Agent: Azure Pipelines 13
Started: Wed at 10:11 PM
Duration: 1h 54m 35s

Activity

  1. ghost added
    needs-area-labelAn area label is needed to ensure this gets routed to the appropriate area owners
    on Jul 19, 2024
  2. changed the title [-][Apple[TVOS] Unhandled exception. System.IO.IOException: No space left on device[/-] [+][Apple][TVOS] Unhandled exception. System.IO.IOException: No space left on device[/+] on Jul 19, 2024
  3. dotnet-policy-service commented on Jul 20, 2024

    @dotnet-policy-service
    Contributor

    Tagging subscribers to this area: @dotnet/runtime-infrastructure
    See info in area-owners.md if you want to be subscribed.

  4. ivanpovazan commented on Jul 22, 2024

    @ivanpovazan
    Member
  5. matouskozak commented on Jul 22, 2024

    @matouskozak
    Member

    I took a look at the current state and I'm not seeing this failure anywhere (last 3 rolling builds).

    I see a dip in executed tests between 18-19 of July which could be related to the Azure outage. @richlander do you happen to have a link to the build with this error so I can take a look what happened?

  6. richlander commented on Jul 22, 2024

    @richlander
    MemberAuthor
  7. matouskozak commented on Jul 22, 2024

    @matouskozak
    Member

    #105063

    https://dev.azure.com/dnceng-public/public/_build/results?buildId=745877&view=logs&jobId=cd385208-11d3-5d70-fa38-1c21a65d17f1

    Ah, sorry. I was looking at runtime pipeline and not runtime-staging. Looks like this is a recurring issue on this pipeline. This is a range of commits when the failure started occurring fe40750...4b5fdbc. I wonder if it could be related to the pipeline changes introduced in ac83237.

  8. changed the title [-][Apple][TVOS] Unhandled exception. System.IO.IOException: No space left on device[/-] [+][Apple][TVOS][release/6.0-staging] Unhandled exception. System.IO.IOException: No space left on device[/+] on Jul 22, 2024
  9. richlander commented on Jul 22, 2024

    @richlander
    MemberAuthor

    Sorry for not including the branch name in the title. Will definitely do that next time.

  10. added this to the 9.0.0 milestone on Jul 23, 2024
  11. removed
    untriagedNew issue has not been triaged by the area owner
    on Jul 24, 2024
  12. modified the milestones: 9.0.0, 10.0.0 on Aug 22, 2024
  13. modified the milestones: 10.0.0, 11.0.0 on Jul 15, 2025
  14. modified the milestones: 11.0.0, 12.0.0 on Jul 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions