System.Net.Quic.Functional.Tests - Helix timeout

[karelz]

There are plenty of failures in System.Net.Quic.Functional.Tests. On other OSs there are different failures than those reported here (incl. on CoreCLR).
Last 30 days in Runfo as of 10/3:

Day	Run	Details
9/30	PR 37171	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/30	PR 37112 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/30	PR 36942	6x PR specific
9/30	PR 36937	Different error - tests finished, Helix failed
9/30	PR 36347	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/30	PR 36173	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/29	PR 35997	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/29	PR 35450	net7.0-Linux-Debug-x64-Mono_release-Ubuntu.1804.Amd64.Open
9/29	PR 35189	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/19-9/28	many others	Not checked all
9/25	Rolling run 29475	net7.0-Linux-Release-x64-Mono_release-Ubuntu.1804.Amd64.Open
9/18	PR 21712 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/16	Rolling run 20304 (7.0)	net7.0-Linux-Release-x64-Mono_release-RedHat.7.Amd64.Open
9/16	Rolling run 19676	net7.0-Linux-Release-x64-Mono_release-RedHat.7.Amd64.Open
9/15	PR 18961 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/15	PR 18480	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/14	PR 17698 (7.0)	net7.0-Linux-Debug-x64-Mono_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open
9/14	PR 16235	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/12	PR 14351 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/12	PR 14249 (7.0)	net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open
9/12	PR 13488	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/11	PR 12061	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	"All" 9415	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 9170	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 9012 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 8814 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 8193	2x net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 7255 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 7228 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/6	PR 6863	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
<=9/6	(not looked at)	...
9/2	Rolling Run 3183	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open

Example Console log - net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open:

  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 106 of 112 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
      Condition(s) not met: "IsQuicUnsupported"
['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

Example Console log - net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open

  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 106 of 112 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
      Condition(s) not met: "IsQuicUnsupported"

...
[EXECUTION TIMED OUT]
Exit Code:-3Executor timed out after 900 seconds and was killed
['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

---

There are plenty of failures in System.Net.Quic.Functional.Tests. On other OSs there are different failures than those reported here.
Last 30 days in Runfo as of 9/19:

Day	Run	Details
9/18	PR 21712 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/16	Rolling run 20304 (7.0)	net7.0-Linux-Release-x64-Mono_release-RedHat.7.Amd64.Open
9/16	Rolling run 19676	net7.0-Linux-Release-x64-Mono_release-RedHat.7.Amd64.Open
9/15	PR 18961 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/15	PR 18480	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/14	PR 17698 (7.0)	net7.0-Linux-Debug-x64-Mono_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open
9/14	PR 16235	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/12	PR 14351 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/12	PR 14249 (7.0)	net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open
9/12	PR 13488	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/11	PR 12061	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	"All" 9415	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 9170	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 9012 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/8	PR 8814 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 8193	2x net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 7255 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/7	PR 7228 (7.0)	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
9/6	PR 6863	net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open
<=9/6	(not looked at)	...

Example Console log - net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open:

  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 106 of 112 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
      Condition(s) not met: "IsQuicUnsupported"
['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

Example Console log - net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open

  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 106 of 112 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
      Condition(s) not met: "IsQuicUnsupported"

...
[EXECUTION TIMED OUT]
Exit Code:-3Executor timed out after 900 seconds and was killed
['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

Author:	karelz
Assignees:	-
Labels:	blocking-clean-ci, area-System.Net.Quic
Milestone:	-

[karelz]

Actually it seems there are similar errors also with System.Globalization.Tests - also on 6.0 and also with various other (similar failures), incl. SIGSEGV
See last 30 days in Runfo
@dotnet/dncenghot can you perhaps advice what might be going on here?

[dkurepa]

Hello, I will create an issue on our side to look into this: dotnet/arcade#10907

[karelz]

There are also lots of failures in System.Net.Security.Tests - with various errors (incl. Helix timeouts, SIGSEGV, SIGABRT)
See last 30 days in Runfo

[steveisok]

I'm no longer seeing this as a problem, so closing.