AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds failing

[buyaa-n]

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
297099	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87174
296730	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87162
296569	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87114
295996	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86983
295246	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87119
295222	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86391
294783	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87067
294672	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87093
294441	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85373
294326	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85945
294286	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86816
294036	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87055
293260	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86486
293106	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85373
292824	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86983
292543	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86975
292295	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#87001
292181	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86997
289245	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86811
287068	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86578
286984	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86781
286491	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86731
285489	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
285469	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86737
285445	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86732
285411	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86733
285393	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86656
284164	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86675
283957	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86659
283906	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85267
283767	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86657
283683	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86278
283073	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86602
282788	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#84821

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	18	35

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "Tests failed: D:\a\_work\1\s\artifacts\TestResults\Debug\AppHost.Bundle.Tests_net8.0_x86.html",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Author:	buyaa-n
Assignees:	-
Labels:	area-Infrastructure-libraries, blocking-clean-ci, untriaged, Known Build Error
Milestone:	-

[vitek-karas]

Looks like encoding issue somewhere:

The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'
File Name: D:\a_work\1\s\artifacts\tests\Debug\ahb\b4xgpzxv.2h0\LocalizedApp\bundle\LocalizedApp.exe
Arguments:
Exit Code: 0
StdOut:
ನಮಸ್ಕಾರ! வணக்கம்! Hello!

I'm no aware of any changes in the host/related tests, so possibly something from the system around it?

@elinor-fung for ideas.

[elinor-fung]

We haven't changed anything there. It does seem to have been failing intermittently since mid-April based on our test data:

AzureDevOpsTests
| where Repository == "dotnet/runtime"
| where TestName == "AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds"
| where Outcome == "Failed"
| where Message contains "did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'"
| order by RunCompleted asc
| project BuildId, TestRunName, TestName, Message, StackTrace, RunCompleted

[jkotas]

Failed in #86602

Tagging subscribers to this area: @agocke, @vitek-karas, @VSadov
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Microsoft.NET.HostModel.Tests AppHost.Bundle.Tests failing on CI Build Installer Build and Test coreclr windows_x86 Debug

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=265331
Build error leg or test failing: AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
Pull request: #85896

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "The command output did not contain expected result: 'ನಮಸ್ಕಾರ! வணக்கம்! Hello!'",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
284164	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86675
283957	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86659
283906	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds
283833	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#85267
283767	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86657
283683	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86278
283073	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#86602
282788	dotnet/runtime	AppHost.Bundle.Tests.BundleLocalizedApp.Bundled_Localized_App_Run_Succeeds	#84821

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
3	8	8

Author:	buyaa-n
Assignees:	-
Labels:	area-Single-File, blocking-clean-ci, untriaged, Known Build Error
Milestone:	-

[elinor-fung]

Still not sure why exactly this is failing, but the test seems to depend on more external factors than it should (and maybe doesn't compensate for them). I'll try to rework it a bit.