[wasi] Cannot find host wasmtime

[pavelsavara]

Log

    Wasi.Build.Tests.ILStripTests.WasmStripILAfterAOT_TestDefaultAndOverride(stripILAfterAOT: "", expectILStripping: True, singleFileBundle: False) [FAIL]
       Expected 0 exit code but got 255: /root/helix/work/workitem/e/dotnet-latest/dotnet run --no-silent --no-build -c Release
      Standard Output:
      [Release_3ubcj3n5_xxb] WasmAppHost --runtime-config /root/helix/work/workitem/e/wbt artifacts/Release_3ubcj3n5_xxb/bin/Release/net9.0/wasi-wasm/AppBundle/Release_3ubcj3n5_xxb.runtimeconfig.json --no-silent
      [Release_3ubcj3n5_xxb] Error: Cannot find host wasmtime: Tried to look for wasmtime in PATH: /root/helix/work/workitem/e/dotnet-latest, /root/helix/work/correlation/dotnet-latest, /root/helix/work/correlation/xharness-cli, /root/helix/work/correlation/dotnet-cli, /root/helix/work/correlation/wasi-sdk, /root/helix/work/correlation/wasmtime, /home/helixbot/.jsvu/bin, /usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin .

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=621924

Error Message

{
  "ErrorMessage": "Cannot find host wasmtime",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=621924
Error message validated: [Cannot find host wasmtime]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/28/2024 9:09:15 AM UTC

Report

Build	Definition	Test	Pull Request
645396	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100141
645013	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100272
644758	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#101095
640285	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100157
640282	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100938
639606	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100661
639437	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100520
638169	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100407
637618	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100407
637478	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100858
637169	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100847
637144	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100846
635807	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100801
635488	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100386
634844	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100610
634832	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#91042
634711	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100767
633684	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish
631271	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100618
630000	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100407
629576	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100610
629024	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#98492
628517	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#98492
627438	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#96169
626872	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100517
624831	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100402
623845	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100283
623635	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100141
622955	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#96169
621924	dotnet/runtime	Wasi.Build.Tests.WasiTemplateTests.ConsoleBuildThenRunThenPublish	#100251

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	30

[dotnet-policy-service]

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

[pavelsavara]

cc @akoeplinger

[akoeplinger]

It looks like wasmtime is missing from the correlation payload which suggests to me something goes wrong here:

runtime/src/libraries/sendtohelix-wasi.targets

Lines 19 to 24 in 83b0d93

	** Staging system directories before use as helix payloads **
	Helix tries to write a `.payload` file to the payload directory, but if that is
	not writable then it needs to be staged first. For example:
	<HelixDependenciesToStage Condition="'$(NeedsWasmtime)' == 'true'" SourcePath="$(WasmtimeDir)" Include="$(WasmtimeDirForHelixPayload)" />

[maraf]

Red hering - windows investigation - on windows everything works

From Build.binlog
WasmtimeDir = D:\a\_work\1\s\artifacts\obj\wasmtime\
Downloading from "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/bytecodealliance/wasmtime/releases/download/v5.0.0/wasmtime-v5.0.0-x86_64-windows.zip" to "D:\a\_work\1\s\artifacts\obj\wasmtime-v5.0.0-x86_64-windows.zip" (3995602 bytes).

From SendToHelix.binlog
WasmtimeDir = D:\a\_work\1\s\artifacts\obj\wasmtime\
WasmtimeDirForHelixPayload = D:\a\_work\1\s\artifacts\obj\helix-staging\\wasmtime

One of the corellation payload was empty (empty zip) https://helixde107v0xdeko0k025g8.blob.core.windows.net/helix-job-887530b8-8cc0-4dab-a4c8-242ff41fa82b18102e030f94a06bf/c7d44711-29d4-4ff7-944f-947d4f8dea8a.zip

It all seems correct from the binlog :/

From Build.binlog


We don't provision wasmtime on linux. It's preinstalled in the image. Could it be that copy fails because of some symlink or something?

I have tried to ignore WASMTIME_PATH (system provided wasmtime) in #100664 and it worked. The corellation payload that is normally empty, contains wasmtime now.

[maraf]

I'm not seeing it anymore

EDIT: It happens sometimes and on linux lines only