Skip to content

Illegal instruction on EMR + Windows #317

Open
Open
Illegal instruction on EMR + Windows#317

Description

@rahulchaphalkar
rahulchaphalkar
opened on Jul 22, 2026

Summary

OneDNN seems to be emitting an illegal instruction (bf16/amx)
Fails in CI (wasmtime -> openvino-rs -> openvino -> onednn)

Version

oneDNN v3.6.2 (commit 5baba71)

Environment

oneDNN includes hardware-specific optimizations and may behave
differently on depending on the compiler and build environment. Include
the following information to help reproduce the issue:

  • CPU make and model - INTEL(R) XEON(R) PLATINUM 8573C
  • OS version - Windows 2025 server
  • Compiler version (gcc --version)
  • CMake version (cmake --version)
  • CMake output log
  • git hash (git log -1 --format=%H)

Steps to reproduce

Please check that the issue is reproducible with the latest revision on
main. Include all the steps to reproduce the issue.

Observed behavior

cargo test -p wasmtime-wasi-nn --features openvino -- openvino --test-threads=1 --nocapture
  shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
  env:
    ONEDNN_VERBOSE: 1
    CARGO_INCREMENTAL: 0
    CARGO_PROFILE_DEV_DEBUG: 0
    CARGO_PROFILE_TEST_DEBUG: 0
    RUSTFLAGS: -D warnings 
    WIT_REQUIRE_SEMICOLONS: 1
    OPENVINO_INSTALL_DIR: D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64
    _OPENVINO_INSTALL_RELEASE: 
    InferenceEngine_DIR:  
    INTEL_OPENVINO_DIR: D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\ 
    OpenVINO_DIR: D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\\runtime\cmake 
    OPENVINO_LIB_PATHS: D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\\runtime\3rdparty\tbb\bin;D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\\runtime\bin\intel64\Release;D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\\runtime\bin\intel64\Debug; 
    TBB_DIR: D:\a\_actions\abrown\install-openvino-action\v10\openvino_toolkit_windows_2025.1.0.18503.6fec06580ab_x86_64\\runtime\3rdparty\tbb\lib\cmake\TBB 
   Compiling proc-macro2 v1.0.101
   Compiling quote v1.0.41
   Compiling unicode-ident v1.0.24
   Compiling libtest-mimic v0.8.1
    Finished `test` profile [unoptimized] target(s) in 4m 05s
     Running unittests src\lib.rs (target\debug\deps\wasmtime_wasi_nn-90492c3d4fd53778.exe)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 3 filtered out; finished in 0.00s

     Running tests\test-programs.rs (target\debug\deps\test_programs-fb370b389455bf6e.exe)
> ignoring nn_wit_image_classification_onnx: requires the `onnx` feature
> found openvino version: 2025.1.0-18503-6fec06580ab-releases/2025/1
> found openvino version: 2025.1.0-18503-6fec06580ab-releases/2025/1
> ignoring nn_wit_image_classification_pytorch: requires the `pytorch` feature
> WinML learning device is available: Ok(LearningModelDevice(IUnknown(0x1c5cc977300)))
> ignoring nn_witx_image_classification_onnx: requires the `onnx` feature
> found openvino version: 2025.1.0-18503-6fec06580ab-releases/2025/1
> found openvino version: 2025.1.0-18503-6fec06580ab-releases/2025/1
> ignoring nn_witx_image_classification_pytorch: requires the `pytorch` feature
> WinML learning device is available: Ok(LearningModelDevice(IUnknown(0x1c5cc977300)))

running 4 tests
test nn_wit_image_classification_openvino        ... > found openvino version: 2025.1.0-18503-6fec06580ab-releases/2025/1
> downloading: "curl" "--location" "--retry" "4" "--retry-delay" "1" "--retry-max-time" "30" "https://download.01.org/openvinotoolkit/fixtures/mobilenet/mobilenet.bin" "--output" "D:\\a\\wasmtime\\wasmtime\\target\\debug\\build\\wasmtime-wasi-nn-6db559e0f462c9aa\\out\\fixtures\\model.bin"
> downloading: "curl" "--location" "--retry" "4" "--retry-delay" "1" "--retry-max-time" "30" "https://download.01.org/openvinotoolkit/fixtures/mobilenet/mobilenet.xml" "--output" "D:\\a\\wasmtime\\wasmtime\\target\\debug\\build\\wasmtime-wasi-nn-6db559e0f462c9aa\\out\\fixtures\\model.xml"
> downloading: "curl" "--location" "--retry" "4" "--retry-delay" "1" "--retry-max-time" "30" "https://download.01.org/openvinotoolkit/fixtures/mobilenet/tensor-1x224x224x3-f32.bgr" "--output" "D:\\a\\wasmtime\\wasmtime\\target\\debug\\build\\wasmtime-wasi-nn-6db559e0f462c9aa\\out\\fixtures\\tensor.bgr"
onednn_verbose,v1,info,oneDNN v3.6.2 (commit 5baba714e16e11309774a62783f363cad30e97c7)
onednn_verbose,v1,info,cpu,runtime:TBB,nthr:2
onednn_verbose,v1,info,cpu,isa:Intel AVX-512 with float16, Intel DL Boost and bfloat16 support and Intel AMX with bfloat16 and 8-bit integer support
onednn_verbose,v1,info,gpu,runtime:none
onednn_verbose,v1,primitive,info,template:operation,engine,primitive,implementation,prop_kind,memory_descriptors,attributes,auxiliary,problem_desc,exec_time
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:Adcb16a::f0,,,32x3x3x3,0.0124
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,32,0.0012
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,32x1x1x3x3,0.0014
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,16x32x1x1,0.0015
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,96x16x1x1,0.0465
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,96,0.0011
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,96x1x1x3x3,0.0018
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,24x96x1x1,0.0164
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,144x24x1x1,0.0148
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,144,0.001
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,144x1x1x3x3,0.0102
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,24x144x1x1,0.0201
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,144x24x1x1,0.0133
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,144,0.002
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,144x1x1x3x3,0.0072
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,32x144x1x1,0.0123
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,192x32x1x1,0.0083
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,192,0.0011
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,192x1x1x3x3,0.0072
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,32x192x1x1,0.0089
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,192x32x1x1,0.0126
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,192,0.0013
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,192x1x1x3x3,0.0054
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,32x192x1x1,0.0175
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,192x32x1x1,0.0133
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,192,0.0009
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,192x1x1x3x3,0.0066
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,64x192x1x1,0.0166
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,384x64x1x1,0.0306
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,384,0.0012
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,384x1x1x3x3,0.0078
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,64x384x1x1,0.0427
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,384x64x1x1,0.044
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,384,0.0012
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,384x1x1x3x3,0.0243
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,64x384x1x1,0.0642
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,384x64x1x1,0.0243
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,384,0.0016
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,384x1x1x3x3,0.0055
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,64x384x1x1,0.0663
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,384x64x1x1,0.0558
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,384,0.0012
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,384x1x1x3x3,0.0065
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,96x384x1x1,0.0818
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,576x96x1x1,0.0812
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,576,0.0012
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,576x1x1x3x3,0.0124
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,96x576x1x1,0.0784
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,576x96x1x1,0.1117
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,576,0.0228
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,576x1x1x3x3,0.0117
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,96x576x1x1,0.0828
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,576x96x1x1,0.0719
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,576,0.0016
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,576x1x1x3x3,0.0104
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,160x576x1x1,0.1089
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,960x160x1x1,0.2309
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,960,0.0016
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,960x1x1x3x3,0.0247
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,160x960x1x1,0.1975
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,960x160x1x1,0.1767
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,960,0.002
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,960x1x1x3x3,0.0179
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,160x960x1x1,0.1611
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,960x160x1x1,0.1754
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:a::f0 dst:bf16::blocked:a::f0,,,960,0.0014
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcde::f0 dst:bf16::blocked:debcA16a::f0,,,960x1x1x3x3,0.0124
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,320x960x1x1,0.2854
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16::blocked:ABcd16b16a2b::f0,,,1280x320x1x1,0.5307
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:f32::blocked:abcd::f0 dst:bf16:p:blocked:ABcd16b16a2b::f0,,,1001x1280x1x1,1.2243
[nn] created wasi-nn execution context with ID: GraphExecutionContext { handle: Resource { handle: 6 } }
[nn] input tensor: 602112 bytes
onednn_verbose,v1,primitive,exec,cpu,reorder,jit:uni,undef,src:bf16::blocked:abcd::f0 dst:bf16::blocked:acdb::f0,,,1x3x224x224,0.1788
error: test failed, to rerun pass `-p wasmtime-wasi-nn --test test-programs`

Caused by:
  process didn't exit successfully: `D:\a\wasmtime\wasmtime\target\debug\deps\test_programs-fb370b389455bf6e.exe openvino --test-threads=1 --nocapture` **(exit code: 0xc000001d, STATUS_ILLEGAL_INSTRUCTION)**
D:\a\_temp\763d4a49-8928-447b-918f-d622c0bd229d.sh: line 1:  1335 Illegal instruction        cargo test -p wasmtime-wasi-nn --features openvino -- openvino --test-threads=1 --nocapture

Expected behavior

No illegal instruction

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions