fix the test_hotswapping_compiled_model_xxx case failure in xpu - #13535

fix the test_hotswapping_compiled_model_xxx case failure in xpu#13535

sywangyi wants to merge 1 commit into

huggingface:mainhuggingface/diffusers:mainfrom

sywangyi:host_swap_compiledsywangyi/diffusers:host_swap_compiledCopy head branch name to clipboard