fix ci woa test, disable woa svml optimization (#5846)

fix ci woa test, disable woa svml optimization (#5846) #523