Model does not run on Intel UHD 770 machine with both NVIDIA and Intel GPU

[natke]

On Intel UHD 770, Foundry Local fails to load the openvino-gpu models with new Openvino EP v1.8.63.

Failed loading model qwen2.5-0.5b-instruct-openvino-gpu:2
Could not find an implementation for EPContext(1) node with name 'ContextNode'

Hardware

On an Intel UHD 770 system, 
Name          : Intel(R) UHD Graphics 770
DriverVersion : 32.0.101.7029

Foundry Local version 0.8.117

After the NVIDIA GPU card is removed (physically unplugged it, not just disabled it, which did not resolve the issue), everything works fine and the Foundry Local openvino‑gpu model now run without issues.

A second user experienced the same issue with this machine config

[MichaelQuint]

I also have this issue but disabling the Nvidia GPU from Device Manager on Windows 11 Pro worked for me. Before the release 0.8.119 this was not an issue tho.

[js333031]

I have similar issue with Serpent Canyon NUC which has A770m (dGPU) and Iris Xe Graphics (integrated GPU of i7-12700H CPU)

foundry model run qwen2.5-0.5b
🟢 Service is Started on http://127.0.0.1:65496/, PID 23316!
🕖 Downloading complete!...
Successfully downloaded and registered the following EPs: OpenVINOExecutionProvider.
Valid EPs: CPUExecutionProvider, WebGpuExecutionProvider, OpenVINOExecutionProvider
Downloading qwen2.5-0.5b-instruct-openvino-gpu:2...
[####################################] 100.00 % [Time remaining: about 0s]        27.4 MB/s
🕓 Loading model... [15:32:11 ERR] Failed loading model:qwen2.5-0.5b-instruct-openvino-gpu:2
Exception: Failed: Loading model qwen2.5-0.5b-instruct-openvino-gpu:2 from http://127.0.0.1:65496/openai/load/qwen2.5-0.5b-instruct-openvino-gpu:2?ttl=600
Internal Server Error
Failed loading model qwen2.5-0.5b-instruct-openvino-gpu:2
Could not find an implementation for EPContext(1) node with name 'ContextNode'

If I run the generic model, it works:

foundry model run qwen2.5-0.5b-instruct-generic-gpu:4
Downloading qwen2.5-0.5b-instruct-generic-gpu:4...
[####################################] 100.00 % [Time remaining: about 0s]        35.9 MB/s
Unloading existing models. Use --retain true to keep additional models loaded.
🕘 Loading model...
🟢 Model qwen2.5-0.5b-instruct-generic-gpu:4 loaded successfully

Interactive Chat. Enter /? or /help for help.
Press Ctrl+C to cancel generation. Type /exit to leave the chat.

Interactive mode, please enter your prompt
> why is the sky blue?
🧠 Thinking...
🤖 Hello visitor, your question of "Why is the sky blue?" to me can be asked in two ways: from an environmental science perspective or through the lens of astronomy.

**Environmental Science Perspective**: This answer would focus on how different elements like water vapor, nitrogen dioxide, and carbon dioxide interact with sunlight in various wavelengths to determine whether we see Earth's surface as it appears to us (the horizon). The color spectrum of Earth's atmosphere does not directly correspond to the visible light spectrum of our eyes. The colors we perceive depend heavily on atmospheric conditions rather than direct measurements of what goes on at the bottom of the atmosphere.

To fully understand this phenomenon, let's break it down into smaller steps:

1. **Solar Radiation**: Earth receives its energy primarily from the Sun. As the sun moves across the sky, each spot receives more or less radiation based on the angle from which it faces the Sun.

2. **Water Vapor**: Water vapor absorbs infrared radiation (which matches our perception of the color) when heated up against its surface. However, when we look outwards towards the ground, the ground reflects much more heat back to the Earth's surface compared to being shielded behind clouds or dense clouds.

3. **Clouds**: Clouds absorb infrared radiation and reflect back some, which indirectly affects our vision of the sky. Clouds also influence the amount of light reaching our eyes due to their size and composition.

4. **Sunlight**: When sunlight hits an object such as a cloud, it causes it to bend slightly due to refraction laws. The higher the object is located above sea level, the larger the deflection will be.

5. **Differences in Atmospheric Conditions**: Different factors like temperature and altitude can affect absorption and scattering of sunlight in different regions. These differences result in the observed color shift of the sky.

**Astronomy Perspective**: Another approach is to look into astronomical perspectives which include stellar emission spectra, planetary atmospheres, and planetary rings.

- **Stellar Emission**: Stars emit light that travels outward and includes the redshift effect due to gravitational wave distortion. Observations show that stars in other parts of the universe tend to appear redder.

- **Planetary Rings**: Planets orbiting Jupiter, for example, have bands of clouds that scatter light differently, leading to a unique sky appearance compared to Earth.

- **Planetary Rings in Other Star Systems**: Studying planetary rings around other stars helps researchers understand the presence of volatile compounds and dust grains that could lead to color changes.

Each of these perspectives builds upon our understanding of how the atmosphere interacts with sunlight, resulting in the observed color changes seen in nature.

If you have any questions about either environment or astrophysics beyond the scopes provided here, feel free to ask!
> /bye

[natke]

We have located the source of this error in the Intel OpenVINO EP libraries. A fix will be released as soon as possible