Select NVIDIA GPU instead of Intel.

[yairh]

Hi, first of all, I want to thank you for the good work. It works amazingly well!

I am trying to use the large V3 model, I enabled GPUs, But my Nvidia GPU doesn't get detected only Intel. This is the output of voxtype setup gpu:

=== Voxtype Backend Status ===

Active backend: GPU (Vulkan)
  Binary: /usr/lib/voxtype/voxtype-vulkan

Installation mode: tiered (pre-built)

Available backends:
  CPU (AVX2) - installed
  CPU (AVX-512) - installed
  GPU (Vulkan) - active

GPU detected: Intel Corporation TigerLake-H GT1 [UHD Graphics] (rev 01)
Vulkan runtime: installed

To switch back to CPU:
  sudo voxtype setup gpu --disable

How can I tell Voxtype to use the Nvidia card?
I almost completely dictated this question :)

[peteonrails]

@yairh This looks like a bug, or at least like an overlooked use-case. I'm looking in to it now.

[yairh]

From what I can understand in the code you get the info from lspci and match to first card. It would be cool to have the option to select the gpu we want.

[peteonrails]

I can take a look at making voxtype handle this in a more user-friendly way. In the meantime, could you try this and let me know whether it does what you expect?

VK_LOADER_DRIVERS_SELECT='nvidia*' voxtype daemon

If so, you might consider adding that environment variable to your system to force selection of your nvidia GPU more broadly whenever a Vulkan app is run.

[peteonrails]

Could you try running systemctl --user daemon-reload to see whether it clears things up? Even though the drop in is showing, that might be necessary

[yairh]

I did it several times (I tried tinkering with the service configuration to figure it out). To no avail.
I'll try to figure it out as well.

[yairh]

Another info that might point to the right direction: when I run voxtype directly in the terminal, it doesn't have the VK env variable set and still picks up the Nvidia gpu. But whatever I do in the systemd service always, it always uses the Intel one.

[yairh]

Hi, hope you're okay. After rebooting several times my computer, and I don't know exactly what I did, but now the systemd service also picks up the NVIDIA card. Inference with the turbo model looks great. Thanks again for your great work!

[peteonrails]

Great to hear it! Thanks for letting me know!