Maoels are not unloaded when a request for another model comes in

[d4mer]

I'm running into an issue where I have a model loaded and then request another model from opencode or openclaw and the first model doesn't unload to allow the new model to load, thus causing oom situation and crash. What am I doing wrong? Shouldn't omlx be able to manage this?

[epicycle]

I seem to be running into this as well myself. I tried using the "Unload model" button from the UI, but I never see the python3 subprocess every drop in memory. I can easily run a few models, but when I want to run a 122B one to plan with and then a few smaller ones to execute, it falls over. How can we get the models to unload? I've watched the process for over an hour, with no traffic to oMLX, and it never unloads.

[d4mer]

Check out the comments on this twitter post. They are about this very issue: https://x.com/ivanfioravanti/status/2043203888908574899?s=46

This seems to be a deal breaker for most

@jundot