Problem with downloading the model

[tcnguyen]

Hi team,
When runing the model with vllm the model does not seem to be downloaded. Can you investigate?
Thank you

[mehuljariwala]

Hello @tcnguyen

Can you share the exact command you ran and any error output?

A few common things to check:

• The model is ~15GB, so first download takes a while - are you seeing any progress?
• You might need to login to Hugging Face first: huggingface-cli login
• Make sure you have enough disk space

What does the terminal show when you run vllm serve "microsoft/Fara-7B" --port 5000 --dtype auto?