CUDA out of memory

[jeeyung]

I am using 8 24GB gpus.
I set the LLAVA_PARAMS_PATH as liuhaotian/llava-v1.5-13b and NUM_DEVICES = 8.

I got out of memory error. Could you let me know what I have to change?

[roywang021]

Hello, did you encounter KeyError: 'llava' and how did you handle it