!mistral-demo $7B_DIR issue

[shaimaa0000]

Hi ,
When I try to run this command '!mistral-demo $7B_DIR', I encounter an issue related to the GPU. Could you please suggest a solution? I am using Google Colab

[sachinsshetty]

replace 7B_DIR with M7B_DIR at all places
looks like an issue with setting environment variables with numeric character.
faced the same issue on ubuntu 22.04. replacing the variable solved the problem.

[patrickvonplaten]

Also note that not every GPU will work with the required version of xformers. If you're having a T4 on google colab, maybe try to manually install a lower version of xformers

[kartikWorld]

you need to have a NVIDIA A100 machine to fine tune. I faced this earlier with V100. After switching to A100, it worked.