You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I found the hidden dimension of FFN in EVA-2 cannot be divided by 256 which would not be suitable for model parallelism. Would you mind releasing the model that meets the requirement as LLaMA did? Thanks.
The text was updated successfully, but these errors were encountered:
Hi, I found the hidden dimension of FFN in EVA-2 cannot be divided by 256 which would not be suitable for model parallelism. Would you mind releasing the model that meets the requirement as LLaMA did? Thanks.
The text was updated successfully, but these errors were encountered: