which llama 7b version use?

[trouble-maker007]

did you use llama 7b in the training with the InternViT−6B?
and is there any plan to release a technical report?

[Artanic30]

We use original llama2 7b from meta without any modification. There is no usage of InternViT−6B. More details could be found in our technical report, which will be released soon.

[trouble-maker007]

@Artanic30 Thanks for the quick response. And did you compare with flant5-xxl as the text encoder

[gaopengpjlab]

We release Flag-DiT-5B with LLaMa-7B as text encoder along with Next-DiT-2B with gemma-2B. Compared with flant5-xxl, gemma-2B demonstrate superior multilingual ability. Best wishes. More details are coming soon.

[Artanic30]

We clarify that the specific version of llama2 text encoder is meta-llama/Llama-2-7b-hf.