Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about alignment evaluation or prompt following study? #16

Closed
BruceLeeeee opened this issue May 11, 2024 · 6 comments
Closed

about alignment evaluation or prompt following study? #16

BruceLeeeee opened this issue May 11, 2024 · 6 comments

Comments

@BruceLeeeee
Copy link

Hi, thanks for the amazing work.
I have read your technical report about T2I part, but no found about alignment evaluation or prompt following study.

@gaopengpjlab
Copy link
Contributor

Thanks for your suggestion. We will add more T2I evaluation soon.

@BruceLeeeee
Copy link
Author

And I noticed your model also supports other languages (e.g. Chinese), although the image looks a little worse. I'd like to know if you used other languages text-image pairs in training?

@gaopengpjlab
Copy link
Contributor

The prompts contain only English. However, after english-only training, the Lumina-T2X model developed emerging multilingual capabilities, including the ability to understand and generate Chinese, emoji, Japanese, and other languages.

@gaopengpjlab
Copy link
Contributor

We will include the discuss of emerging multi-lingual ability into our report in the future.

@BruceLeeeee
Copy link
Author

amazing!
it seems no discussion of multilingual capabilities when using large language models as text encoders in current research.

Looking forward to training script support (doesn't work properly right now)

@gaopengpjlab
Copy link
Contributor

We will update the training script soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants