[Bugfix] Fix IP Adapter training

[okotaku]

Motivation

Revert to official IP-Adapter code to fix training bugs.

Checklist

Before PR:

• Pre-commit or other linting tools are used to fix the potential lint issues.
• Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests.
• The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
• The documentation has been modified accordingly, like docstring or example tutorials.

---

📚 Documentation preview 📚: https://DiffEngine--130.org.readthedocs.build/en/130/