{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":763774926,"defaultBranch":"master","name":"mistral.rs","ownerLogin":"EricLBuehler","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2024-02-26T22:30:06.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/65165915?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1717182651.0","currentOid":""},"activityList":{"items":[{"before":"402fa16d9743229bc2d88b9e9a1466dc2809a74f","after":"5634a3adfda7ca3c7cece16c280427e91378a78a","ref":"refs/heads/phi3_vision","pushedAt":"2024-06-01T01:09:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Rewrite the pad, hd transform","shortMessageHtmlLink":"Rewrite the pad, hd transform"}},{"before":"1135b463c1dcb8b92a1864dfdc10bbd8dca3a8fc","after":"402fa16d9743229bc2d88b9e9a1466dc2809a74f","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T23:02:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Update","shortMessageHtmlLink":"Update"}},{"before":"c1d6b48d8d9b15fe3f522b91201748f84a7406cf","after":"1135b463c1dcb8b92a1864dfdc10bbd8dca3a8fc","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:59:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Implement messages flattening","shortMessageHtmlLink":"Implement messages flattening"}},{"before":"7a1b8ce75b64982ddbb55ca5453a8f0c44043f5b","after":"c1d6b48d8d9b15fe3f522b91201748f84a7406cf","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:37:01.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Add phi3v","shortMessageHtmlLink":"Add phi3v"}},{"before":"f42b527e6c428898e5fe6d11d1460c421a549132","after":"7a1b8ce75b64982ddbb55ca5453a8f0c44043f5b","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:34:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Setup debug flag","shortMessageHtmlLink":"Setup debug flag"}},{"before":"989eb324dde0443ea5df8494cc0fa7d27dee7625","after":"f42b527e6c428898e5fe6d11d1460c421a549132","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:26:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Allow no processor config","shortMessageHtmlLink":"Allow no processor config"}},{"before":"6e1a6a8d05a7bf1515461525a071a324baab6a8b","after":"989eb324dde0443ea5df8494cc0fa7d27dee7625","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:24:30.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Some defaults","shortMessageHtmlLink":"Some defaults"}},{"before":"b126d2811f7b65c518346c0ae16b163af391cb48","after":"6e1a6a8d05a7bf1515461525a071a324baab6a8b","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:20:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Default for do convert rgb","shortMessageHtmlLink":"Default for do convert rgb"}},{"before":"88a2df8863a92a487ef1210d4727b0b17d553539","after":"b126d2811f7b65c518346c0ae16b163af391cb48","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:19:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Fix varbuilder","shortMessageHtmlLink":"Fix varbuilder"}},{"before":"24092e08d6abe3f405a2d75ec2fabf31d362d237","after":"88a2df8863a92a487ef1210d4727b0b17d553539","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T21:18:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Fix varbuilder","shortMessageHtmlLink":"Fix varbuilder"}},{"before":"971ffa9f95d6fd77b1b2611221995bc6c76eff53","after":"24092e08d6abe3f405a2d75ec2fabf31d362d237","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T19:43:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Rename to phi3v and fix deser","shortMessageHtmlLink":"Rename to phi3v and fix deser"}},{"before":"fe47785ec3b55e23b44b7cb19b65824c27dc79f3","after":"6f4146295105e6949fc3d4fef360d8827af7624b","ref":"refs/heads/gh-pages","pushedAt":"2024-05-31T19:18:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to gh-pages from @ EricLBuehler/mistral.rs@24b33b17e3e56aed0934f1d54c1bd29ccb853e57 🚀","shortMessageHtmlLink":"Deploying to gh-pages from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/EricLBuehler/mistral.rs/commit/24b33b17e3e56aed0934f1d54c1bd29ccb853e57/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/commit/24b33b17e3e56aed0934f1d54c1bd29ccb853e57\"><tt>24b33b1</tt></a> 🚀"}},{"before":"0ec9aeca37bc3c97d6081af7b8cf1e3d32e4f64c","after":"971ffa9f95d6fd77b1b2611221995bc6c76eff53","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T19:15:03.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Merge","shortMessageHtmlLink":"Merge"}},{"before":"67516efac25485589b6b24b8df83a64e01108acb","after":null,"ref":"refs/heads/multi_types_refactor","pushedAt":"2024-05-31T19:10:51.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"}},{"before":"651b9f6b96e2a65bc5dca73dd30a0d6617d48b1d","after":"24b33b17e3e56aed0934f1d54c1bd29ccb853e57","ref":"refs/heads/master","pushedAt":"2024-05-31T19:10:49.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Prepare to accept multiple model types (#369)\n\n* Prepare for embedding and vision models while refactoring code.","shortMessageHtmlLink":"Prepare to accept multiple model types (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2328355102\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EricLBuehler/mistral.rs/issues/369\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EricLBuehler/mistral.rs/pull/369/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/pull/369\">#369</a>)"}},{"before":null,"after":"67516efac25485589b6b24b8df83a64e01108acb","ref":"refs/heads/multi_types_refactor","pushedAt":"2024-05-31T18:11:11.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Prepare","shortMessageHtmlLink":"Prepare"}},{"before":"124720af37db7449433e7f56e606992262ab67e4","after":"0ec9aeca37bc3c97d6081af7b8cf1e3d32e4f64c","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T18:04:25.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Merge branch 'master' into phi3_vision","shortMessageHtmlLink":"Merge branch 'master' into phi3_vision"}},{"before":"635a84206c3059b720215c4b0315b36d481846a8","after":"fe47785ec3b55e23b44b7cb19b65824c27dc79f3","ref":"refs/heads/gh-pages","pushedAt":"2024-05-31T15:47:51.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to gh-pages from @ EricLBuehler/mistral.rs@651b9f6b96e2a65bc5dca73dd30a0d6617d48b1d 🚀","shortMessageHtmlLink":"Deploying to gh-pages from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/EricLBuehler/mistral.rs/commit/651b9f6b96e2a65bc5dca73dd30a0d6617d48b1d/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/commit/651b9f6b96e2a65bc5dca73dd30a0d6617d48b1d\"><tt>651b9f6</tt></a> 🚀"}},{"before":"c096dd080366a4116a7727c30a57a1c2d3d81460","after":null,"ref":"refs/heads/bump_0.1.12","pushedAt":"2024-05-31T15:41:19.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"}},{"before":"d6864285f1d74416cf912daa7746f8c6b860d16b","after":"651b9f6b96e2a65bc5dca73dd30a0d6617d48b1d","ref":"refs/heads/master","pushedAt":"2024-05-31T15:41:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Bump version to 0.1.12 (#368)","shortMessageHtmlLink":"Bump version to 0.1.12 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2328114644\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EricLBuehler/mistral.rs/issues/368\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EricLBuehler/mistral.rs/pull/368/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/pull/368\">#368</a>)"}},{"before":null,"after":"c096dd080366a4116a7727c30a57a1c2d3d81460","ref":"refs/heads/bump_0.1.12","pushedAt":"2024-05-31T15:40:36.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Bump version to 0.1.12","shortMessageHtmlLink":"Bump version to 0.1.12"}},{"before":"2b25d7a60906dcc1a824ca6ee967fd1ad4e03752","after":"635a84206c3059b720215c4b0315b36d481846a8","ref":"refs/heads/gh-pages","pushedAt":"2024-05-31T15:15:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to gh-pages from @ EricLBuehler/mistral.rs@d6864285f1d74416cf912daa7746f8c6b860d16b 🚀","shortMessageHtmlLink":"Deploying to gh-pages from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/EricLBuehler/mistral.rs/commit/d6864285f1d74416cf912daa7746f8c6b860d16b/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/commit/d6864285f1d74416cf912daa7746f8c6b860d16b\"><tt>d686428</tt></a> 🚀"}},{"before":"d06970c7f4360fc15d35747f5ef3a4a34d09b41a","after":null,"ref":"refs/heads/more_flexible_devicemap","pushedAt":"2024-05-31T15:08:27.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"}},{"before":"1d21c5f2d8a75545135741d615fbd7c41106d5d7","after":"d6864285f1d74416cf912daa7746f8c6b860d16b","ref":"refs/heads/master","pushedAt":"2024-05-31T15:08:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Clamp device mapping n device layers (#367)","shortMessageHtmlLink":"Clamp device mapping n device layers (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2328019677\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EricLBuehler/mistral.rs/issues/367\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EricLBuehler/mistral.rs/pull/367/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/pull/367\">#367</a>)"}},{"before":null,"after":"d06970c7f4360fc15d35747f5ef3a4a34d09b41a","ref":"refs/heads/more_flexible_devicemap","pushedAt":"2024-05-31T14:47:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Clamp device mapping n device layers","shortMessageHtmlLink":"Clamp device mapping n device layers"}},{"before":"68e57b6364e6d4caf77362073fb888890634b6f0","after":"124720af37db7449433e7f56e606992262ab67e4","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T01:00:16.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Merge","shortMessageHtmlLink":"Merge"}},{"before":"c3287f54b4a36b7b54afe859fc8b1c91ce6a1e80","after":"2b25d7a60906dcc1a824ca6ee967fd1ad4e03752","ref":"refs/heads/gh-pages","pushedAt":"2024-05-31T00:35:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deploying to gh-pages from @ EricLBuehler/mistral.rs@1d21c5f2d8a75545135741d615fbd7c41106d5d7 🚀","shortMessageHtmlLink":"Deploying to gh-pages from @ <a class=\"commit-link\" data-hovercard-type=\"commit\" data-hovercard-url=\"https://github.com/EricLBuehler/mistral.rs/commit/1d21c5f2d8a75545135741d615fbd7c41106d5d7/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/commit/1d21c5f2d8a75545135741d615fbd7c41106d5d7\"><tt>1d21c5f</tt></a> 🚀"}},{"before":"e1c3e6eba50625b0a98545191364ebaa7e7c5931","after":"1d21c5f2d8a75545135741d615fbd7c41106d5d7","ref":"refs/heads/master","pushedAt":"2024-05-31T00:27:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"refactor: GGUF + GGML Loaders with `ModelKind` (#356)\n\n* chore: Communicate actual difference\r\n\r\nThese methods are very verbose, but really only differ by two params to differentiate from Lora vs XLora.\r\n\r\n* refactor: Introduce `ModelConfig` + `from_gguf` proxy\r\n\r\n`ModelConfig` groups the common properties used across the `from_gguf()` methods. This will better communicate differences across impl of `from_gguf()`.\r\n\r\nThe quantized xlora models `from_gguf()` now have a prop to param forwarder as a workaround to minimize breakage elsewhere.\r\n\r\n* refactor: Add `from_ggml` proxy\r\n\r\nVery similar to the `from_gguf`, except only `quantized_llama.rs` xlora supports this. No `Device` params, slightly different `File` params from GGUF type.\r\n\r\n* chore: DRY `ggml.rs` + `gguf.rs` common adapter config logic\r\n\r\nFinally, all this extra boilerplate can be shifted into the model config `Adapter` struct to self-contain in a single method.\r\n\r\nThis required adjusting ownership a little to satisfy the compiler. The original `from_gguf()` and `from_ggml()` methods are unaffected, they still receive the expected params as reference.\r\n\r\n* refactor(breaking): Leverage traits for `from_gguf()` / `from_ggml()`\r\n\r\nThis introduces a slight breaking change, in that using these `from_gguf()` / `from_ggml()` methods now requires importing the trait into scope.\r\n\r\nThe methods drop the `pub` prefix as they inherit `pub` from the trait requirement itself.\r\n\r\nThe purpose of this trait is to not require each model to duplicate the structs to params mapping helper method. Instead that can be centralized.\r\n\r\n* chore: DRY - Dedupe prop mapping methods\r\n\r\nThese no longer need to be maintained as copies within the supported model modules.\r\n\r\nThey now leverage the common shared traits and take an annotated type parameter to handle.\r\n\r\nThe syntax for usage is presently a little more verbose than desired.\r\n\r\n* chore: Contextual commit - Alternative prop mapping approaches\r\n\r\nFor reference, these alternatives could be considered.\r\n\r\n* refactor: Add equivalent support for quant models without adapters\r\n\r\n- Impl traits for the non-adapter quant models\r\n- Since adapter variants only append parameters and that is now a distinct struct, `model_config` can be defined earlier and a helper `with_adapter()` can convert to the adapter type variant.\r\n\r\n* chore: Fix typo\r\n\r\n* refactor: Collapse Lora + XLora arms\r\n\r\nWith a rebase to adopt new methods for `ModelKind`, the shared logic can be hoisted out of the match arms.\r\n\r\nXLora specific variables were moved into `Adapter::try_new()` (`model_config.rs`) as they can share the same `paths` parameter by adding a separate bool to toggle x-lora usage.\r\n\r\nBy hoisting `model_config` variable out of the match arm, the type would change when calling `with_adapter()`, thus to prevent that the separate `Adapter*` tuple structs have been dropped in favor of `ModelParams<Q>` which uses generic `Q` for the quantization type (trait marker) and a separate adapter optional that can be updated.\r\n\r\n`MapParamsToModel<T>` also is no longer compatible as an approach since the trait bound is ambiguous as there is no distinct adapter type (eg: `for AdapterGGUF`) to impl upon, unique method names also become required to avoid conflict on the same type.\r\n- `try_into_model()` + `try_into_model_with_adapter()` for the separate `Q` types (GGUF/GGML) with/without adapter.\r\n- Due to new struct introduced, slight change to destructuring. The `impl` also bundles both methods now for each `Q` variant. Order was adjusted to basic followed by adapter methods for each `Q` variant, instead of both basic, then both adapter variations following afterwards.\r\n- Likewise the `ggml.rs` and `gguf.rs` methods without the `MapParamsToModel<T>` trait now rely on `TryFrom` trait impl.\r\n\r\n* refactor: Wrap `ModelParams` into enum for distinct adapter type\r\n\r\nThis approach introduces another generic parameter `MaybeAdapter` to emulate a `Option<Adapter>` that can be used as type to `impl` upon.\r\n\r\nTo continue the unified type usage with an adapter variant in `ggml.rs` / `gguf.rs` pipelines, this must now leverage an enum for the two variants.\r\n- Slightly more complexity added as a result.\r\n- Adapter `try_into_model()` methods no longer need to check for `Some(Adapter)` to unwrap, since that should always be the case. This is now guaranteed.\r\n- However similar logic has bubbled up to the `TryFrom` for all impl due to the enum wrapper, thus this approach may not be much better beyond broader consistency. Likewise with the `with_adapter()` method.\r\n\r\nTo minimize boilerplate in handling unwrapping of the enum in the `TryFrom` methods, `Variantly` has been introduced for it's `expect_variant()` method.\r\n\r\nAs all four types are distinct, the `_with_adapter()` method can also be `try_into_model()` due to separate impl for the new generic param `MaybeAdapter`.\r\n\r\n* chore: Minor improvements\r\n\r\nSince the type constraint for `try_into_model()` methods is bound as the return type, it can be inferred without any hint in the `TryFrom`, no need to annotate with `Self`.\r\n\r\nUse `derive_more` for terser construction of `Config` struct for `ModelParams` variants.\r\n\r\n* refactor: Use `buildstructor` for builder API\r\n\r\nThis is an alternative approach to build the config. Construction of the config from the param inputs is handled at the end now, not dependent upon separate `new()` + optional `with_adapter()` calls on a mutable variable.\r\n\r\nUnfortunately `buildstructor` and `typed-builder` APIs don't allow for easy flexibility of builder methods in different scopes (_due to moves_). `derive-builder` can do this but not with the more complex types due to lack of a `Copy` / `Clone`. Thus the `None` option is required as input regardless of if an adapter is needed.\r\n\r\n* chore: Wrap `model_config` assignment into expression\r\n\r\nThis better communicates the block is only relevant to assigning this value. While the two `is_lora` / `is_xlora` variables are hoisted above due to usage later as metadata inputs.\r\n\r\n* fix: Drop `is_lora` from `GeneralMetadata`\r\n\r\n`pipeline/gguf.rs` + `pipeline/ggml.rs` now ensure that `activate_adapters()` works for X-LoRA too. This is assumed as a bugfix due to the `XLoraLlama` model the two adapter kinds share along with code everywhere else checking `is_xlora`, no other usage of `is_lora` seems to be used.\r\n- To ensure further ambiguity is avoided, the condition is better communicated as `has_adapter`.\r\n- It is unclear if all usage of `is_xlora` is specific to X-LoRA or also intended to be applicable to LoRA since `XLora*` models do impl `is_xlora() -> true` (except Gemma, which is a potential bug).\r\n\r\n`pipeline/normal.rs` handled it's own `is_xlora` bool differently than `gguf.rs` / `ggml.rs` loaders.\r\n- It relied upon`model.is_xlora() && !is_lora`, but we already assume X-LoRA via prior matching  on `ModelKind` which now provides this information via it's own `is_x_lora()` method.\r\n- Only `xlora_models/gemma.rs` would behave differently with this change, but Gemma might have meant to return `true`?\r\n\r\n* chore: Match on adapter\r\n\r\nMatches are only for `Quantized` or `AdapterQuantized` variants with no difference in handling by `AdapterKind` variant used.\r\n\r\nAdditionally restores the `GGUF X-LoRA` bail formatted string. For consistency the non-adapter branch also appends `for GGUF` and the architecture in the lora branch now comes before the `ModelKind`.\r\n\r\n* chore: Support params via tuple `into()` + add note of possible bug\r\n\r\n* breaking: Replace `ModelKind` with new version\r\n\r\nA better approach for the most part at encoding the kind info.\r\n\r\n* lint(clippy): Appease the lint gods\r\n\r\n`model_config.rs` GGUF and GGML structs prefixed with `Params`.\r\n\r\nTwo exceptions added as the concerns don't seem to warrant change:\r\n- `#[allow(clippy::borrowed_box)]`\r\n- `#[allow(clippy::large_enum_variant)]`\r\n\r\n* chore: Convert from `CRLF` to `LF`\r\n\r\nThis file has no other change in the commit beyond line ending conversion. It was mistakenly using CRLF since creation.\r\n\r\n* lint(rustfmt): Appease the lint gods\r\n\r\n* fix: Restore `is_lora` condition\r\n\r\n`GeneralMetadata` now stores the `ModelKind` for this type of information.\r\n\r\n`activate_adapters()` error message revised. `mod.rs` version includes contextual comment about X-LoRA not being equivalent.\r\n\r\n* fix: Gemma X-Lora model `is_xlora()` should return `true`\r\n\r\nMost likely redundant with `GeneralMetadata` now having `ModelKind` to query, but fixing here until all queries replaced.\r\n\r\nAdditionally updates `model_config.rs` note to clarify not a bug.","shortMessageHtmlLink":"refactor: GGUF + GGML Loaders with <code>ModelKind</code> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2321379085\" data-permission-text=\"Title is private\" data-url=\"https://github.com/EricLBuehler/mistral.rs/issues/356\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/EricLBuehler/mistral.rs/pull/356/hovercard\" href=\"https://github.com/EricLBuehler/mistral.rs/pull/356\">#356</a>)"}},{"before":"cca71d4e64af2eef8aea9ac6c1495d5585a7ffd5","after":"8def4a8cba5266f0d90cf6240a91bd66cd424764","ref":"refs/heads/idefics2","pushedAt":"2024-05-31T00:25:38.000Z","pushType":"push","commitsCount":8,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Merge branch 'master' into idefics2","shortMessageHtmlLink":"Merge branch 'master' into idefics2"}},{"before":"37a5b8ff7a6b956e3e43785f6b1426c1dbb442ee","after":"68e57b6364e6d4caf77362073fb888890634b6f0","ref":"refs/heads/phi3_vision","pushedAt":"2024-05-31T00:25:22.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"EricLBuehler","name":"Eric Buehler","path":"/EricLBuehler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/65165915?s=80&v=4"},"commit":{"message":"Merge branch 'master' into phi3_vision","shortMessageHtmlLink":"Merge branch 'master' into phi3_vision"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEWX-UTgA","startCursor":null,"endCursor":null}},"title":"Activity · EricLBuehler/mistral.rs"}