Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Kagome Korean tokenizer docs #2281

Merged
merged 4 commits into from
Jul 5, 2024
Merged

Add Kagome Korean tokenizer docs #2281

merged 4 commits into from
Jul 5, 2024

Conversation

databyjp
Copy link
Contributor

@databyjp databyjp commented Jul 5, 2024

What's being changed:

  • Add kagome_kr to reference list of tokenizers
  • Add references to the new tokenizer to existing tokenization discussions
  • Add the new env vars to the list of env vars

Type of change:

  • Documentation updates (non-breaking change to fix/update documentation)

How Has This Been Tested?

  • Github action – automated build completed without errors
  • Local build - the site works as expected when running yarn start

@databyjp databyjp merged commit 04d4589 into main Jul 5, 2024
2 checks passed
@databyjp databyjp deleted the 20240705-1-25-7-kagome-kr branch July 5, 2024 12:42
daveatweaviate added a commit that referenced this pull request Jul 8, 2024
* Webinars Update (#2272)

* Update

* Blog Update

* Minor fixes iosblog (#2275)

* fix dates, title, linkedIn and twitter links

* Webinars Update (#2272) (#2274)

* Update

* Blog Update

Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>

---------

Co-authored-by: AJ Chan <adam@ajchan.io>
Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>

* Update docusaurus.config.js (#2277)

* People Update (#2278)

* Episode Update (#2279)

* Add `Kagome` Korean tokenizer docs (#2281)

* Draft Kagome tokenizer docs

* Add 'USE_GSE'

* add tokenization examples

* Update kagome available version

* 20240705 update banner (#2284)

* Draft banner

* Update time

* add many shot ICL paper (#2285)

* CTA Update (#2286)

* DR-521 release py4.6.6 core1.25.7 (#2283)

* Correct version links (#2287)

* DR-522 align section names with semantic naming (#2288)

* DR-522 align section names with semantic naming

* DR-522 align section names with semantic naming

* staging

* staging

* redirects

* add axn paper (#2289)

* add axn paper

* Update index.mdx

* Title Update (#2290)

* Fix version include (#2291)

---------

Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>
Co-authored-by: AJ Chan <achan99@gmail.com>
Co-authored-by: AJ Chan <adam@ajchan.io>
Co-authored-by: JP Hwang <61258750+databyjp@users.noreply.github.com>
Co-authored-by: Zain Hasan <zain_has@hotmail.com>
daveatweaviate added a commit that referenced this pull request Jul 12, 2024
* DR-471 v1.26 release tasks

* DR-471 v1.26 release tasks

* DR-474 create blog post skeleton (#2253)

* DR-474 create blog release notes skeleton

* bold city

* include

* include not showing up

* solved

* Refesh (#2294)

* Webinars Update (#2272)

* Update

* Blog Update

* Minor fixes iosblog (#2275)

* fix dates, title, linkedIn and twitter links

* Webinars Update (#2272) (#2274)

* Update

* Blog Update

Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>

---------

Co-authored-by: AJ Chan <adam@ajchan.io>
Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>

* Update docusaurus.config.js (#2277)

* People Update (#2278)

* Episode Update (#2279)

* Add `Kagome` Korean tokenizer docs (#2281)

* Draft Kagome tokenizer docs

* Add 'USE_GSE'

* add tokenization examples

* Update kagome available version

* 20240705 update banner (#2284)

* Draft banner

* Update time

* add many shot ICL paper (#2285)

* CTA Update (#2286)

* DR-521 release py4.6.6 core1.25.7 (#2283)

* Correct version links (#2287)

* DR-522 align section names with semantic naming (#2288)

* DR-522 align section names with semantic naming

* DR-522 align section names with semantic naming

* staging

* staging

* redirects

* add axn paper (#2289)

* add axn paper

* Update index.mdx

* Title Update (#2290)

* Fix version include (#2291)

---------

Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>
Co-authored-by: AJ Chan <achan99@gmail.com>
Co-authored-by: AJ Chan <adam@ajchan.io>
Co-authored-by: JP Hwang <61258750+databyjp@users.noreply.github.com>
Co-authored-by: Zain Hasan <zain_has@hotmail.com>

* DR-523 blog helm changes (#2295)

* DR-489 docs scalar quantization (#2296)

* DR-489 sq compression

* redirects

* old links

* links

* clean up

* clean up

* multi-vector

* background

* background

* staging

* pause

* py clients

* ts client

* not yet supported

* DR-502 docs default maxConnections (#2304)

* DR-490 docs dashboards for async

* image

* alt ttxt

---------

Co-authored-by: JP Hwang <me@jphwang.com>
Co-authored-by: Shan-Weaviate <137914800+Shan-Weaviate@users.noreply.github.com>
Co-authored-by: AJ Chan <achan99@gmail.com>
Co-authored-by: AJ Chan <adam@ajchan.io>
Co-authored-by: JP Hwang <61258750+databyjp@users.noreply.github.com>
Co-authored-by: Zain Hasan <zain_has@hotmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant