Docker 1.4.5

What's Changed

• Treat empty ScriptureRange as a filter not letting anything through @Enkidu93 in #394
• Update to Machine 3.2.0 by @ddaspit in #402
• Only allow textId or scriptureRange in a buildID (not both). by @johnml1135 in #401

Full Changelog: docker_1.4.4...docker_1.4.5

Release 1.4.4

What's Changed

• Do not train/pretranslate all if textIds is an empty array by @ddaspit in #390
• #384 - file download error message by @johnml1135 in #387

Full Changelog: release_1.4.0...release_1.4.4

Release 1.4.0

Highlights:

• Ability to pretranslate non-scripture USFM portions (footers, notes, headers, etc.)
• Choice for USFM generation: only existing, prefer existing, prefer pretranslations, only pretranslations
• Handle broader range of non-compliant and older USFM files
• Bug fixes

What's Changed for Serval

• Fix for new Machine, update documentation by @johnml1135 in #359
• Change to MongoDB Callback API for better error handling - #314 by @johnml1135 in #360
• Update Open Telemetry to resolve security issues. by @johnml1135 in #366
• Fixes missed from previous PR by @johnml1135 in #367
• #370 - control pretranslating existing text by @johnml1135 in #371

Full Changelog: docker_1.3.2...docker_1.4.3

What's Changed for Machine

• default to major biblical terms by @johnml1135 in sillsdev/machine#180
• Add support for non-verse text segments in Scripture corpora by @ddaspit in sillsdev/machine#179
• Update machine version by @johnml1135 in sillsdev/machine#183
• Update to fix vulnerability. by @johnml1135 in sillsdev/machine#186
• Fixes #365 by @Enkidu93 in sillsdev/machine#187
• Test coverage by @johnml1135 in sillsdev/machine#182
• Convert to MongoDB callback API by @johnml1135 in sillsdev/machine#184
• Allow for write commands that are greater than 5MB. by @johnml1135 in sillsdev/machine#188
• Control the pretranslation of existing text by @johnml1135 in sillsdev/machine#189
• Update version by @johnml1135 in sillsdev/machine#190
• Usfm parse error logging by @johnml1135 in sillsdev/machine#191
• v3.1.2 by @johnml1135 in sillsdev/machine#192
• Extract book id from filename by @ddaspit in sillsdev/machine#193
• Serval was down until langtags.json was added back. by @johnml1135 in sillsdev/machine#194
• Fix usfm population by @johnml1135 in sillsdev/machine#195
• V3.1.3 by @johnml1135 in sillsdev/machine#196

Full Changelog: sillsdev/machine@docker_3.8.1...docker_3.9.3

What's Changed for Machine.py

• Update machine.py to reflect usfm changes in machine by @mshannon-sil in sillsdev/machine.py#103
• fix normalization order in find_missing_characters() by @mshannon-sil in sillsdev/machine.py#105
• Parallel to sillsdev/machine#187 by @Enkidu93 in sillsdev/machine.py#106

New Contributors

• @Enkidu93 made their first contribution in sillsdev/machine.py#106

Full Changelog: sillsdev/machine.py@docker_1.2.0...docker_1.4.0

Docker 1.4.3

What's Changed

• Fix for new Machine, update documentation by @johnml1135 in #359
• Change to MongoDB Callback API for better error handling - #314 by @johnml1135 in #360
• Update Open Telemetry to resolve security issues. by @johnml1135 in #366
• Fixes missed from previous PR by @johnml1135 in #367
• #370 - control pretranslating existing text by @johnml1135 in #371

Full Changelog: docker_1.3.2...docker_1.4.3

Release 1.3.0

Overall updates:

• Add mixed-source configuration ability
• Many stability improvements including moving to MongoDB Atlas

What's Changed in Serval

• Mongo atlas by @johnml1135 in #348
• Update .editorconfig with many changes by @johnml1135 in #312
• Refactor all DTOs and models into records by @ddaspit in #322
• Update MemoryUpdateBuilder to work with read-only collections by @ddaspit in #324
• Reduce batch size to help with e2e testing on 24 GB GPUs by @johnml1135 in #329
• Fix invalid json by @johnml1135 in #330
• Fix documentation by @johnml1135 in #331
• refactor E2E oauth usage - #333 by @johnml1135 in #334
• Update Serval App by @Enkidu93 in #341
• Increase PVC size for production by @johnml1135 in #340
• Update serval app (take 2) by @Enkidu93 in #344
• Update serval app by @Enkidu93 in #345

Full Changelog: docker_1.2.0...docker_1.3.2

What's Changed in Machine

• Add support for mixed source corpora by @ddaspit in sillsdev/machine#177

bug fixes

• Try 2 for editor config: by @johnml1135 in sillsdev/machine#171
• Refactor models to records by @ddaspit in sillsdev/machine#172
• Better error handling for download endpoint by @johnml1135 in sillsdev/machine#173
• fix ClearML Event error - only require fields used by @johnml1135 in sillsdev/machine#175
• Remove required property from optional ClearMLTask attributes by @Enkidu93 in sillsdev/machine#176
• Fix some logic found during e2e testing by @johnml1135 in sillsdev/machine#178

Full Changelog: sillsdev/machine@docker_3.7.0...docker_3.8.1

What's Changed in Machine.py

• Add option to save the model during build job by @ddaspit in sillsdev/machine.py#99

bug fixes

• Restrict build options to only update model hyperparameters by @ddaspit in sillsdev/machine.py#88
• Update error message to include filename by @isaac091 in sillsdev/machine.py#90
• swap out 600M param model for tiny for faster startup by @johnml1135 in sillsdev/machine.py#92
• Add test for default attributes in USFM by @ddaspit in sillsdev/machine.py#93
• use sacremoses normalizer, ensure pretranslate.src.json and pretranslate.trg.json use same directory by @mshannon-sil in sillsdev/machine.py#96
• Clean up get_chapters code and expand tests by @isaac091 in sillsdev/machine.py#97
• Refactor get_chapters to not reuse code and add additional tests by @isaac091 in sillsdev/machine.py#98
• And upgrade torch, numpy, pandas and accelerate as well as black, pyr… by @johnml1135 in sillsdev/machine.py#100

Full Changelog: sillsdev/machine.py@docker_1.1.1...docker_1.2.0

docker_1.3.2

What's Changed

• Mongo atlas by @johnml1135 in #348
• Update .editorconfig with many changes by @johnml1135 in #312
• Refactor all DTOs and models into records by @ddaspit in #322
• Update MemoryUpdateBuilder to work with read-only collections by @ddaspit in #324
• Reduce batch size to help with e2e testing on 24 GB GPUs by @johnml1135 in #329
• Fix invalid json by @johnml1135 in #330
• Fix documentation by @johnml1135 in #331
• refactor E2E oauth usage - #333 by @johnml1135 in #334
• Update Serval App by @Enkidu93 in #341
• Increase PVC size for production by @johnml1135 in #340
• Update serval app (take 2) by @Enkidu93 in #344
• Update serval app by @Enkidu93 in #345

Full Changelog: docker_1.2.0...docker_1.3.2

Release 1.2.0

Major items:

• NMT download endpoint
• USFM download
• Scripture chapter selection
• Language Info endpoint (with NLLB name resolution)

Serval - What's Changed

• Add endpoint to return pretanslations as USFM by @ddaspit in #292
• Chapter level specification by @Enkidu93 in #289
• Add Language Info endpoint by @johnml1135 in #283
• Nmt download by @johnml1135 in #300

Fixes:

• #285 - fix it by @johnml1135 in #291
• Fixes #293 by @Enkidu93 in #296
• Update to Machine 3.0.2 by @Enkidu93 in #305
• Generate NSwag client using .NET 8 by @ddaspit in #287

Full Changelog: docker_1.1.1...docker_1.2.0

Machine - What's Changed

• Add UsfmVerseTextUpdater class by @ddaspit in sillsdev/machine#160
• Language endpoint by @johnml1135 in sillsdev/machine#159
• Add functionality to Paratext project settings parser by @ddaspit in sillsdev/machine#163
• Cancel build gRPC endpoint returns Aborted when no build is running by @ddaspit in sillsdev/machine#165
• Added chapter-level filtering by @Enkidu93 in sillsdev/machine#161
• Scripture range parser by @Enkidu93 in sillsdev/machine#168
• Chapter level aspnetcore by @Enkidu93 in sillsdev/machine#167
• Move logic to parallel text corpus by @Enkidu93 in sillsdev/machine#169
• Nmt download by @johnml1135 in sillsdev/machine#164

Full Changelog: sillsdev/machine@docker_3.6.3...docker_3.7.0

Machine.py - What's Changed

• Clean up get_chapters code and expand tests by @isaac091 in sillsdev/machine.py#97
• Refactor get_chapters to not reuse code and add additional tests by @isaac091 in sillsdev/machine.py#98
• And upgrade torch, numpy, pandas and accelerate as well as black, pyr… by @johnml1135 in sillsdev/machine.py#100
• Add option to save the model during build job by @ddaspit in sillsdev/machine.py#99

Full Changelog: sillsdev/machine.py@docker_1.1.3...docker_1.2.0

Docker 1.2.0

What's Changed

• Add endpoint to return pretanslations as USFM by @ddaspit in #292
• Chapter level specification by @Enkidu93 in #289
• Add Language Info endpoint by @johnml1135 in #283
• Nmt download by @johnml1135 in #300

Fixes:

• #285 - fix it by @johnml1135 in #291
• Fixes #293 by @Enkidu93 in #296
• Update to Machine 3.0.2 by @Enkidu93 in #305
• Generate NSwag client using .NET 8 by @ddaspit in #287

Full Changelog: docker_1.1.1...docker_1.2.0

Release 1.1.1

What's Changed in Serval

• Make MNT batch testing more robust, especially with tiny, random models. by @johnml1135 in #246
• #223 - hide health endpoint by @johnml1135 in #256
• Add build log by @johnml1135 in #263
• Added download script by @Enkidu93 in #272
• Drive health by @johnml1135 in #269

Full Changelog: docker_1.1.0...docker_1.1.1

What's Changed in Machine

• Add support for detokenizing USFM by @ddaspit in sillsdev/machine#154
• Build log output by @johnml1135 in sillsdev/machine#155
• Passed shared file folder to ClearML NMT job by @ddaspit in sillsdev/machine#157
• Drive health by @johnml1135 in sillsdev/machine#156

Full Changelog: sillsdev/machine@docker_3.6.2...docker_3.6.3

What's Changed in Machine.py

• use sacremoses normalizer, ensure pretranslate.src.json and pretranslate.trg.json use same directory by @mshannon-sil in sillsdev/machine.py#96
• Update error message to include filename by @isaac091 in sillsdev/machine.py#90
• swap out 600M param model for tiny for faster startup by @johnml1135 in sillsdev/machine.py#92
• Add test for default attributes in USFM by @ddaspit in sillsdev/machine.py#93

Full Changelog: sillsdev/machine.py@docker_1.1.2...docker_1.1.3

Docker 1.1.1

What's Changed

• Make MNT batch testing more robust, especially with tiny, random models. by @johnml1135 in #246
• #223 - hide health endpoint by @johnml1135 in #256
• Add build log by @johnml1135 in #263
• Added download script by @Enkidu93 in #272
• Drive health by @johnml1135 in #269

Full Changelog: docker_1.1.0...docker_1.1.1