You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
CTranslate does not provide an API that takes numerical token Ids, thus we convert the IDs we get from Triton to subwords for the encoder input and convert the decoder outputs back to IDs. This is unnecessary since it means that it has to be done on both the client and server.
The text was updated successfully, but these errors were encountered:
CTranslate does not provide an API that takes numerical token Ids, thus we convert the IDs we get from Triton to subwords for the encoder input and convert the decoder outputs back to IDs. This is unnecessary since it means that it has to be done on both the client and server.
The text was updated successfully, but these errors were encountered: