Skip to content

Commit

Permalink
Correct an old documentation point
Browse files Browse the repository at this point in the history
unidecode deleted unknown characters, but deunicode turns ’em into [?].
  • Loading branch information
chris-morgan committed Aug 4, 2022
1 parent b419b6c commit ae51d72
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions src/lib.rs
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,7 @@ const POINTERS: &[u8] = include_bytes!("pointers.bin");
///
/// There are, however, some things you should keep in mind:
/// * As stated, some transliterations do produce `\n` characters.
/// * Some Unicode characters transliterate to an empty string, either on purpose
/// or because `deunicode` does not know about the character.
/// * Some Unicode characters transliterate to an empty string on purpose.
/// * Some Unicode characters are unknown and transliterate to `"[?]"` (see `deunicode_with_tofu`)
/// * Many Unicode characters transliterate to multi-character strings. For
/// example, 北 is transliterated as "Bei ".
Expand Down

0 comments on commit ae51d72

Please sign in to comment.