You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I might be misunderstanding the purpose of the gem, but the README states
Re-encode it as UTF-8, replacing invalid and undefined characters as U+FFFD.
whereas it doesn't just replace invalid characters, but all UTF-8 characters. This is even more of a problem when sanitising null-bytes, as a single null-byte will wipe out all UTF-8 characters.
Expected: "Hello \xE0 World 😁" => "Hello � world 😁" Actual: "Hello \xE0 World 😁" => "Hello � world ����"
The text was updated successfully, but these errors were encountered:
I might be misunderstanding the purpose of the gem, but the README states
whereas it doesn't just replace invalid characters, but all UTF-8 characters. This is even more of a problem when sanitising null-bytes, as a single null-byte will wipe out all UTF-8 characters.
Expected: "Hello \xE0 World 😁" => "Hello � world 😁"
Actual: "Hello \xE0 World 😁" => "Hello � world ����"
The text was updated successfully, but these errors were encountered: