mirror of https://github.com/RPCS3/discord-bot.git synced 2024-11-27 04:00:34 +00:00

History

13xforever f8c798d75a update confusables to unicode 15.0		2022-10-14 21:05:06 +05:00
..
confusables.txt	update confusables to unicode 15.0	2022-10-14 21:05:06 +05:00
HomoglyphConverter.csproj	Upgrade to .net6 + Update dependencies.	2022-03-05 16:05:33 +00:00
Normalizer.cs	use file-scoped namespaces to reduce nesting	2022-06-30 00:59:46 +05:00
readme.md	replace runtime builder with source generator for unicode confusables	2021-01-28 20:11:26 +05:00

Homoglyph Converter

This is a straight up implementation of the recommended confusable detection algorithm. It is mainly used to check for mod impersonation.

You can get the latest version of the mappings from the Unicode.org. You'll need to manually gzip it for embedding in the resources.

Code is split in two parts:

Builder will load the mapping file from the resources and will build the mapping dictionary that can be used to quickly substitute the character sequences.

One gotcha is that a lot of the characters are from the extended planes and require use of surrogate pairs, so we convert them to UTF32 and store as uint.
Normalizer implements the mapping and reducing steps of the algorithm