Package net.thexcoders.aladin_bot_backend.nlp_models.tokenizer

Interface Summary

Interface	Description
Tokenizer	The Tokenizer splits each sentence into an array of tokens that will be used to get the associated Category It is highly linked to Categorizer

Class Summary

Class	Description
TokenizerImplEng	The Tokenizer splits each sentence into an array of tokens that will be used to get the associated Category It is highly linked to Categorizer
TokenizerImplFra	The Tokenizer splits each sentence into an array of tokens that will be used to get the associated Category It is highly linked to Categorizer