Glitch Tokens / Prompt Delimiters - WHY do our tokens work?

In research @BRX we are currently diving into the world of glitch tokens and prompt delimiters and the direct impact that these tokens can have in a operational and security based standpoint for the functions of LLM’s. Not only can strange combinations of BPE tokens save you execution cost, reduce execution speed, enhance cognition, they can also cause unexpected emergent behaviors.