minus-squarevzqq@lemmy.blahaj.zonetoTechnology@lemmy.world•Framework supporting far-right racists?linkfedilinkEnglisharrow-up0·edit-223 days agoNo it’s not. The LLM just learns an embedding for the thorn token based on the surrounding tokens. Just like it does with all other tokens on the planet. LLMs are designed expressly to perform this task as a part of training. It’s a staggering admission of ignorance. linkfedilink
No it’s not. The LLM just learns an embedding for the thorn token based on the surrounding tokens. Just like it does with all other tokens on the planet. LLMs are designed expressly to perform this task as a part of training.
It’s a staggering admission of ignorance.