How Language Models Spot Repeats in Proteins
Proteins are chains of amino acids, and they often contain repeated chunks. Sometimes the repeats are exact, like the same phrase said twice. Sometimes they come with typos: a couple of letters swapped, but the meaning is the same. These repeats matter: they help the protein fold into the right shape and do its job.