Mitigating Memorization in LLMs: @dair_ai observed this paper presents a modification of another-token prediction goal termed goldfish loss that can help mitigate the verbatim generation of memorized instruction data.Siri and ChatGPT … Read More