Or memories. Or other things. Colors and memories are the only ones I have experience with though. But yeah! No offense taken since this wouldn't be the first time we've been stuck someplace that was treated like a pretty messed up game, but it is a little like losing your progress because you didn't hit a save point. I'm not sure if there's any repercussions to us losing colors besides the loss itself, but that could just mean it's something we aren't actually seeing.