I know what you mean about the difference in flavor. I'm very attuned to food textures and there is a noticeable difference in the texture and taste for spuds that go into the fridge and/or freezer. But, it is doable and it's still nice having the leftovers to savor.