What happens when I change batteries - is the memory kept?

Yes. Once a cat is learnt then it stays in memory whether the batteries are in place or not.