If you press the "Undo All" button this will undo everything since the start of the program.

A lot of users want to have an undo of the last operation only, so I will implement it in the next versions, maybe even as shortkeys <ctrl-z> and <alt-backspace>

However a redo doesn't seem to be needed since you can press the Rename button again.