Keep, without a doubt. you can rune the second set up to a different attribute. Makes gameplay a bit more diverse. I usually use the belt pouch space for a second set of armour...
yeah just hold on to them. that way if you ever want to try a different build or just try something wierd, you can just switch armors. i've got about 4 or 5 storage characters to hold all of my armors.