Once you've purchased the guild cape for your guild, is it possible to remove the cape at times or do you have to wear it all the time?

Thanks.