i usually take the lens cap off as soon as i take the camera out of the bag and drop the cap back in the bag before i put the camera around my neck.
in cases where i forget to do that i just put it in my pocket. back pockets are bad especially if you think you might sit down.
oh, i have a vest but i think it makes me look fat so i don't wear it too often.