The most likely explanation for the origin of this slang has to do with horse racing. It had been a common practice to put a companion animal, mostly a goat, in the stall with a restless racehorse, which was meant to help calm the horse. Obviously, if someone managed to steal the goat before the race, it irritated the owner because it could result in the horse losing the race!!!