This idiom or expression like phrase means:

An advantage.
Having an advantage.

When someone says “We have the upper hand over them,” they mean something like “We’re in a better position than, or have an advantage over, them.”

A. Do you want to negotiate with Richard?
B. Not really. I have the upper hand here.