This idiom or expression has to do with:

Disrespecting.
Doing or saying the wrong thing.

I don’t care who he is. He crossed the line and has to apologize.

Joining the other side.

If this infighting goes on, some of the voters will cross the party lines and vote for the other party’s candidate.