This idiom or expression means:

Watching someone or something carefully.

I’m not sure about this guy. Keep an eye on him for a while, until we know more.