This idiom or expression has to do with:

Seriously believing in something.

When someone says “I swear by warm, steamy baths to relax the body,” they mean something like “I seriously believe that a warm bath relaxes the body!!”