Do you have a handset that would let you listen to the phone line? You should be able to heard the phone being taken off hook, getting the dial tone, the touch tone dialing, and the ringing at the other end.

In order to free up your modem port, you may have to completely exit your fax program.