You didn't mention what make and model
furnace you have, but it should have "timed out" and shut down without any
propane available. I'd find and pull the fuse to the
furnace until you can have it checked out by a qualified LP repair service person.
Bottom line.... it doesn't sound good and can become dangerous.
Above all, don't try it with LP until it's checked out.