You didn't mention what make and model furnace
you have, but it should have "timed out" and shut down without any propane
available. I'd find and pull the fuse to the furnace
until you can have it checked out by a qualified LP repair service person.
Bottom line.... it doesn't sound good and can become dangerous.
Above all, don't try it with LP until it's checked out.