It might help you if you have a friend who has some experience with towing trailers and who can ride with you on your first tow-drive. Just to talk and reassure you, see what you're doing and give you pointers. Get into an area that is pretty deserted and feel what it's like to have that thing behind you. Go to an empty parking lot and practice backing up. Practice hooking and unhooking with your friend watching over you.
A 5th wheel is generally considered to be sway-proof because the pivot point is over the
axle instead of several feet behind it, but a correctly loaded trailer (with about 10% of its
weight on the tongue) should not sway anyhow. Also some people feel that the 5th wheel tows with less bounce; it won't make your tow vehicle bob like a seesaw the way a trailer can when going over humps and stuff. Those are the main differences. But a 5th wheel requires a pickup, and a trailer doesn't.
There is risk in anything; it's risky to get up in the morning, because you might slip and break your neck! The risks in towing a small trailer are pretty manageable. Hardly anyone crashes and burns.
A few folks slip up and forget to fasten the latch on the ball, or they back into something and make a dent... pretty manageable stuff. The 13, 16, and 17 foot trailers all tow pretty easily. Way easier to do than a monster 30 footer. Once you get a little practice and feel confident that you know how to do it, you'll be happy you did it.
Never let fear rule your life.