Leshem,
I cannot visualize your problem from your description. I think that a photo would help.

Of course having the Tourpak loose will affect the way the bike feels, but it should not affect the stability as severely as you describe.
A history of the bike would help: as you are new here, being your very first post, an' all, I am going to hazard a guess that the bike is a recent purchase. Being as the previous owner has left some loose bolts on the Tourpak fastenings, I would say that you have to give the bike a good going over and check all the nuts and bolts you can access - this should be done with a torque wrench, and a model-specific workshop manual, which will tell you the torque that each bolt should be tightened to. If you don't have these, I would suggest you get the nearest dealership to do it for you.
Make a search on this forum for suspension problems. The touring bikes pre-2009 had some poor handling characteristics, but there are upgrades that can be made that will go far to eliminating these.
Also a good idea, so that you might get advice from here more suited to your specific circumstances - take a visit to the "New Member Introductions" thread - tell everyone who you are, where you are, about your bike, and how you came to own it.

You will be surprised how much more friendly and responsive these guys and gals become when you take the time to introduce yourself.
Cheers,
Peggers