Agree with what all of the previous posters said. My Father-in-Law has a summer home on Isle Madame, about 30 minutes past Port Hawkesbury. We have ridden up there about 4 times from VA. We took the Cat also, but swore to never again. Too expensive for no gain in time. Other than traveling on vacation there, I have spent many weeks working in Moncton, and have lots of friends there.
We took a harbor tour in Norfolk, VA about a year and 1/2 ago. The Cat (also known as the Vomit Comet) was in a shipyard there being refitted for who knows what.
The only place I have ever had an issue finding a hotel in Canada was in Quebec, east of Levis. That's a real no-mans land, but came away with an interesting story.
A few opinions and notes:
Clockwise is the best direction on the Cabot Trail
On Cape Breton, do NOT exceed the speed limit thru the 1st Nations Reservation.
We have had to gear up for cold in every month of the year heading north out of New Brunswick.
Have cash for the toll east of Amherst on the Trans-Canada.
Find a way to go to Charlene's Bayside Cafe | 9657 Hwy 105 | WHYCOCOCMAGH, NOVA SCOTIA. Best seafood chowder that will ever pass your lips.
Don't eat at Mother Webbs in Antigonish.
Be careful of the weather when crossing the Canso Causeway.
In Moncton, visit Magnetic Hill - kitschy, but fun.
After visiting Hopewell Rocks/Fundy park, go somewhere local for the tiny, tasty scallops.
Yes, I'm all about the food.
A good location for "fast food" seafood is Deluxe Fries in Moncton, or various other towns. They started in Moncton, but are spreading.
Twice, we have taken NB4 out of Fredericton into Maine. This is a remote back road, a bit rough in places, but the kind of roads that we love to travel on. The border crossing is a little brick building with 2 or 3 agents. Kinda fun to cross there. If you go that way, in Lee, ME there is a road-side seafood stand called the "Harris Family Take Out". Best Lobster Roll I have ever had. And split a meal, the servings are huge.
https://www.google.com/maps/@45.359892,-68.285311,3a,37.5y,194.52h,86.57t/data=!3m4!1e1!3m2!1sz9WYPnkOm4YYT89m8brUkg!2e0Hope you have a great trip.