CVO models take a BIG hit the 1st year and then average out over 3 years. I don't think they are lowballing you, given what market conditions are. They would have to try to resell your Ultra for 34K or more and most people buying a cvo have the few extra thousand to buy a brand new one. So your dealer will probably end up wholesaling it around 31-32K unless they have a buyer lined up for it.
If you are really wanting to change to the Road Glide, I would do it in a heartbeat. And since I bought all my new bikes from the same dealer I would ask for some other things like maybe include the 1K and 5K services, maybe some oil changes or discount on accessories, an in store gift card, etc
What I've learned from buying cvo's is to hold onto them for at least 3 years.... that way the hit isn's as dramatic
Good luck