Hi Tizone,
I have also experienced the same problem with the lower V&H baffle. Impossible to take it out.
So... I've solved it the strait way
:
1) Measure exactly by how much the baffle should be push back to allow the right place for the Smartpartz quiet baffle. It was approx 1.50 cm
2) Take a screwdriver and hammer the V&H baffle to push it back!
3) Drill the lower pipe at the correct distance from pipe tip to match the Smartpartz fitment, make measure twice! You have only one chance to drill it correctly!!
4) Hammer in the Smartpartz baffle
5) Screw the bolt
6) et voilà.... 
Please notice that this seems a one way operation! Forget about removing the V&H baffle after that!
I'd like to revise what I've said about taking the baffle out of the V&H BR 2-2 :
I've used a "stalk" ended on one end with a "round screw" and on the other en by a "slice". Sorry if the technical words are not correct, I don't use them so often

As seen on the pictures below the idea was to grap the baffle at the most inside end and hammer on the slice until it goes out. It worked like a charm in less than 10min and for less than 5$.
Greetings Laurent