I would not continue to ride that bike until I found the cause of the noise, and here is why I say that. 2011 and 2012 CVO's seem to be the ones most likely to suffer a major lifter failure, which can easily cause many thousands of dollars worth of damage to the engine. Yes it could be something simple like a heat shield, rubber muffler support, motor mount, or even an exhaust leak. Those are things I'd put on the checklist as well. But if it isn't one of those things, I'd strongly suggest having the lifters checked out ASAP. If it would make the noise all the time you could try to trace it with a stethoscope, since it could also be from the primary side (compensator issues are also pretty common). But I wouldn't just wait until the next time the noise gets worse. That could be the time it fails completely.
JMHO - Jerry