I have used the exact same oil filter on my bike for the last five years and each time I change my oil (4-5K miles), I see about the same as you have. I've also had my engine apart during that period of time (nothing oil related) and there was no evidence whatsoever of abnormal wear, as a matter of fact, looked damn good. I'd be more concerned if I saw pieces of metal on the pan plug rather than minute particles. JMHO.
You might have something going on in the primary. I would drain fluid, remove outer cover, flush thoroughly with brake clean and check with light and mirror to see if anything obvious. Refill with fresh fluid and check periodically. I'm assuming you don't hear any funky noises coming from the primary that may indicate something else going on.