This would be a good time to 'true' the fork. A hit hard enough to damage both of the rims means you whacked the whole bike, whether it shows or not. If you are only talking about a couple of mm motion in a cyclic manner, I'm betting on the difference in tread pattern in the front tire, rather than actual physical damage. But it doesn't hurt to make sure.
It's unlikely in my view that the swing arm would be affected as much as the fork. The fork legs are only held in place by clamping force at the upper and lower triple clamps. Between those two points, the fender mounts, and the front axle, the tubes are supposed to stay parallel. This is a relatively beefy fork, compared to the last one I tweaked out of true.... but the process is quick, and relatively painless:
1) loosen the bolts on the upper triple clamp that hold the fork tubes. DO NOT loosen the lower triple clamp bolts.(finger tight)
2) loosen the fender mounts(finger tight)
3)loosen the front axle. (finger tight)
4) mount the bike, grab the front brake hard, and romp on the handle bars. Get the suspension to move through as much of the stroke as you can, and ensure that you do so half a dozen times or more.
5) when you are done, tighten everything up that you loosened. You're done. Ride it and see if it made a difference.
By forcing the suspension through it's full stroke, with a 'common' reference, you will ensure that the tubes align themselves to their straightest path. Straight means less stiction (better action) and less off set from straight ahead.