I'd say that you definately have a problem with your loading nozzle
It's most likely that your loading nozzle is physically slamming into the bb, which is never good. there should only be enough force in it to load the chamber, IMO there shouldn't be enough force in it to cause any serious damage, since it's only going to feed as fast as the slide mechanism on your pistol goes forward.
Your recoil spring may be too stiff, causing too much pressure to be exerted on the loading cycle.