The real difference is the intensity of the impact.
In boxing you are hit by a single padded hand. The boxers muscles are mostly to accelerate your hand and glove up to speed and to follow through, but little is applied during the actual punch due to rebound.