If I am not mistaken, taking down and letting up your opponent was changed from an unsportsmanlike conduct call to stalling when the concept of stalling was formally introduced and codified in the rulebook in the late 70's, early '80's. The rationale was exactly as you say, if the controlling wrestler was not working for a pin he was called for stalling!
