渡す(渡すとは言ってない)

It was handed over. (It was taken without permission.)
There is a tradition where a senpai will hand over the second button of their uniform to a kouhai. This is generally done as a sign of closeness between the two, and therefore, is done when both parties understand it's happening.