When punching a player before they leave makes them die randomly, once they join back they can't pick up their items, but other people can.
Way to replicate this: Punch someone with anything in your hand, can be empty too. Then tell them to leave the instant they were punched.