1v1 casual matches

Can anyone tell me why it takes so bloody long after matches to get back to the lobby? Why is there always a player that hasn’t hit the A button. It’s very painful. It’s not just 1v1 matches. It’s all online matches.