Nobody wants to be the group holding up the course, but rushing your actual swing to save time almost always backfires — you get worse contact, which leads to more shots, which slows you down more.
The real time savings live everywhere except the swing itself: walk toward your ball while others are hitting instead of standing still, decide your club before it's your turn, and play "ready golf" instead of waiting for strict honors.
Same tempo at address. Faster everything around it.