The short answer is, everything varies.
The longer answer involves the agreement between what is possible and what is desired.
If we could design a product and it could be replicated exactly, including every element of the product, we would not need tolerances. Any part would work with any assembly. We would simply specify the dimensions required.