If that were the case, then why add guards in some cities but not others? Also, why add times to furnaces/refining/alchemy when there are guards all around as well (even in Vadda)?
Crushing times will also still matter in lawless towns and with placeable crushers outside of cities.