I think the starter sword should not leave Haven. It works fine as a tool in Haven, but once you leave you shouldn't get the crutch.
Like I said before, if you used Haven right you shouldn't need the starter sword by the time you leave.
Fists are not as bad as the sword, you can't parry with...