I think endurence is not needed at all. 19 more Stamina, passive regeneration and to be able to swim is not as important and can be dropped, if you make a versetile build.
I for excample use a Hybrid that can use Magic, use Bows, use Swords and can do mounted Archery.
Ps i dropped Vitalism to...