Maybe basing it on overkill (either absolute values or relative to max hp) would make sense.
Example: You have 100 max hp and after receiving fatal damage you end up with just slightly negative hp --> mercy mode. If you get hit hard enough to end up with less than let's say -10 hp/% you die...