Differentiate between crashing vs failing tests

[DanielRosenwasser]

Currently the test runner allows failing requests - but in actuality, these are recovered crashes. We should find a way to track these differently so that we can burn these issues down.

[jakebailey]

It doesn't fail with "nil response" anymore, it should fail with the actual errors. But, they are not tracked separately.