Audit test files for assert/refute with no custom message

[Cohen-Carlisle]

These should have a custom message put in place as without them you get a very unhelpful message like this:

Failed assertion, no message given.

[kotp]

exercism/problem-specifications#230 talks about this, Let's open an issue on x-common for any that need them.

And for the non-generated ones, l think we could make a check listed note here and do PR's against the list?

[kytrinyx]

Where they're generated, we can generate the custom message based on the inputs/outputs. The few times that we've had messages in the test data it's just been echoing the inputs, and it hasn't added any value.

[kotp]

If we can do a good job of it, I say go for it. Writing good error messages can be hard, just about as hard as naming things, and they are more important, because if they are there, they are intended to hold your hand a little bit, and definitely should not misinform. I would rather have a non-informative error message than a misleading one.

[kotp]

Currently these files still have this style of test:

• exercises/allergies/allergies_test.rb
• exercises/bracket-push/bracket_push_test.rb
• exercises/clock/clock_test.rb
• exercises/custom-set/custom_set_test.rb
• exercises/grade-school/grade_school_test.rb
• exercises/isogram/isogram_test.rb
• exercises/leap/example.tt
• exercises/leap/leap_test.rb
• exercises/luhn/luhn_test.rb
• exercises/pangram/pangram_test.rb
• exercises/pythagorean-triplet/pythagorean_triplet_test.rb
• exercises/queen-attack/queen_attack_test.rb
• exercises/triangle/triangle_test.rb

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[hilary]

I'd rather see effort put into created canonical data and converting exercises to using generators than into crafting error messages for non-generated test suites.

[kotp]

I wonder if @hilary comment will cause the Probot to now leave this open...