Differentiate builds that partially succeed vs builds that fail

I'd want to be notified of a complete build failure but not necessarily a partial one because it might be a while before it's fixed, which means every build will trigger a notification and become simply noise. I would want a notification when build quality worsens, though.