It’s crucial to stand by our informed judgment of what’s right and wrong when people seek to undermine us by screaming “bias”