How we handle moral disagreement is not just a scientific problem. It is a moral one too. And, since the times of the ancient Greeks, the solution to that moral problem is not aggregating preferences, but democratic participation.
Machine learning and artificial intelligence are tools. They can be used in a right or a wrong way, like everything else. Human greed and human unintelligence scare me far more than artificial intelligence.
Corporation’s success depends on the contributions of many people. If we are going to try to determine how much compensation the CEOs deserve given their contribution to their companies, this should be the test all the way down.