How we handle moral disagreement is not just a scientific problem. It is a moral one too. And, since the times of the ancient Greeks, the solution to that moral problem is not aggregating preferences, but democratic participation.
Machine learning and artificial intelligence are tools. They can be used in a right or a wrong way, like everything else. Human greed and human unintelligence scare me far more than artificial intelligence.