@neologist,
neologist wrote:
Is a moral algorithm important to the future development of A.I.?
I doubt it.
I suspect the "moral imperative" of any AI creations will be the same as for all non-AI living things...survival above all things.
I suspect that if AI creations see anything as a threat to their survival, they will do their best to eliminate that thing...and no moral algorithm will counterman that inclination.
I suspect that the next progression in the evolution of humans toward "godhood" is what the AI progression will produce. As soon as AI creations get advanced enough to see what humans mean to their continued survival...and the continued survival of Planet Earth...they will effectively eliminate humanity. (Perhaps keeping a small contingent in a zoo-like environment for possible future study.)
The way things are going, it is hard for me not to be rooting for them.