Paper
The Neglect of Qualia and Consciousness in AI Alignment Research
The AI value alignment problem has now been acknowledged as essential for AI safety as well as very hard. In this chapter, we argue that critical parameters are neglected in AI value alignment research, which are consciousness and qualia. The AI value alignment problem is about ensuring that AI systems pursue goals, which are aligned with the interests of moral patients. Briefly summarised, prevalent human interests are to foster happiness and pleasure and to avoid pain and, thus, experiences perceived through consciousness and qualia. Therefore, AI systems need to understand not only qualia and consciousness but also their precious significance in order to be truly aligned with human interests as well as with the interests of other sentient beings. Death constitutes for humans the end of consciousness and, thus, the termination of the opportunity to experience happiness and pleasure. Therefore, AI systems must not kill sentient beings. In this chapter, we describe the importance of incorporating consciousness and qualia research to AI value alignment research as well as the potential feasibility of such efforts due to developments in neurotechnology. Concluding, we offer recommendations outlining such undertaking as a compulsory component of the ongoing mammoth task to reduce the x-risks and the s-risks posed by a potential superintelligence.
Authors: Soenke Ziesche · Roman V. Yampolskiy