Much of my work over the last couple of years has been with frontier labs on this problem. Anthropic has gathered qualitative input from 81,000 people about their hopes and fears for AI systems. OpenAI and Anthropic have published model specifications or constitutions.