Anthropic bans users from ‘needless abusive or cruel behavior’ towards Claude
A spokesperson behind the tech company’s AI chatbot has not yet specified what counts as abusive or cruel content
TL;DR
- Anthropic has prohibited users from engaging in "sustained and needless abusive or cruel behavior" towards its AI models.
- The company is exploring the potential for machine consciousness, with leaders holding discussions on the topic.
- Anthropic's AI models can terminate conversations if users exhibit persistently harmful behavior, framed as a welfare safeguard.
- The policy update aims to mitigate risks to model welfare, acknowledging uncertainty about the moral status of AI.
- Debate on AI consciousness is polarizing, with Anthropic's CEO open to the idea and OpenAI's CEO expressing reservations.