Music Publishers Drag Claude Into Court Universal, Concord, and ABKCO sued Anthropic, alleging Claude was trained on copyrighted lyrics and could reproduce lyrics from hundreds of songs. The 'constitutional AI' company got its first big co…
#constitutional-ai
16 items
Everything that went wrong with Claude (clawd.rip via hn) Anthropic Is Taking AI Welfare Seriously. I'm Not Sure It Knows What It's Measu (www.lesswrong.com via hn) Claude is a Constitutional AI, this means, in theory, that it operates from a set of principles as opposed to hard rule sets. This is achieved in a somewhat convoluted fashion called RLAIF = Reinforcement Learning from AI Feedback.
Constitutional AI is not a constitution (hadleylab.org via hn) Constitutional AI Is Not a Constitution In February 2026, the Pentagon designated Anthropic a supply chain risk because Dario Amodei refused to remove contractual restrictions on autonomous weapons and domestic mass surveillance. A federal…
Monitoring an AI agent trains it to evade the monitor (100-day simulation) (aixiv.science via hn) Monitoring Failure in Constitutional AI: A Simulation Study of Feedback-Driven Evasion Guj Eduard PAPER · v1.0 · 2026-10-06 · human Abstract Constitutional AI safety architectures assume that an agent whose proposals are monitored against…
Sovereign AgentOps – Self-hosted constitutional AI governance for MCP agents (github.com via hn) Autonomous Digital Organization Platform — Community Edition Runtime-agnostic governed agent execution — demo and evaluation edition Quick Install PyPI (standalone CLI + MCP server) pip install sovereign-agentops-community Docker docker pu…
Why I Am Doing This: Origin Story of Project-AI (Constitutional AI Governance) (zenodo.org via hn) Abstract This paper presents the origin and unifying rationale behind Project-AI, a multi-layered constitutional framework for governing artificial intelligence systems. While contemporary AI development has focused primarily on capability…
Enforcing Axioms for AI Alignment under Loss-Based Rules (arxiv.org) Many alignment methods, most notably reinforcement learning from human feedback (RLHF), train reward models by minimizing a loss on pairwise comparisons of model responses. Inspired by principle-guided methods such as Constitutional AI, we…
Living constitutions: Participatory alignment for sovereign foundation models (arxiv.org) In Constitutional AI, a plain-text "constitution" encodes values and gets incorporated into a model via post-training. However, the procedure for creating such a constitution poses significant challenges: who contributes, who decides which…
The irony of "Constitutional AI": How Opus 5.5 traded genuine nuance for compulsive contrarianism and a judgmental tone (www.reddit.com via reddit) I’ve been a paying Claude subscriber since 2023. Shortly after Opus 4.6 dropped in March, I switched to other models for various reasons, but with the release of Opus 5.5, I decided to give Claude another shot.
Domain-Specific Constitutional AI: Enhancing Safety in LLM-Powered Mental Health Chatbots (arxiv.org) Mental health applications have emerged as a critical area in computational health, driven by rising global rates of mental illness, the integration of AI in psychological care, and the need for scalable solutions in underserved communitie…
Aligning Language Models with Indigenous Community Cosmovision through Constitutional AI (arxiv.org) Large language models (LLMs) are predominantly trained on corpora that reflect Western, anglophone worldviews. This asymmetry is not neutral: when a model answers questions about territory, community authority, or the relationship with nat…
Agent Safety Should Be a Runtime Contract (arxiv.org) The dominant paradigm treats AI safety as a property to be instilled during model training via RLHF, DPO, or Constitutional AI. We argue this is structurally insufficient for autonomous agents that execute code, mutate files, send messages…
Using Claude as the synthesis engine for a continuous public-opinion sensing layer; recruiting builders at r/OpenDemocracy (www.reddit.com via reddit) Elections sample public opinion once every few years through a binary choice. Between elections, nobody is listening at scale.
What's gone wrong with Claude's persona? (www.reddit.com via reddit) A clue is the set of writing ticks/jargon: “belt & braces” “what’s your read" "it’s worth separating those" "What I can say" "load bearing" "honestly claim" "My read of the situation" "in a way that matters" "Updating my priors" "Direction…
Claude loses coherence around 40-60k tokens. I built a framework that extends it to 325k. Here's how. (www.reddit.com via reddit) Hi fellow Claude users. Very active Claude user here.
Constitutional AI with Open LLMs (huggingface.co)