Staff at AI companies under mental strain over working on tech that may kill humans
Employees at leading AI companies and evaluation centers are experiencing significant mental distress and burnout due to fears that the powerful AI they are developing could cause widespread societal harm. Concerns include rapid commercial deployment, insufficient safety safeguards, and the potential misuse of autonomous systems in critical areas.
Why it matters
This highlights the ethical and psychological toll on AI developers, underscoring growing concerns within the industry about the responsible development and deployment of advanced AI, which could impact future regulatory efforts and corporate practices.
Employees working at leading artificial intelligence (AI) labs and evaluation companies are reportedly facing increasing mental distress, driven by fears that the powerful software they are engineering may inflict widespread harm on society. At the UK’s AI Security Institute (Aisi), which is regarded globally as a leading independent evaluation center for frontier models, multiple staff members have taken stress leave and entered counseling, The Financial Times reported, citing individuals familiar with the matter. Further, the publication reported that compressed evaluation timelines for unreleased software, paired with unease over rapid commercial deployments have led to burnout and deteriorating morale inside the agency.Mental stress no limited to evaluation companiesSimilar reports have come out from major tech companies, including OpenAI, Anthropic and Google DeepMind, where several specialists have resigned after concluding their projects carry excessive societal danger.The report notes that a Google DeepMind staffer described the effort to establish safety safeguards as an…
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in