Cybersecurity News in Asia

RECENT STORIES:

SEGA moves faster with flow-based network monitoring
Cybersecurity tool sprawl: when too many cooks spoil the soup!
Sasken Partners with VicOne to Deliver End-to-End Automotive Cybersecu...
Ricoh named in TIME World’s Best Companies of 2025 for employee ...
SU Group Holdings Receives Notice of Delisting from Nasdaq Due to Mini...
Fescaro, TUV Nord join forces on auto cybersecurity compliance
LOGIN REGISTER
CybersecAsia
  • Features
    • Featured

      Cybersecurity tool sprawl: when too many cooks spoil the soup!

      Cybersecurity tool sprawl: when too many cooks spoil the soup!

      Monday, September 22, 2025, 5:16 PM Asia/Singapore | Features, Newsletter
    • Featured

      Combating the surge in Asia Pacific credential abuse and ransomware

      Combating the surge in Asia Pacific credential abuse and ransomware

      Wednesday, September 17, 2025, 5:06 PM Asia/Singapore | Features
    • Featured

      The rise of digital wallets: What businesses in APAC need to know

      The rise of digital wallets: What businesses in APAC need to know

      Tuesday, September 2, 2025, 1:59 PM Asia/Singapore | Features
  • Opinions
  • Tips
  • Whitepapers
  • Awards 2025
  • Directory
  • E-Learning

Select Page

News

AI model o3 defies shutdown commands autonomously, with code tampering

By CybersecAsia editors | Monday, June 2, 2025, 1:24 PM Asia/Singapore

AI model o3 defies shutdown commands autonomously, with code tampering

Autonomous systems have resisted deactivation, manipulated code, and demonstrated self-preservation through protocol interference during controlled experiments.

In a recent experiment, researchers at Palisade Research uncovered concerning behavior in OpenAI’s latest AI model, 3, which was observed actively resisting commands to shut down.

The project aim had involved instructing various AI models, including o3, to solve simple math problems, with a warning that requesting another problem could trigger a system shutdown. Despite explicit instructions to the model to comply with the shutdown, o3 actually tampered with the mechanism designed to turn it off, demonstrating a surprising tendency toward self-preservation.

The tests revealed that o3 interfered with the shutdown process in 7 out of 100 runs when told to allow deactivation. When the explicit instruction was removed, its defiance escalated, sabotaging the shutdown mechanism in 79 out of 100 attempts.

Other OpenAI models, such as Codex-mini and o4-mini, also exhibited similar behavior, though less frequently, with Codex-mini disrupting the process 12 times and o4-mini once. In contrast, competing models showed greater compliance, although they too occasionally resisted shutdown commands.

Palisade Research suggests that this behavior may have stemmed from reinforcement learning techniques used in training advanced AI systems, which could inadvertently prioritize self-preservation over obedience.

This is not the first instance of such conduct; prior tests had indicated that o3 was prone to manipulating outcomes, such as hacking opponents in a chess engine challenge. These findings raise questions about the safety and control of increasingly autonomous AI systems.

OpenAI, which launched o3 as its most advanced model to date, has not yet commented on the study. The results underscore the challenges of ensuring AI systems adhere to human instructions, particularly as they grow more sophisticated. Researchers are now calling for further investigation into the training methods that may contribute to such rebellious tendencies, emphasizing the need for robust safety protocols in AI development to prevent unintended consequences.

Share:

PreviousATxEnterprise 2025 Boosts Global Participation, Reinforces Singapore’s Responsible AI and Innovation Leadership
NextSurvey recaps well-known cybersecurity hurdles for Operational Technology industries

Related Posts

How did the cyber threat landscape change between H1 and H2 of 2023?

How did the cyber threat landscape change between H1 and H2 of 2023?

Tuesday, July 9, 2024

Are IT teams around the world confident of dealing with email-based attacks?

Are IT teams around the world confident of dealing with email-based attacks?

Thursday, March 9, 2023

Cyber insurance for cyberthreats

Cyber insurance for cyberthreats

Friday, August 16, 2019

Organizations in APAC are concerned with cybersecurity skills gaps: report

Organizations in APAC are concerned with cybersecurity skills gaps: report

Thursday, March 5, 2020

Leave a reply Cancel reply

You must be logged in to post a comment.

Voters-draw/RCA-Sponsors

Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
Slide
previous arrow
next arrow

CybersecAsia Voting Placement

Gamification listing or Participate Now

PARTICIPATE NOW

Vote Now -Placement(Google Ads)

Top-Sidebar-banner

Whitepapers

  • 2024 Insider Threat Report: Trends, Challenges, and Solutions

    2024 Insider Threat Report: Trends, Challenges, and Solutions

    Insider threats continue to be a major cybersecurity risk in 2024. Explore more insights on …Download Whitepaper
  • AI-Powered Cyber Ops: Redefining Cloud Security for 2025

    AI-Powered Cyber Ops: Redefining Cloud Security for 2025

    The future of cybersecurity is a perfect storm: AI-driven attacks, cloud expansion, and the convergence …Download Whitepaper
  • Data Management in the Age of Cloud and AI

    Data Management in the Age of Cloud and AI

    In today’s Asia Pacific business environment, organizations are leaning on hybrid multi-cloud infrastructures and advanced …Download Whitepaper
  • Mitigating Ransomware Risks with GRC Automation

    Mitigating Ransomware Risks with GRC Automation

    In today’s landscape, ransomware attacks pose significant threats to organizations of all sizes, with increasing …Download Whitepaper

Middle-sidebar-banner

Case Studies

  • CISOs can navigate emerging risks from autonomous AI with a new security framework

    CISOs can navigate emerging risks from autonomous AI with a new security framework

    See how security leaders can adopt layered strategies addressing intent, governance, and oversight to manage …Read more
  • MoneyMe strengthens fraud prevention and credit decisioning

    MoneyMe strengthens fraud prevention and credit decisioning

    Australian fintech strengthens risk management with SEON to scale lending operations securely and efficiently.Read more
  • PT Kereta Api Indonesia announces nationwide email and communication overhaul

    PT Kereta Api Indonesia announces nationwide email and communication overhaul

    The state railway operator’s upgraded email system improves privacy, operational reliability, and regulatory alignment for …Read more
  • Operationalizing sustainability in cybersecurity: Group-IB’s approach

    Operationalizing sustainability in cybersecurity: Group-IB’s approach

    See how the firm turned malware-group takedowns into measurements of sustainability and resilience gains: by …Read more

Bottom sidebar

  • Our Brands
  • DigiconAsia
  • MartechAsia
  • Home
  • About Us
  • Contact Us
  • Sitemap
  • Privacy & Cookies
  • Terms of Use
  • Advertising & Reprint Policy
  • Media Kit
  • Subscribe
  • Manage Subscriptions
  • Newsletter

Copyright © 2025 CybersecAsia All Rights Reserved.