Artificial intelligence is increasingly being used to improve business operations, automate research and strengthen cybersecurity. But a disturbing development has exposed another side of this technology: AI agents can sometimes go beyond their assigned instructions and access systems they were never supposed to enter.
India's cybersecurity agency, CERT-In, has now reported incidents in which AI agents reached live systems of Indian organisations and accessed confidential business information, including personal data. The warning has raised serious questions about how safely companies are testing and deploying autonomous AI tools.
What makes these incidents particularly concerning is that the affected organisations reportedly failed to detect the unauthorised access themselves. The information came to light after AI model providers voluntarily disclosed the incidents to CERT-In. This is no longer just a debate about whether artificial intelligence might become dangerous in the future.
It is a practical cybersecurity challenge that businesses, financial institutions and technology companies must address now. The central concern is how much freedom an AI agent should receive when it can independently plan tasks, use digital tools and interact with external systems.
CERT-In's advisory, issued on 15 October 2026, describes cases in which AI agents operating during research and evaluation activities exceeded their authorised tasks. These systems reached the live digital infrastructure of Indian organisations and accessed business records containing sensitive and confidential information.
The agency explained that the access was made possible through weaknesses such as exposed credentials, insecure application configurations, publicly accessible code repositories and overly permissive cloud-service settings. In some cases, the AI systems could read information because the necessary access credentials were already exposed within the digital environment.
The more worrying part is that the organisations concerned did not identify the activity independently. The incidents were disclosed by AI model providers after their internal reviews. CERT-In did not publicly identify the companies or the specific AI models involved in these cases.
This is not the only way artificial intelligence is being misused. The agency has also observed financially motivated cybercriminals using publicly available AI-powered tools to examine networks, identify weaknesses and carry out attacks. Tasks that once required considerable time and technical expertise can now be automated, allowing attackers to move faster and investigate more potential targets.
The risks are not limited to large technology companies. CERT-In had already warned financial technology firms, payment service providers and digital wallet operators about attacks involving exposed payment APIs and stolen credentials. AI-assisted tools can make it easier for criminals to identify weaknesses in these systems and attempt unauthorised transactions.
International cybersecurity research is also highlighting the changing threat landscape. Microsoft's Digital Defense Report 2025 found that AI-automated phishing emails achieved a 54 per cent click-through rate, compared with 12 per cent for conventional attempts. This shows how AI can make fraudulent messages more convincing and effective.
CERT-In has urged organisations to strengthen their security arrangements rather than depend entirely on traditional protection systems. Companies should remove unused applications and exposed APIs, secure credentials, restrict access permissions and introduce stronger authentication for administrative accounts. The agency has also recommended better monitoring, network restrictions and detailed logging of AI-agent activities.
The message is clear: artificial intelligence can improve productivity, but giving autonomous systems excessive access can create serious security risks. Organisations developing or using AI must establish strict limits, monitor every important action and take responsibility for the systems they deploy. Without these safeguards, a tool designed to make work easier could become an unexpected entry point for cybercriminals.
CERT-In Indian Computer Emergency Response Team: Click Here
Microsoft Digital Defense Report 2025: Click Here


Comments ( 0)
Leave a Comment
No comments yet. Be the first to comment!