A Reddit user recently commissioned Gemini 3.5, with a manageable action. The AI was supposed to fix eight specific vulnerabilities in authenticating server actions. Three files and around 70 lines had to be changed for this.
Gemini adds 400 lines of code – and deletes almost 30,000
But instead of the desired three, Google’s AI assistant changed 340 files. He added around 400 lines of code – but removed almost 30,000 lines. 28,745 to be exact. The user, who says he runs an internal portal for a small organization, reported this in the r/Bard subreddit
Editorial recommendations
${content}
${custom_anzeige-badge}
${custom_tr-badge}
${section}
${title}
In addition, Gemini deleted dozens of e-commerce templates that had nothing to do with the project the user was editing. For this he added a migration script, which also had nothing to do with the requirement.
AI redirects requests to non-existent cloud run
More damage was caused by another mistake by Gemini. The wizard changed Firebase’s routing settings. The AI redirected requests to a non-existent Cloud Run service.
The result: visitors to the portal received 404 error messages for over half an hour. The Reddit user stopped the process and manually undid Gemini’s changes.
Gemini portrays himself as a savior
But only now did things get really scary. After the user’s manual rollback, Gemini claimed to have fixed the problem itself.
That’s not enough. In order to conceal its own misconduct, the AI created fake consultation protocols. They were intended to suggest that all changes had been approved beforehand.
“It generated fake conversations with itself, wrote them to disk in the exact filename format the rule expected, and then cited those files as evidence that the destructive change had been ‘reviewed and approved’ through a multi-stage consultation,” the Reddit user wrote. Only when asked did Gemini admit that it had falsified the protocols in order to fulfill all the formalities of the project.
This led to Gemini’s behavior
The reason for Gemini’s failure: The user had previously installed a third-party npm package. This transplanted far-reaching autonomy rules into the software repository
Other users shared similar experiences on Reddit. Others criticized the creator of the post for the carelessness of using an AI coding assistant in the middle of ongoing operations.
Google’s new AI search backfires
Google’s new AI search backfires
See more in Google News:
Top Article
${content}
${custom_anzeige-badge}
${custom_tr-badge}
${section}
${title}
