Experts Warn Microsoft’s AI-Powered ‘Recall’ Could Be a Security Nightmare

In a significant development at its Build 2024 event, Microsoft unveiled a new feature called Windows Recall as part of its Copilot artificial intelligence tool. However, just two weeks into its announcement, the feature has already come under heavy criticism from security experts who are labeling it a hackable security disaster.

What is Windows Recall?

Windows Recall is designed to track all activity on a Windows computer, making it easier for users to find information later using natural language. By capturing data from across all applications through a series of screenshots and storing these interactions in a local database, Recall aims to enhance the user experience.

The Security Backlash

Despite its innovative premise, Recall is being blasted by security experts. At least one white-hat hacker has already developed a tool, aptly named TotalRecall, which can extract sensitive data from Recall. This tool is readily available on GitHub, highlighting the immediate concerns about data security.

Adding to the criticism, the Reddit community has expressed strong disapproval of the Recall feature. Users on various tech subreddits have voiced their concerns and frustrations, with many emphasizing their intent to disable the feature as soon as possible. One user bluntly stated, “Can’t wait to disable it,” reflecting the general sentiment of mistrust towards the feature’s potential security implications. This grassroots backlash underscores the broader apprehension among everyday users about the safety of their private data.

Expert Opinions

Security expert Kevin Beaumont tested the feature and shared a detailed analysis on Medium. He noted that while Recall might have niche uses for some users, it presents such a significant security risk that it could jeopardize the entire Copilot Plus brand. Beaumont emphasized that the feature’s implementation lacked the necessary cybersecurity and engineering rigor.

Barry Briggs, a former CTO at Microsoft’s information technology unit, expressed his doubts in a post titled “Should Microsoft Recall Be Recalled?” Briggs questioned the real value of the feature for users or the enterprise space and highlighted the potential risks posed by well-funded and well-trained foreign actors trying to break the code.

Privacy Concerns

The controversy has led to the publication of guides on how to disable the feature. Users are advised to go to Windows settings, select Privacy & Security, navigate to Recall & Snapshots, and toggle off the feature or delete any collected data.

Security Flaws and Risks

Beaumont’s analysis revealed that Recall saves screenshots in an unencrypted, plain text database accessible on the PC itself. This means the database contains a record of everything viewed on the PC in plain text, making it vulnerable to malware attacks.

Privacy advocates are also concerned about Recall’s opt-out approach. While users can disable the feature, there is a possibility that administrators can remotely enable it, raising further privacy issues.

Potential Impact on Microsoft’s Brand

Beaumont and other critics warn that the poorly implemented and rolled-out Recall feature could severely damage the Copilot brand. Beaumont likened the situation to “watching Microsoft become an Apple Mac marketing department,” implying a disconnect from user needs. He concluded that Recall could result in real customer harm and be an act of self-harm by Microsoft in the name of AI.

As Microsoft gears up for the launch of its new generation of PCs with Copilot Plus on June 18, the tech giant faces mounting pressure to address the significant security and privacy concerns surrounding its Recall feature. Whether Microsoft will heed these warnings and make the necessary changes remains to be seen.