The anti-AI thread

Page 13 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136
“Prompt injection” attacks on agentic browsers:
By slightly adjusting the URL, the browser fails to validate it as a web address and instead “treats the entire content as a prompt.” That makes a disguised URL a perfect place to embed harmful messages.


The vulnerability could even be used to make Atlas’s agent navigate to the user’s Google Drive and mass delete files, since the user is already running an authenticated session.



Also applies to Microsoft Copilot via things like infected Excel files:


The flaw, detailed in a blog post published today by researcher Adam Logue, exploits the AI assistant’s integration with Office documents and its built-in support for Mermaid diagrams, enabling data exfiltration without direct user interaction beyond an initial click.

The attack begins when a user asks M365 Copilot to summarize a maliciously crafted Excel spreadsheet. Hidden instructions, embedded in white text across multiple sheets, use progressive task modification and nested commands to hijack the AI’s behavior.
 

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136

The AI apocalypse has begun


I consider this one of the greatest threats to humanity for this generation. The trust erosion is going to be TERRIBLE.

Two primary issues:

1. False allegations
2. Fake news stories

This is powered by:

1. AI video
2. AI photos
3. AI websites
4. AI writing (fake news articles)

I've already run into people my age this week falling for fake AI videos on social media because you can no longer tell the difference due to photorealism. Public legal issues have already started:




Trust in the media is already low:


1761919924465.png

Bias perception has been an issue for ages anyway:


1761920262531.png



sakute.gif
 

nakedfrog

No Lifer
Apr 3, 2001
62,919
19,148
136
Well, we better make sure we can't pass any legislation on AI for ten years, huh?

Seems really weird to list AP News as "far left" and Epoch Times and Zero Hedge as only partly-right.
 
  • Like
Reactions: lxskllr

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136
Well, we better make sure we can't pass any legislation on AI for ten years, huh?

On one hand, stopping it isn't just pointless, it's impossible. China keeps releasing better, smaller, faster FREE models for anyone to use, which bypass tools like AI video watermarking, camera 3D depth verification, etc. Progress will continue due to capitalism, innovation. competition, and just the natural course of industry growth.

On the other hand, what SHOULD happen is:

1. Strict laws (ex. Deepfakes) with teeth (i.e. actual prosecution & fast turnaround)

2. Verification systems from trusted sources (not easy when even government accounts like POTUS & the White House are using AI)

There are valuation tools out there, but because technology always stays a step ahead, it is going to become progressively harder to detect fakes due to both the quality & the sheer volume of data as the market gets flooded:



It's a big mess. Personally I think that AI-generated fake news will cause MASSIVE problems in coming years. We're just seeing the first inklings of it:

Federal judges using AI filed court orders with false quotes, fake names

Adelphi student accused of using AI on an assignment sues the school

Facebook, Instagram accounts falsely linked to predatory behavior via AI auto-moderation

Dutch election overshadowed by AI fakes and genocide accusations

 

nakedfrog

No Lifer
Apr 3, 2001
62,919
19,148
136
On one hand, stopping it isn't just pointless, it's impossible. China keeps releasing better, smaller, faster FREE models for anyone to use, which bypass tools like AI video watermarking, camera 3D depth verification, etc. Progress will continue due to capitalism, innovation. competition, and just the natural course of industry growth.

On the other hand, what SHOULD happen is:

1. Strict laws (ex. Deepfakes) with teeth (i.e. actual prosecution & fast turnaround)

2. Verification systems from trusted sources (not easy when even government accounts like POTUS & the White House are using AI)

There are valuation tools out there, but because technology always stays a step ahead, it is going to become progressively harder to detect fakes due to both the quality & the sheer volume of data as the market gets flooded:



It's a big mess. Personally I think that AI-generated fake news will cause MASSIVE problems in coming years. We're just seeing the first inklings of it:

Federal judges using AI filed court orders with false quotes, fake names

Adelphi student accused of using AI on an assignment sues the school

Facebook, Instagram accounts falsely linked to predatory behavior via AI auto-moderation

Dutch election overshadowed by AI fakes and genocide accusations

I didn't say anything about stopping it, but as I said before, the way it's being implemented is utterly disastrous. A calamity of global proportions, and it's only getting worse because billionaires are determined to make more money they can't possibly spend. I do think we may see acts of terrorism against AI data centers in the coming years.
 

Kaido

Elite Member & Kitchen Overlord
Feb 14, 2004
51,707
7,294
136
I didn't say anything about stopping it, but as I said before, the way it's being implemented is utterly disastrous. A calamity of global proportions, and it's only getting worse because billionaires are determined to make more money they can't possibly spend. I do think we may see acts of terrorism against AI data centers in the coming years.

As of like just now, pushbutton Deepfakes are now, literally, Hollywood-level. I don't think very many people understand the disastrous implications this technology will have: