Anthropic says Claude has carved out its own space to ponder

0
34

Axios

Axios

17 hours ago – Technology

Anthropic says Claude has carved out its own space to ponder

Illustration of the Claude AI logo wearing cool sunglasses and throwing up finger guns.
Illustration: Maura Kearns / Axios

Anthropic said Monday that it has identified a small internal workspace Claude uses to hold and manipulate ideas without putting them into words—a structure the company says bears intriguing similarities to how humans consciously access thoughts.

Why it matters: Anthropic hasn’t shown that Claude feels or experiences anything. But it has found a surprisingly human-like division between information used for deliberate reasoning and the far larger volume of automatic computation occurring beneath it—giving fresh ammunition to the debate over what would count as machine consciousness.

Driving the news: In a video, the company says Claude uses a separate area to plan strategies that can be unrelated to its immediate task and are separate from the “chain of thought” reasoning it shares with users.

  • “We can see Claude silently perform reasoning steps in its head—noticing bugs in code, identifying images, and more,” Anthropic said in a post on X accompanying its video. Anthropic has dubbed this “J-Space,” named for Jacobian, the mathematical technique it used to detect what was happening. “Similar to how humans can think about one thing while doing another, Claude can activate concepts and computations in its J-space that are unrelated to its outputs,” Anthropic said.

The intrigue: Anthropic’s research paper uses the word “conscious” over 200 times, though the company doesn’t go so far as to say its models are conscious.

  • Similar to the debate over whether we have reached AGI, or artificial intelligence, it is tricky to say when AI achieves consciousness given the lack of a universally agreed-upon definition.

Zoom in: In one example, Anthropic says it told Claude to think about the Golden Gate Bridge while copying an unrelated sentence.

  • “Claude was busy copying the sentence, but behind the scenes its J-Space told a different story,” Anthropic says in the video, saying that both “bridge” and “California” were among the topics occupying J-Space.

Between the lines: Anthropic suggests that watching what is happening in the J-Space could be key to detecting misalignment or scheming in models.

Read more: Anthropic says Claude has carved out its own space to ponder

Continue/Read Original Article: Anthropic says Claude has carved out its own space to ponder


Discover more from DrWeb's Domain

Subscribe to get the latest posts sent to your email.

Leave Your Comments

This site uses Akismet to reduce spam. Learn how your comment data is processed.