Claude gets hands on your computer

Welcome Humans🤖,

Here is what we have Today:

• 📊 OpenAI hires economist (Not replaced by AI)

• 💻 AI learns to computer: "Hello World, where's Ctrl+Alt+Del?"

• 🎭 Your face + AI = Hollywood star?
  Runway lets you puppet AI characters with selfie.

• 💼 New Job Opportunities

Anthropic

🧠 Anthropic's AI Just Learned to Use a Computer

Anthropic introduced upgraded Claude 3.5 Sonnet and new Claude 3.5 Haiku, both with 'computer use' capability, allowing Claude to interact with computers through screen viewing, typing, cursor movement, and command execution.

How does it work?

• AI can navigate computer interfaces autonomously.

• Performs complex tasks across multiple apps and websites.

• Uses "general computer skills" rather than standalone tools.

• Operates more like a human user than traditional AI.

What's new with the models?

• Sonnet 3.5 shows improved coding and tool use capabilities.

• Outperforms other models, including o1-preview.

• New Haiku 3.5 matches previous high-end models.

• Offers lower cost and higher speed.

What can these models actually do?

• Control computer cursors.

• Input information directly.

• Automate complex tasks.

• Execute commands through API.

How smart is the new Sonnet?

• .Shows major improvements in coding performance.

• Surpasses previous models in industry benchmarks.

• Can now interact with computers like a human.

• Converts instructions into computer commands via API.

What about Haiku?

• Launching later this month.

• Promises faster performance.

• More cost-effective than previous models.

• Excels particularly in coding tasks.

Why is this revolutionary?

• First major AI to directly interact with computers.

• Could transform software development.

• Potential to automate complex tasks.

• Opens new possibilities for AI assistance.

What's next?

• Further refinement of computer use abilities.

• Potential expansion of task complexity.

• Impact on automation industry.

• Evolution of human-AI interaction.

This breakthrough could fundamentally change how we work with AI, making it a more direct and practical tool for everyday computing tasks though it's still early days for the technology.

Trending Today

• Even Realities has made an AI powered glasses “G1 glasses” that can translate and navigate images that are projected on the lens of the glasses in real time.

• AI startup Genmo has launched Mochi 1, a new open-source video generation model built on a new 10B parameter architecture called AsymmDiT, making it the largest open-source video generation model ever released — claims to rival closed competitors like Runway, Pika, and Kling — while being freely available to developers and researchers.

• OpenAI has hired Dr. Aaron Chatterji—former Chief Economist at the White House—to study AI’s economic impacts at OpenAI, leading research into how AI will influence economic growth and job creation — also assess the global economic impacts of building AI infrastructure, give long-term insights on labor market trends,

• Ideogram just unveiled a new AI-powered workspace called Canvas, offering an endless digital board on which users can generate, organize, and seamlessly blend AI-generated and uploaded images. Also introducing advanced tools like Magic Fill and Extend to combine image editing and generation for new creative workflows

• Runway debuted Act-One, a new feature that creators record facial expressions using any camera—even a smartphone—and use them on AI characters — Also from single video and image without motion capture or rigging.

• Meta has suspended several Threads and Instagram accounts that track the private jets of celebrities such as Mark Zuckerberg, Elon Musk, Jeff Bezos, Kim Kardashian, and former US president Donald Trump — ElonJet Creator claimed that he received no explanation to why accounts suspended.

Recommended Reading
If WE had to recommend other newsletters

AI Tool Report is an Newsletter, we enjoy reading daily. AI Tool Report delivers top techniques on how AI can transform your business filled with practical tips, real-world examples.

A Smart Bear is for people who love thinking about strategy, startups, product, marketing, decision-making, and founder psychology.

Job Opportunities

• Walmart - Senior, Software Engineer - Apply

• Palantir Technologies - Mission Security Analyst - Apply

• Databricks - Senior Software Engineer, Backend - Apply

• Deepmind - Research Scientist, Principles of Learning - Apply

• Hippocratic AI - Prompt Engineer - Apply

AI ART

70's sci-fi illustration of a cat astronaut

Ideas? Comments? Complaints?

We read your emails, comments and poll replies daily.

Get the most important AI, tech, and science news in a free daily email.
New Here? Subscribe!
Sponsorship Slots Open for November and Reach over 800+ active readers. (Now 40% off) 🤯

Until next time, Stay Informed!