• Everyday AI
  • Posts
  • How to use Claude’s AI ‘Computer use’ for everyday people

How to use Claude’s AI ‘Computer use’ for everyday people

How to use Claude's agentic AI, Salesforce launches Agentforce, GitHub partners with Google and Anthropic, U.S. sets restrictions on AI in China, LinkedIn unveils AI hiring assistant and more!

Author

Everyday AI
October 29, 2024

Outsmart The Future

Today in Everyday AI
8 minute read

🎙 Daily Podcast Episode: Today we’re showing you how to use Claude’s agentic AI with its newly released Computer Use feature. Give it a listen.

🕵️‍♂️ Fresh Finds: ChatGPT rolls out chat history search, NVIDIA to help power world’s largest supercomputer and U.S. Department of Defense tests AI software. Read on for Fresh Finds.

🗞 Byte Sized Daily AI News: GitHub Partners with Google and Anthropic, Salesforce releases Agentforce publicly and LinkedIn unveils an AI hiring assistant. For that and more, read on for Byte Sized News.

🚀 AI In 5: Mistral’s AI Agents have flown under the radar. How do they stack up against custom GPTs? We give you the pros and cons. See it here

🧠 Learn & Leveraging AI: We break down what’s new with Anthropic Claude’s Computer Use and how the everyday person can use it. Keep reading for that!

↩️ Don’t miss out: Did you miss our last newsletter? We talked about Apple Intelligence going live, Meta unveils NotebookLlama and announces AI search engine, Grok AI gets new image capabilities. Check it here!

How to use Claude’s AI ‘Computer use’ for everyday people 🧑‍💻️

Wanna learn Claude's new agentic AI? 

Got 30ish minutes? This is the show for you.

In short -- Computer Use is an agentic AI system where you can control a virtual computer just by talking to Claude.

Join the conversation and ask Jordan questions on AI here.

Also on the pod today:

• Overview of Anthropic Claude 🤖
• Critiques of Anthropic's Tools 🤔
• Future of AI Agents 💭

It’ll be worth your 41 minutes:

Listen on our site:

Click to listen

Subscribe and listen on your favorite podcast platform

Listen on:

Here’s our favorite AI finds from across the web:

New AI Tool Spotlight – Octomind is an AI agent QA tool, Anything World lets you generate any 3D model with AI and Augment UI provides AI-powered UI generation.

OpenAI – You can now search your chat history on ChatGPT’s web version.

Big Tech – Cisco has unveiled a high-density GPU server tailored for training large language models and a new product called "AI PODS" designed for inferencing.

NVIDIA – NVIDIA's Spectrum-X Ethernet will enable the world’s largest supercomputer.

AI in Government - The Department of Defense has been testing AI software.

Apple - GitHub’s Copilot is coming to Apple’s Xcode

Amazon - Amazon is extending its Rufus AI to more international markets.

Content Creation - Stable Diffusion 3.5 Medium has just been unveiled.

Trending in AI – Elon Musk says there’s a 10-20% chance AI could turn bad.

Money in AI - Toyota and NNT are making a $3.3 billion investment for self-driving AI.

AI in Medical – An NVIDIA backed AI firm has unveiled a new drug discovery breakthrough.

Read This – Researchers have uncovered vulnerabilities in Open-Source AI and ML models

AI in Media – Robert Downey Jr says he’ll sue any executives who make AI replicas of himself.

1. GitHub Partners with Google and Anthropic for New AI Models 🤝

GitHub has announced its partnership with Google and Anthropic to integrate their AI models into its popular Copilot coding assistant. Starting soon, developers will have the option to leverage Google's Gemini and Anthropic's Claude 3.5 Sonnet for coding assistance, enhancing their programming experience with cutting-edge AI capabilities.

Initially, users can engage with these new models through chat features that allow them to pose questions and receive tailored coding suggestions.

2. U.S. Sets New Rules to Restrict AI Investments in China ❌

The Biden administration is set to implement new rules starting January 2 that will limit U.S. investments in key technology sectors in China, including artificial intelligence and semiconductors, all aimed at protecting national security. This decision, stemming from an executive order signed by President Biden in August, reflects growing concerns about U.S. know-how potentially bolstering Chinese military and cybersecurity advancements.

While the rules allow some leeway for investments in publicly traded securities, they signal a significant shift in how the U.S. engages with foreign tech markets.

3. Salesforce Launches Agentforce: A Game Changer in AI Chatbots 🤩

Salesforce has unveiled Agentforce, a low-code platform designed to empower businesses in deploying AI agents without the need for extensive coding skills. Already adopted by notable firms like OpenTable, Saks, and Wiley, this platform promises to transform customer interactions by automating tasks based on data changes and business rules, effectively reducing reliance on human engagement.

With features like the Agentforce Service Agent starting at just $2 per conversation and the customizable Agent Builder, professionals looking to boost productivity and streamline client communications now have a powerful new resource at their fingertips.

4. LinkedIn Unveils AI-Powered Hiring Assistant 💼

LinkedIn has rolled out its new Hiring Assistant, an AI tool designed to streamline the recruitment process by automating tasks like crafting job descriptions and sourcing candidates. Currently available to a select group of large enterprises, this assistant aims to help recruiters focus on more impactful aspects of their jobs by handling mundane administrative tasks.

As LinkedIn continues to integrate AI into its offerings, it's positioning itself to enhance its B2B revenue streams, especially in the competitive recruitment market.

5. OpenAI Teams Up with Broadcom for Custom AI Chip Development 🛠️

OpenAI has partnered with Broadcom and Taiwan Semiconductor Manufacturing Co. to develop a custom chip tailored for advanced artificial intelligence systems. This initiative aims to reduce dependency on Nvidia while addressing surging demand for AI technology, with plans to produce the first chip by 2026.

The collaboration also includes Advanced Micro Devices as a key supplier, highlighting the growing investment in AI hardware.

6. Amazon Q Developer Launches Inline Chat Feature 💬

Amazon Q Developer unveiled its new inline chat capability for Visual Studio Code and JetBrains, allowing developers to interact directly within their code editor. This feature merges AI-generated responses into the codebase, simplifying tasks like bug fixing and documentation without the hassle of switching windows.

Powered by Anthropic's Claude 3.5 Sonnet, this tool promises to enhance productivity and streamline workflows for developers tackling complex coding challenges.

7. Oracle Launches AI Electronic Health Record System 🧑‍⚕️

Oracle has unveiled a groundbreaking electronic health record (EHR) system, marking its most significant health-care update since acquiring Cerner for $28 billion in 2022. This new EHR, designed with cloud and AI capabilities, allows doctors to interact using voice commands, drastically simplifying patient data access and management.

With the health-care sector’s ongoing challenges, this innovative approach could potentially reshape how clinicians engage with medical records, improving efficiency and patient care.

Mistral AI Agents: What they are and how to build one or free

AI startup and LLM maker Mistral has a feature that allows you to make AI agents….for FREE!

There’s some good upsides to why you might want to use Mistral’s AI Agents over custom GPTs and Claude Projects.

We go over the pros and cons.

🦾How You Can Leverage:

Remember that ridiculously bad AI video of Will Smith eating Spaghetti?

Well, that’s what we have today with AI agents.

Technically usable.

Not very good.

(Yet.)

After a bunch of requests stemming from our Claude 3.5 Sonnet general update show last week, we came back for another round today with a more laser focus:

What is it?

It’s Anthropic’s new agentic AI tool that literally performs actions on a virtual computer and it only requires simple text commands. 

Today on our live show, an AI agent in the cloud literally did our work. 

Was it cool? 

Sure. 

Was it buggy? 

Absofrigginlutely. 

Should you still re-watch today’s show and follow along? 

YES!

Why? 

Even though Anthropic’s new ‘Computer Use’ mode is a mere preview into the future of Agnetic AI, orchestrating AI agents is a skillset we all must learn. 

(News flash — Salesforce JUST released its Agentforce agents.) 

Alright, after you’ve caught up with what’s new in Sonnet 3.5, then you’re ready to fully dive in. 

Here’s what ya need to know to make the most of Computer Use today. 

1 – Grab your pencils ✏️

Wanna follow along? 

Today’s show was more tutorial-based, so feel free to re-watch/re-listen as you need to. 

But, here’s the essentials for what you need to launch ‘Computer Use’ and get a very small taste of AI agents. 

Once you go through these simple steps, you’ll have your own AI agent to direct that runs in a virtual environment, and can execute tasks autonomously in a virtual environment. 

Try this: 

A. Claude API key — You can even do this on the free plan, but you’ll need to add a Credit Card and add money to your Claude Console, which is technically separate from a front-end Claude AI chatbot account. 

Once you get the API key, which we showed you at this point in the video, copy and paste it and get it ready. 

B. Download and Install the Docker Desktop program — This is a free program, and one of the recommended ways Anthropic recommends to use Computer Use. You can download it here. (Make sure to grab the right version according to your computer type.) 

C. This Snippet from Anthropic — On Anthropic’s Github repo, they give you this snippet. You’ll paste your API key in the area below. 

(Make sure not to modify anything else, or add/delete spaces.) 

docker run -e ANTHROPIC_API_KEY=$ANTHROPIC_API_KEY -v $HOME/.anthropic:/home/computeruse/.anthropic -p 5900:5900 -p 8501:8501 -p 6080:6080 -p 8080:8080 -it ghcr.io/anthropics/anthropic-quickstarts:computer-use-demo-latest

D. Launch the snippet in Docker’s Terminal 

After installing Docker, launch it and click the small ‘Terminal’ area at the very bottom. Then, you’ll copy/paste the updated snippet above with your API key, hit enter, and hope it works. 

(It’s normal for it to take an extra try or two) 

2 – Get practicing 🏃

Follow the steps above, and you should be off and running at the AI playground. 

In short, chat with Claude on the left hand side of your new local environment and the agentic ‘Computer Use’ tool will execute tasks on your behalf on the right side. 

Give it some simple commands that a human should be able to do on a computer, sit back, and watch it either succeed or fail. 

Also, you’ll really see the value of sharply worded prompting, as Tier 1 rate limits will likely push you into constant ‘Toke Timeout.’ 

For 99% of us, you’ll be dealing with a minute-by-minute token rate, which is pretty easy to hit each time you use it. 

Remember, you’re paying for usage here. For our short little demo, it costs us $1.42.

 

Try this: 

Be patient. No, Anthropic’s Computer Use isn’t ready to do your 9-to-5 just yet. Lolz. 

Buuuuuuuuut— Anthropic shipped. 

Which is a refreshing take, vs the normal marketing and wait lists we often get from other big players in the AI space. 

The downside of shipping an autonomous agent that is still VERY much a work in progress? 

You’ll see after a few run-throughs, that it’s super buggy. 

3 – Perspective is everything 🧠

So why the heck should you use this thing? 

It’s a bit buggy, it’s not a final/polished product, and there’s some tight guardrails in this initial offering. 

In short, Computer Use isn’t super futuristic and shiny. It’s buggy, yet kinda capable. 

But in a few months….

Sometimes, getting reps in now isn’t so you can reap benefits now. 

It’s about being prepared for what’s to come. 

But Anthropic has taken a front seat in the AI agents race. 

Try this: 

After you’ve crossed off #1 and #2 above, you’ve already got your feet wet in breaking new agentic tech. 

Congrats homies! 

Now, get caught up in everything AI agents. 

Cuz this space is moving CRAZY fast. 

Here’s a quick overview:

⌚

Numbers to watch

$82 Million

GMI Cloud has secured $82M in Series A for its GPU cloud infrastructure.

Now This …

Let us know your thoughts!

Vote to see live results

Do you attend our livestreams?

Every weekday, we bring you fresh AI insights, exclusive interviews, and breaking news with our Everyday AI livestream.

Login or Subscribe to participate in polls.

Reply

or to participate.