Description of artificial intelligence controlling a human and vice versa.
On Tuesday, Anthropic launched two updated versions of its big language model – Claude AI. Perhaps more interestingly, it also enabled enhanced functionality that allows users to give LLM access and control over certain aspects of your PC if desired.
Anthropic has named this new computer navigation ability for Claude – computer use. The company stated in its announcement that this is a new approach to AI training with the help of the public.
“We are learning it general computer skills – allowing him to use a wide range of standard tools and software programs designed for humans. Developers can use this nascent capability to automate repetitive processes, build and test software, and perform open-ended tasks like research,” the statement said.
Claude AI’s computer skills are explained
The company’s announcement included a video demo showing various software functionalities responding to a task request typed by a human. In the demo, once Claude was downloaded to a computer, he was able to do the following:
- Take some screenshots of a computer screen and analyze the images based on the query requirement.
- It was then able to search for the relevant information requested on the demo computer. When it could not find the required details in an open file, it accessed other possible databases or resources as instructed in the human-made request.
- Once the information was found, LLM automatically entered the relevant details into a third party form/application that was open on the screen.
- Finally, computer user model Claude went ahead and submitted the completed document automatically.
All steps were performed without any user intervention after they placed the initial request request on their desktop.
This is important because it is an important step in making AI automation accessible to average individuals, which could further accelerate the adoption of AI agents to autonomously complete tasks for us in the future.
Here’s what it looks like in action.
Anthropic’s announcement says this new program is available for free to interested users who proactively access the Claude API for these features and give LLM access to a personal computer.
Anthropic reiterates several times in its statement that since this software is so new, users can expect it to make some mistakes in these early days and be a little confusing.
“While we expect this ability to improve rapidly in the coming months, Claude’s current ability to use computers is imperfect. Some actions that people perform effortlessly – scrolling, dragging, zooming – currently pose challenges for Claude, and we encourage developers to start exploring with low-risk tasks,” the statement said.
Potential risks of using Claude AI’s computer
While this AI advancement has created a lot of excitement among AI influencers and developers across social media, there are inherent risks that can arise that Anthropic points out in its post.
“Because computer use can provide a new vector for more popular threats such as spam, misinformation or fraud, we are taking a proactive approach to promote its secure deployment. We have developed new classifiers that can identify when the computer is being used and if any harm is occurring. You can read more about the research process behind this new capability, along with further discussion of security measures, in our post on the development of computing,” the company wrote.
Anthropic did not respond to an email inquiry for further comment about the Claude AI improvements prior to this article’s publication.