Operate your tools with AI "Computer Use"

Use AI to operate your computer like a human would instead of giving it access to special tools / functions / APIs

Problem

Problem

Currently AI can only access "tool" which have been specially prepared for it. By default an LLM can only access it's own training but you can give it tools like web search or others.

The problem with this is that there are a million tools on your computer which dont have APIs and therefore cannot really be connected to an AI this way. This is especially true for B2B Software in all kinds of industries

Solution

Computer Use from Anthropic or "Operator" as OpenAI will likely calls it solves this problem by just making screenshots of your computer and then using AI to figure out where to click.

Check this out:

It currently does not work very reliable yet .. but very likely during 2025 it will work good enough that you can use it for B2B use cases.

Evaluation

Right now this is not ready for production yet but once it will be in 2025 or 2026 at the latest this will have massive implications on how fast you can apply AI in the B2B context and how fast you can "replace" human workers.