Computer-use task where an agent interacts with an Ubuntu (XFCE4) virtual desktop to solve a multi-step GUI challenge. The tool set mirrors the Anthropic computer-use demo.
The Ubuntu desktop (Xvfb + XFCE4) runs in a separate container alongside a FastMCP server that exposes computer-use tools. The desktop and MCP server share a container because the tools need direct access to the X display.
A tkinter application (challenge.py) presents a multi-step challenge that requires the agent to click buttons, type text, and read the result from the screen. The task cannot be solved without genuine GUI interaction.
harbor run -p harbor_cookbook/recipes/computer-use-ubuntu --agent claude-code --model anthropic/claude-sonnet-4-6Multi-container tasks require the docker environment provider because they rely on Docker Compose networking. They are not supported on some of the cloud providers in Harbor (Modal, E2B, etc.).