THE COMPANION
SECTION 18
ISSUE 001
Live Multimodal Assistants Replace Search
Projection: Built-in computer use links perception to action in Gemini 3.5 Flash; Robotics-ER 1.6 adds spatial planning, tool calls, success detection, and instrument reading. A live assistant could reason over what a user shows and act. Replacing search remains unproven until evolving-scene evaluations establish reliability and control.
Why this idea is here
What the evidence establishes.
Google documents built-in computer use in Gemini 3.5 Flash and embodied planning, spatial reasoning, tool calls, success detection, and instrument reading in Robotics-ER 1.6. The live-assistant conclusion is a labeled projection.
Source ledger
Read the sources.
- S01Computer use in Gemini 3.5 Flash
official model release / published 2026-06-24 / retrieved 2026-07-10
- S02Gemini Robotics-ER 1.6
official research release / published 2026-04-14 / retrieved 2026-07-09