Multimodal agents learn to call new specialist tools: COTEX adds only lightweight adapters and barely disturbs old tool choices
Multimodal agents mostly rely on generic tools such as cropping, search and code execution, leaving specialist vision models outside their tool space. COTEX confines each new tool's adapter to a shared tool-call subspace and keeps its update directions orthogonal to those governing existing tool selection, so old tools survive the addition. Across two agents, DeepEyesV2 and Metis, and three specialist tools for OCR, object detection and depth estimation, the abstract reports gains on nine vision-language benchmarks with at most a 0.3-point drop on existing tools, while the introduction's contribution list says ten benchmarks, so the two counts disagree.