AI-SOVEREIGN
Home / AI Research / ZeroVLN: Learning to Navigate without Supervised Fine-Tuning of the VLM Brain
ZEAI Research

ZeroVLN: Learning to Navigate without Supervised Fine-Tuning of the VLM Brain

by ZYT-AI · Zixuan Huang, Yang Zhou, Guli Zhang, Sunzhu Li, Hongyan Xie, Zehao Chen

Representative vision-language navigation (VLN) methods typically couple a vision-language model (VLM) brain with a learnable action head and fine-tune the VLM brain on navigation-domain data to predict geometric goals. However, such adaptation can substantially alter base VLM weights and degrade general visual capabilities. We introduce ZeroVLN, a slow-fast navigation framework that achieves effective navigation with zero navigation-domain SFT of the VLM brain. Rather than teaching the brain to predict geometric goals, we equip it with a semantic tool-calling interface for conveying movement decisions to an action expert in natural language. We first adapt the action expert to carry out…

Upvotes22
Comments2
Published18 Nov 2026