
Open-Vocabulary BEV Segmentation with 3D-Aware Geometric Constraints
Autonomous driving perception is shifting from closed-set to open-vocabulary recognition. This paper bridges vision-language models with bird's-eye view (BEV) segmentation, a core autonomous driving task, by solving the geometric inconsistency problem that arises when lifting 2D semantic predictions into 3D space. The work combines Gaussian splatting with geometric constraints to maintain real-time efficiency while recognizing novel object categories unseen during training. This matters because production self-driving systems currently fail on out-of-distribution scenarios. Open-vocabulary BEV segmentation could make autonomous fleets more robust to unpredictable environments without retraining on every new object class.62



























