Vision-language-action Model
   HOME



picture info

Vision-language-action Model
In robot learning, a vision-language-action model (VLA) is a class of Multimodal learning, multimodal foundation model, foundation models that integrates Computer vision, vision, Natural language, language and actions. Given an input image (or video) of the robot's surroundings and a text instruction, a VLA directly outputs low-level robot actions that can be executed to accomplish the requested task. VLAs are generally constructed by Fine-tuning (deep learning), fine-tuning a vision-language model (VLM, i.e. a large language model extended with Computer vision, vision capabilities) on a large-scale dataset that pairs visual observation and language instructions with robot trajectories. These models combine a vision-language encoder (typically a VLM or a vision transformer), which translates an image observation and a natural language description into a distribution within a latent space, with an action decoder that transforms this representation into continuous output actions, ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  




General Architecture Of A Vision-language-action Model
A general officer is an officer of high rank in the armies, and in some nations' air and space forces, marines or naval infantry. In some usages, the term "general officer" refers to a rank above colonel."general, adj. and n.". OED Online. March 2021. Oxford University Press. https://www.oed.com/view/Entry/77489?rskey=dCKrg4&result=1 (accessed May 11, 2021) The adjective ''general'' had been affixed to officer designations since the late medieval period to indicate relative superiority or an extended jurisdiction. French Revolutionary system Arab system Other variations Other nomenclatures for general officers include the titles and ranks: * Adjutant general * Commandant-general * Inspector general * General-in-chief * General of the Air Force (USAF only) * General of the Armies of the United States (of America), a title created for General John J. Pershing, and subsequently granted posthumously to George Washington and Ulysses S. Grant * (" general admiral") ( ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  



MORE