Vision Language Action

VLA Drive Sim

Camera patches and a language instruction enter one transformer. The policy outputs steer, throttle, and brake on a forked road.

camerapatch 4/9

vision tokens

one transformerACT style chunk

actions drive the car

instructionconfidence 0.00
take the second exit

text tokens

v = 0.0 km/h steer +0.0° AUTO
W throttle · S brake · A/D steer · R reset