Matt MacMahon:
Understanding and Following Route Instructions
Through Large-Scale Space
Abstract
Understanding and following verbal instructions is a crucial human ability,
allowing quick transfer of knowledge about acting in the world. This paper
presents how the MARCO architecture models the spatial language of route
instructions and evaluates the language in the environmental context to guide
navigation to a distant destination in an unfamiliar world, past the perceptual
horizon. The performance is evaluated against a corpus of natural language
route instructions and compared against people performing the same task.
When the follower can interact with a director, the follower can plan dialog
moves that increase its understanding and likelihood of reaching the destination.
|
