Learning Task Decomposition with Ordered Memory Policy Network
Authors
Authors
- Yuchen Lu
- Yikang Shen
- Siyuan Zhou
- Aaron Courville
- Joshua B. Tenenbaum
- Chuang Gan
Authors
- Yuchen Lu
- Yikang Shen
- Siyuan Zhou
- Aaron Courville
- Joshua B. Tenenbaum
- Chuang Gan
Published on
03/19/2021
Categories
Many complex real-world tasks are composed of several levels of sub-tasks. Humans leverage these hierarchical structures to accelerate the learning process and achieve better generalization. In this work, we study the inductive bias and propose Ordered Memory Policy Network (OMPN) to discover subtask hierarchy by learning from demonstration. The discovered subtask hierarchy could be used to perform task decomposition, recovering the subtask boundaries in an unstruc-tured demonstration. Experiments on Craft and Dial demonstrate that our modelcan achieve higher task decomposition performance under both unsupervised and weakly supervised settings, comparing with strong baselines. OMPN can also bedirectly applied to partially observable environments and still achieve higher task decomposition performance. Our visualization further confirms that the subtask hierarchy can emerge in our model.
Please cite our work using the BibTeX below.
@misc{lu2021learning,
title={Learning Task Decomposition with Ordered Memory Policy Network},
author={Yuchen Lu and Yikang Shen and Siyuan Zhou and Aaron Courville and Joshua B. Tenenbaum and Chuang Gan},
year={2021},
eprint={2103.10972},
archivePrefix={arXiv},
primaryClass={cs.LG}
}