Temporal and Object Quantification Networks
Authors
Authors
- Chuang Gan
- Leslie Kaelbling
- Joshua Tenenbaum
- Jiayuan Mao
- Jiajun Wu
- Tomer Ullman
- Zhezheng Luo
Authors
- Chuang Gan
- Leslie Kaelbling
- Joshua Tenenbaum
- Jiayuan Mao
- Jiajun Wu
- Tomer Ullman
- Zhezheng Luo
Published on
08/21/2021
Categories
We present Temporal and Object Quantification Networks (TOQ-Nets), a new class of neuro-symbolic networks with a structural bias that enables them to learn to recognize complex relational-temporal events. This is done by including reasoning layers that implement finite-domain quantification over objects and time. The structure allows them to generalize directly to input instances with varying numbers of objects in temporal sequences of varying lengths. We evaluate TOQ-Nets on input domains that require recognizing event-types in terms of complex temporal relational patterns. We demonstrate that TOQ-Nets can generalize from small amounts of data to scenarios containing more objects than were present during training and to temporal warpings of input sequences.