In:
at - Automatisierungstechnik, Walter de Gruyter GmbH, Vol. 70, No. 3 ( 2022-03-28), p. 257-266
Abstract:
In previous works we discovered that rule-based systems severely suffer in performance when increasing the number of rules. In order to increase the amount of possible boolean relations while keeping the number of rules fixed, we employ ideas from well known Spatial Transformer Systems and Self-Attention Networks: here, our learned rules are not static but are dynamically adjusted to fit the input data by training a separate rule-prediction system, which is predicting parameter matrices used in Neural Logic Rule Layers. We show, that these networks, termed Adaptive Neural Logic Rule Layers, outperform their static counterpart both in terms of final performance, as well as training stability and excitability during early stages of training.
Type of Medium:
Online Resource
ISSN:
2196-677X
,
0178-2312
DOI:
10.1515/auto-2021-0136
Language:
English
Publisher:
Walter de Gruyter GmbH
Publication Date:
2022
detail.hit.zdb_id:
629186-7
detail.hit.zdb_id:
2027287-X
SSG:
15,3
Permalink
