In plain words: Scallop is a language that mixes neural networks with logic rules, automatically turning the rules into trainable steps so the whole system learns from data. Across eight tasks it matched or beat top models in accuracy while running faster and needing less training data.
Abstract
We present Scallop, a language which combines the benefits of deep learning and logical reasoning. Scallop enables users to write a wide range of neurosymbolic applications and train them in a data- and compute-efficient manner. It achieves these goals through three key features: 1) a flexible symbolic representation that is based on the relational data model; 2) a declarative logic programming language that is based on Datalog and supports recursion, aggregation, and negation; and 3) a framework for automatic and efficient differentiable reasoning that is based on the theory of provenance semirings. We evaluate Scallop on a suite of eight neurosymbolic applications from the literature. Our evaluation demonstrates that Scallop is capable of expressing algorithmic reasoning in diverse and challenging AI tasks, provides a succinct interface for machine learning programmers to integrate logical domain knowledge, and yields solutions that are comparable or superior to state-of-the-art models in terms of accuracy. Furthermore, Scallop's solutions outperform these models in aspects such as runtime and data efficiency, interpretability, and generalizability.
Ziyang Li, Jiani Huang, Mayur Naik
arXiv:2304.04812 · cs.PL, cs.AI, cs.LG · submitted Apr 10, 2023
abstract · pdf · html