ML Newsnew | past | best | rss | submit about
Neurosymbolic Programming for Science (arxiv.org)
78 points by insider_7 on Nov 9, 2022 | hide | past | pdf | 6 comments on HN

In plain words: These systems mix pattern-learning neural parts with explicit rules and concepts, so scientists can feed in prior knowledge and get outputs they can read and check. A review of real behavior-analysis examples maps where this fits scientific workflows and what still blocks wider use.

Abstract

Neurosymbolic Programming (NP) techniques have the potential to accelerate scientific discovery. These models combine neural and symbolic components to learn complex patterns and representations from data, using high-level concepts or known constraints. NP techniques can interface with symbolic domain knowledge from scientists, such as prior knowledge and experimental context, to produce interpretable outputs. We identify opportunities and challenges between current NP models and scientific workflows, with real-world examples from behavior analysis in science: to enable the use of NP broadly for workflows across the natural and social sciences.

Jennifer J. Sun, Megan Tjandrasuwita, Atharva Sehgal, Armando Solar-Lezama, Swarat Chaudhuri, Yisong Yue, Omar Costilla-Reyes
arXiv:2210.05050 · cs.AI · submitted Oct 10, 2022 · updated Nov 7, 2022
abstract · pdf · html · Neural Information Processing Systems 2022 - AI for science workshop

add comment on HN

insider_7 on Nov 9, 2022 [–]
Neurosymbolic Programming (NP) techniques have the potential to accelerate scientific discovery. These models combine neural and symbolic components to learn complex patterns and representations from data, using high-level concepts or known constraints. NP techniques can interface with symbolic domain knowledge from scientists, such as prior knowledge and experimental context, to produce interpretable outputs. We identify opportunities and challenges between current NP models and scientific workflows, with real-world examples from behavior analysis in science: to enable the use of NP broadly for workflows across the natural and social sciences.
reply
aseg on Nov 9, 2022 [–]
Hello! I'm one of the authors on this. Feel free to ask me any questions. Happy to clear up any confusion about what we're talking about as well!

Here's a survey paper describing the algorithms used under the hood: https://www.cs.utexas.edu/~swarat/pubs/PGL-049-Plain.pdf

reply
ubj on Nov 9, 2022 [–]
Related site with overview of broad research vision and additional papers:

http://www.neurosymbolic.org/index.html

reply
Kalanos on Nov 9, 2022 [–]
Is this a branch of "scientific machine learning" ?
reply
melony on Nov 9, 2022 | parent [–]
It's a combination of GOFAI (fancy tree search) and ML (neural networks and differentiable programming)

The idea isn't particularly new but it wasn't possible to implement anything useful until recently when attention/transformers and LLMs gave a huge boost to NLP and most ML tasks.

reply
aseg on Nov 9, 2022 | parent [–]
The algorithms are generally in the area of machine learning + programming languages and pretty flexible. This paper talks about how we "bias" these algorithms for applications in the hard sciences (specifically talking about behavioral neuroscience but has/is being applied in other areas as well).
reply
About | RSS | RSS (all) | HN arXiv