about
Deep Molecular Programming (arxiv.org)
130 points by groar on Apr 3, 2020 | hide | past | pdf | 11 comments on HN

In plain words: A neural network whose weights are only plus or minus one can be translated exactly into a set of chemical reactions whose answers do not change with reaction speed. The translated reactions correctly told apart iris flowers, handwritten digits, and virus types from gene activity.

Abstract · Deep Molecular Programming: A Natural Implementation of Binary-Weight ReLU Neural Networks

Embedding computation in molecular contexts incompatible with traditional electronics is expected to have wide ranging impact in synthetic biology, medicine, nanofabrication and other fields. A key remaining challenge lies in developing programming paradigms for molecular computation that are well-aligned with the underlying chemical hardware and do not attempt to shoehorn ill-fitting electronics paradigms. We discover a surprisingly tight connection between a popular class of neural networks (binary-weight ReLU aka BinaryConnect) and a class of coupled chemical reactions that are absolutely robust to reaction rates. The robustness of rate-independent chemical computation makes it a promising target for bioengineering implementation. We show how a BinaryConnect neural network trained in silico using well-founded deep learning optimization techniques, can be compiled to an equivalent chemical reaction network, providing a novel molecular programming paradigm. We illustrate such translation on the paradigmatic IRIS and MNIST datasets. Toward intended applications of chemical computation, we further use our method to generate a chemical reaction network that can discriminate between different virus types based on gene expression levels. Our work sets the stage for rich knowledge transfer between neural network and molecular programming communities.

Marko Vasic, Cameron Chalk, Sarfraz Khurshid, David Soloveichik
arXiv:2003.13720 · cs.NE, cs.ET, cs.LG · submitted Mar 30, 2020 · updated Jun 30, 2020
abstract · pdf · html

add comment on HN

A warning shot.

I'm bracing for what I think will be rapid acceleration in joint organic-machine experimentation going forward.

Over the next decade, I surmise it's likely we will see everything ranging from constructing and training large-scale organic/molecular deep neural networks with stochastic gradient descent (which is what these guys have done at a small scale) to integrating artificial networks with organic ones (which is what startups like Neuralink are doing) to who knows what else.

We live in interesting times.

This paper mentions CRN++, a compiler that translates an imperative language into Chemical Reaction Networks. I had no idea this field existed. This stuff is mind bogglingly cool!

https://arxiv.org/abs/1809.07430

I skimmed the paper but I still wonder how a (practical) memory would be implemented, and how many bits it could contain.

I think these computations all happen in a "soup", and this means that the memory can only exist as a superposition of concentrations, which I suppose has its limits.

Nucleic acids store bits pretty well.
Programmable matter. Now we are getting closer to the future we were promised.
Well, what do you think life is? It’s a product of chemical computation.
Until when do I have to wait for an Organic Raspberry Pi to play with?
How can a binary-valued network be differentiable?
The loss function needs to be differentiable. The paper uses square hinge loss which is differentiable.
Thanks, and for those who are wondering how squared hinge loss is differentiable, I found:

https://www.quora.com/Why-is-squared-hinge-loss-differentiab...

future virus and worms will be scary...