### Abstract

In this paper we explore how machine learning techniques can be applied to the discovery of efficient mathematical identities. We introduce an attribute grammar framework for representing symbolic expressions. Given a grammar of math operators, we build trees that combine them in different ways, looking for compositions that are analytically equivalent to a target expression but of lower computational complexity. However, as the space of trees grows exponentially with the complexity of the target expression, brute force search is impractical for all but the simplest of expressions. Consequently, we introduce two novel learning approaches that are able to learn from simpler expressions to guide the tree search. The first of these is a simple n-gram model, the other being a recursive neural-network. We show how these approaches enable us to derive complex identities, beyond reach of brute-force search, or human derivation.

Original language | English (US) |
---|---|

Title of host publication | Advances in Neural Information Processing Systems |

Publisher | Neural information processing systems foundation |

Pages | 1278-1286 |

Number of pages | 9 |

Volume | 2 |

Edition | January |

State | Published - 2014 |

Event | 28th Annual Conference on Neural Information Processing Systems 2014, NIPS 2014 - Montreal, Canada Duration: Dec 8 2014 → Dec 13 2014 |

### Other

Other | 28th Annual Conference on Neural Information Processing Systems 2014, NIPS 2014 |
---|---|

Country | Canada |

City | Montreal |

Period | 12/8/14 → 12/13/14 |

### Fingerprint

### ASJC Scopus subject areas

- Computer Networks and Communications
- Information Systems
- Signal Processing

### Cite this

*Advances in Neural Information Processing Systems*(January ed., Vol. 2, pp. 1278-1286). Neural information processing systems foundation.

**Learning to discover efficient mathematical identities.** / Zaremba, Wojciech; Kurach, Karol; Fergus, Rob.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

*Advances in Neural Information Processing Systems.*January edn, vol. 2, Neural information processing systems foundation, pp. 1278-1286, 28th Annual Conference on Neural Information Processing Systems 2014, NIPS 2014, Montreal, Canada, 12/8/14.

}

TY - GEN

T1 - Learning to discover efficient mathematical identities

AU - Zaremba, Wojciech

AU - Kurach, Karol

AU - Fergus, Rob

PY - 2014

Y1 - 2014

N2 - In this paper we explore how machine learning techniques can be applied to the discovery of efficient mathematical identities. We introduce an attribute grammar framework for representing symbolic expressions. Given a grammar of math operators, we build trees that combine them in different ways, looking for compositions that are analytically equivalent to a target expression but of lower computational complexity. However, as the space of trees grows exponentially with the complexity of the target expression, brute force search is impractical for all but the simplest of expressions. Consequently, we introduce two novel learning approaches that are able to learn from simpler expressions to guide the tree search. The first of these is a simple n-gram model, the other being a recursive neural-network. We show how these approaches enable us to derive complex identities, beyond reach of brute-force search, or human derivation.

AB - In this paper we explore how machine learning techniques can be applied to the discovery of efficient mathematical identities. We introduce an attribute grammar framework for representing symbolic expressions. Given a grammar of math operators, we build trees that combine them in different ways, looking for compositions that are analytically equivalent to a target expression but of lower computational complexity. However, as the space of trees grows exponentially with the complexity of the target expression, brute force search is impractical for all but the simplest of expressions. Consequently, we introduce two novel learning approaches that are able to learn from simpler expressions to guide the tree search. The first of these is a simple n-gram model, the other being a recursive neural-network. We show how these approaches enable us to derive complex identities, beyond reach of brute-force search, or human derivation.

UR - http://www.scopus.com/inward/record.url?scp=84937961368&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937961368&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84937961368

VL - 2

SP - 1278

EP - 1286

BT - Advances in Neural Information Processing Systems

PB - Neural information processing systems foundation

ER -