Metatheory.jl

The 3.0 version is in-development and close to release!

If you want to use Metatheory.jl, please use the ale/3.0 branch.

It’s a lot more stable, and up to ~200x faster than 2.0

Metatheory.jl is a general purpose term rewriting, metaprogramming and algebraic computation library for the Julia programming language, designed to take advantage of the powerful reflection capabilities to bridge the gap between symbolic mathematics, abstract interpretation, equational reasoning, optimization, composable compiler transforms, and advanced
homoiconic pattern matching features. The core features of Metatheory.jl are a powerful rewrite rule definition language, a vast library of functional combinators for classical term rewriting and an e-graph rewriting, a fresh approach to term rewriting achieved through an equality saturation algorithm. Metatheory.jl can manipulate any kind of
Julia symbolic expression type, as long as it satisfies the TermInterface.jl.

Metatheory.jl provides:

• An eDSL (domain specific language) to define different kinds of symbolic rewrite rules.
• A classical rewriting backend, derived from the SymbolicUtils.jl pattern matcher, supporting associative-commutative rules. It is based on the pattern matcher in the SICM book.
• A flexible library of rewriter combinators.
• An e-graph rewriting (equality saturation) backend and pattern matcher, based on the egg library, supporting backtracking and non-deterministic term rewriting by using a data structure called e-graph, efficiently incorporating the notion of equivalence in order to reduce the amount of user effort required to achieve optimization tasks and equational reasoning.
• @capture macro for flexible metaprogramming.

Intuitively, Metatheory.jl transforms Julia expressions
in other Julia expressions and can achieve such at both compile and run time. This allows Metatheory.jl users to perform customized and composable compiler optimizations specifically tailored to single, arbitrary Julia packages.
Our library provides a simple, algebraically composable interface to help scientists in implementing and reasoning about semantics and all kinds of formal systems, by defining concise rewriting rules in pure, syntactically valid Julia on a high level of abstraction. Our implementation of equality saturation on e-graphs is based on the excellent, state-of-the-art technique implemented in the egg library, reimplemented in pure Julia.

2.0 is out!

Second stable version is out:

• New e-graph pattern matching system, relies on functional programming and closures, and is much more extensible than 1.0’s virtual machine.
• No longer dispatch against types, but instead dispatch against objects.
• Faster E-Graph Analysis
• Better library macros
• Updated TermInterface to 0.3.3
• New interface for e-graph extraction using EGraphs.egraph_reconstruct_expression
• Simplify E-Graph Analysis Interface. Use Symbols or functions for identifying Analyses.
• Remove duplicates in E-Graph analyses data.

Many features have been ported from SymbolicUtils.jl. Metatheory.jl can be used in place of SymbolicUtils.jl when you have no need of manipulating mathematical expressions. The introduction of TermInterface.jl has allowed for large potential in generalization of term rewriting and symbolic analysis and manipulation features. Integration between Metatheory.jl with Symbolics.jl, as it has been shown in the “High-performance symbolic-numerics via multiple dispatch” paper.

Recommended Readings - Selected Publications

• The Metatheory.jl manual
• OUT OF DATE: The Metatheory.jl introductory paper gives a brief high level overview on the library and its functionalities.
• The Julia Manual metaprogramming section is fundamental to understand what homoiconic expression manipulation is and how it happens in Julia.
• An introductory blog post on SIGPLAN about egg and e-graphs rewriting.
• egg: Fast and Extensible Equality Saturation contains the definition of E-Graphs on which Metatheory.jl’s equality saturation rewriting backend is based. This is a strongly recommended reading.
• High-performance symbolic-numerics via multiple dispatch: a paper about how we used Metatheory.jl to optimize code generation in Symbolics.jl
• Automated Code Optimization with E-Graphs. Alessandro Cheli’s Thesis on Metatheory.jl

Contributing

If you’d like to give us a hand and contribute to this repository you can:

• Find a high level description of the project architecture in ARCHITECTURE.md
• Read the contribution guidelines in CONTRIBUTING.md

Installation

You can install the stable version:

julia> using Pkg; Pkg.add("Metatheory")

Or you can install the developer version (recommended by now for latest bugfixes)

julia> using Pkg; Pkg.add(url="https://github.com/JuliaSymbolics/Metatheory.jl")

Documentation

Extensive Metatheory.jl is available here

Citing

If you use Metatheory.jl in your research, please cite our works.

Sponsors

If you enjoyed Metatheory.jl and would like to help, you can donate a coffee or choose place your logo and name in this page. See 0x0f0f0f’s Github Sponsors page!