Pynini: Finite-state grammar development in Python

Version 2.1.6.post1 is now available for download.

Pynini is now available on conda-forge. Users users who already have Conda can install Pynini and all dependencies using the following command: conda install -c conda-forge pynini

Pynini can now be used from a Colab notebook; see here for an example.

OpenGrm Pynini, like Thrax, compiles grammars expressed as strings, regular expressions, and context-dependent rewrite rules into weighted finite-state transducers. It uses the OpenFst library and its Python extension to create, access and manipulate compiled grammars. Pynini is embedded in a Python module, allowing users to write Thrax-like grammars using Python's flexible syntax (including imperative programming constructs not available in Thrax) and powerful toolchain.

It is (loosely) named after Pāṇini (पाणिनि), the renowned Sanskrit grammarian.

• Download
• Documentation
• C++ API documentation (for advanced users):
  • Optimization
  • Path iteration
  • Specialty operators
  • String (de)compilation

If you use this library in your research, we would appreciate it if you cited one of:

• K. Gorman. 2016. Pynini: A Python library for weighted finite-state grammar compilation. In Proceedings of the ACL Workshop on Statistical NLP and Weighted Automata, pages 75-80.
• K. Gorman & R. Sproat. 2021. Finite-State Text Processing . Morgan & Claypool. (Now published by Springer.)

Third-party information about the library:

• Installing Pynini on Windows 10