TWiki
>
GRM Web
>
Pynini
(2024-03-08,
KyleGorman
)
(raw view)
E
dit
A
ttach
---+ Pynini: Finite-state grammar development in Python --- %ICON{led-red}% *Version 2.1.6 is now available for [[PyniniDownload][download]].* %ICON{radioactive}% Pynini is now available on [[https://conda-forge.org/][conda-forge]]. Users users who already have [[https://docs.conda.io/en/latest/][Conda]] can install Pynini and all dependencies using the following command: =conda install -c conda-forge pynini= %ICON{first-class}% Pynini can now be used from a [[https://colab.research.google.com/][Colab]] notebook, as shown [[https://colab.research.google.com/drive/1ia46Nskg1iUmpPoPAH9XHOrBbL7jX2X2?usp=sharing][here]]. Add the following to the top of your notebook: =!pip install --only-binary :all: pynini= %ICON{strategy}% When using Pynini from a [[https://colab.research.google.com/][Colab]] notebook, logging and error messages sent to standard error are lost. To recover them, install [[https://pypi.org/project/wurlitzer/][ =wurlitzer= ]] (e.g., =!pip install wurlitzer=) and then add the following at the top of your notebook: =%load_ext wurlitzer= --- _OpenGrm_ _Pynini_, like [[Thrax]], compiles grammars expressed as strings, regular expressions, and context-dependent rewrite rules into weighted finite-state transducers. It uses the [[http://www.openfst.org][OpenFst library]] and its [[http://www.python.openfst.org][Python extension]] to create, access and manipulate compiled grammars. Pynini is embedded in a [[https://www.python.org][Python]] module, allowing users to write Thrax-like grammars using Python's flexible syntax (including imperative programming constructs not available in Thrax) and powerful toolchain. It is (loosely) named after [[https://en.wikipedia.org/wiki/PÄ\x81á¹ini][Pāṇini]] (पाणिनि), the renowned Sanskrit grammarian. * [[PyniniDownload][Download]] * [[PyniniDocs][Documentation]] * C++ API documentation (for advanced users): * [[PyniniOptimizeDoc][Optimization]] * [[PyniniPathsDoc][Path iteration]] * [[PyniniOperatorsDoc][Specialty operators]] * [[PyniniStringDoc][String (de)compilation]] If you use this library in your research, we would appreciate it if you cited one of: * K. Gorman. 2016. [[https://www.aclweb.org/anthology/W16-2409][Pynini: A Python library for weighted finite-state grammar compilation]]. In _Proceedings of the ACL Workshop on Statistical NLP and Weighted Automata_, pages 75-80. * K. Gorman & R. Sproat. 2021. [[http://www.morganclaypoolpublishers.com/catalog_Orig/product_info.php?products_id=1636][ _Finite-State Text Processing_ ]]. Morgan & Claypool. Third-party information about the library: * [[https://stackoverflow.com/questions/57898360/how-can-i-install-and-use-pynini-on-windows-10][Installing Pynini on Windows 10]]
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r80
<
r79
<
r78
<
r77
<
r76
|
B
acklinks
|
V
iew topic
|
WYSIWYG
|
M
ore topic actions
Topic revision: r80 - 2024-03-08
-
KyleGorman
GRM
Log In
or
Register
GRM Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Webs
Contrib
FST
Forum
GRM
Kernel
Main
Sandbox
TWiki
Main
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback