Difference: NGramBugs (1 vs. 20)

Revision 202012-03-08 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Changed:
<
<
  1. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  2. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
  3. random error message when symbol tables are missing
  4. empty or non-coaccess machines give odd errors / segfaults
  5. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
>
>
  1. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
 
Deleted:
<
<
  1. ngramcount usage says it takes *.fst but should be *.far; check other binaries for correct usage text!
  2. ngramrandcorpus does not use seed flag.

-- MichaelRiley - 04 Nov 2010

 
META TOPICMOVED by="MichaelRiley" date="1296788036" from="GRM.GrmBugs" to="GRM.NGramBugs"

Revision 192012-03-08 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 10 to 10
 
  1. ngramcount usage says it takes *.fst but should be *.far; check other binaries for correct usage text!
  2. ngramrandcorpus does not use seed flag.
Changed:
<
<
  1. Various binaries read FSTs as VectorFst rather than Fst or MutableFst - will fail if input does not match.
>
>
  -- MichaelRiley - 04 Nov 2010

Revision 182011-12-06 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 10 to 10
 
  1. ngramcount usage says it takes *.fst but should be *.far; check other binaries for correct usage text!
  2. ngramrandcorpus does not use seed flag.
Added:
>
>
  1. Various binaries read FSTs as VectorFst rather than Fst or MutableFst - will fail if input does not match.
  -- MichaelRiley - 04 Nov 2010

Revision 172011-12-06 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 8 to 8
 
  1. empty or non-coaccess machines give odd errors / segfaults
  2. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
Changed:
<
<
  1. ngramcount usage says it takes *.fst but should be *.far
>
>
  1. ngramcount usage says it takes *.fst but should be *.far; check other binaries for correct usage text!
  2. ngramrandcorpus does not use seed flag.
  -- MichaelRiley - 04 Nov 2010

Revision 162011-12-02 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 7 to 7
 
  1. random error message when symbol tables are missing
  2. empty or non-coaccess machines give odd errors / segfaults
  3. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
Added:
>
>
  1. ngramcount usage says it takes *.fst but should be *.far
 -- MichaelRiley - 04 Nov 2010

META TOPICMOVED by="MichaelRiley" date="1296788036" from="GRM.GrmBugs" to="GRM.NGramBugs"

Revision 152011-11-15 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Changed:
<
<
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol. (BER: fixed -- deals with leading and trailing spaces)
  2. (empty) -- causes wiki cross referencing to be wonky if omitted
  3. (empty)
  4. (empty)
  5. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  6. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  7. (empty)
  8. Checking for normalized model is perhaps too exact (allow small delta) (MDR: made --norm_eps a flag for relevant binaries)
  9. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
  10. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\? (fixed.)
  11. Editing Google file to fix 10. results in OK read and empty FST. (seems to be fixed.)
  12. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
  13. ngrammake fails with zero arguments (BER: fixed)
  14. random error message when symbol tables are missing
  15. empty or non-coaccess machines give odd errors / segfaults
  16. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
>
>
  1. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  2. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
  3. random error message when symbol tables are missing
  4. empty or non-coaccess machines give odd errors / segfaults
  5. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
 -- MichaelRiley - 04 Nov 2010

META TOPICMOVED by="MichaelRiley" date="1296788036" from="GRM.GrmBugs" to="GRM.NGramBugs"

Revision 142011-11-07 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 11 to 11
 
  1. (empty)
  2. Checking for normalized model is perhaps too exact (allow small delta) (MDR: made --norm_eps a flag for relevant binaries)
  3. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
Changed:
<
<
  1. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\?
  2. Editing Google file to fix 10. results in OK read and empty FST.
>
>
  1. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\? (fixed.)
  2. Editing Google file to fix 10. results in OK read and empty FST. (seems to be fixed.)
 
  1. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
  2. ngrammake fails with zero arguments (BER: fixed)
  3. random error message when symbol tables are missing

Revision 132011-11-06 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 14 to 14
 
  1. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\?
  2. Editing Google file to fix 10. results in OK read and empty FST.
  3. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
Changed:
<
<
  1. ngrammake fails with zero arguments
>
>
  1. ngrammake fails with zero arguments (BER: fixed)
 
  1. random error message when symbol tables are missing
  2. empty or non-coaccess machines give odd errors / segfaults
  3. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order

Revision 122011-11-04 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol. (BER: fixed -- deals with leading and trailing spaces)
Added:
>
>
  1. (empty) -- causes wiki cross referencing to be wonky if omitted
  2. (empty)
  3. (empty)
 
  1. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  2. Giving ngramprint --ARPA an FST with no symbol tables segfaults
Added:
>
>
  1. (empty)
 
  1. Checking for normalized model is perhaps too exact (allow small delta) (MDR: made --norm_eps a flag for relevant binaries)
  2. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
Changed:
<
<
  1. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\?
  2. Editing Google file to fix 10. results in OK read and empty FST.
  3. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
>
>
  1. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\?
  2. Editing Google file to fix 10. results in OK read and empty FST.
  3. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
 
  1. ngrammake fails with zero arguments 14. random error message when symbol tables are missing 15. empty or non-coaccess machines give odd errors / segfaults
Changed:
<
<
>
>
  1. ngramcount using -epsilon_as_backoff has problem finding state if counting order different from model order
 -- MichaelRiley - 04 Nov 2010

META TOPICMOVED by="MichaelRiley" date="1296788036" from="GRM.GrmBugs" to="GRM.NGramBugs"

Revision 112011-09-30 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 11 to 11
 
  1. Editing Google file to fix 10. results in OK read and empty FST.
  2. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
  3. ngrammake fails with zero arguments
Added:
>
>
14. random error message when symbol tables are missing 15. empty or non-coaccess machines give odd errors / segfaults
  -- MichaelRiley - 04 Nov 2010

Revision 102011-09-27 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 9 to 9
 
  1. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
  2. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\? 11 Editing Google file to fix 10. results in OK read and empty FST.
Added:
>
>
  1. Perplexity measure on war of worlds corpus gives warning about bad fST (but o.w. seems to work)
  2. ngrammake fails with zero arguments
  -- MichaelRiley - 04 Nov 2010

Revision 92011-03-08 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

Line: 6 to 6
 
  1. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  2. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  3. Checking for normalized model is perhaps too exact (allow small delta) (MDR: made --norm_eps a flag for relevant binaries)
Changed:
<
<
  1. ngramread doesn't complain about missing labels if --symbols is passed (e.g. in ARPA format but in symbols file)
>
>
  1. ngramread doesn't complain about missing labels if --symbols is passed (e.g. <s> in ARPA format but <S> in symbols file)
  2. ngramread fails if first line isn't blank. Can't read Google ARPA files. OK if first line is \data\? 11 Editing Google file to fix 10. results in OK read and empty FST.
  -- MichaelRiley - 04 Nov 2010

Revision 82011-02-26 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol. (BER: fixed -- deals with leading and trailing spaces)
Deleted:
<
<
  1. Several commands seg fault if given missing files (BER: fixed to be similar to openfst in this regard)
  2. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given (BER: fixed, and will also update quick tour)
  3. the ngramapply example says there are 2 sentences but there is only one (BER: fixed)
 
  1. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  2. Giving ngramprint --ARPA an FST with no symbol tables segfaults
Changed:
<
<
  1. Shrinking does not terminate (after 10 hours) on a 1 gb input
  2. Checking for normalized model is perhaps too exact (allow small delta)
>
>
  1. Checking for normalized model is perhaps too exact (allow small delta) (MDR: made --norm_eps a flag for relevant binaries)
  2. ngramread doesn't complain about missing labels if --symbols is passed (e.g. in ARPA format but in symbols file)
  -- MichaelRiley - 04 Nov 2010

Revision 72011-02-04 - MichaelRiley

Line: 1 to 1
Changed:
<
<
META TOPICPARENT name="WebHome"

Known Bugs

>
>
META TOPICPARENT name="NGramLibrary"

OpenGrm NGram Library Known Bugs

 
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol. (BER: fixed -- deals with leading and trailing spaces)
  2. Several commands seg fault if given missing files (BER: fixed to be similar to openfst in this regard)
Line: 12 to 12
 
  1. Checking for normalized model is perhaps too exact (allow small delta)

-- MichaelRiley - 04 Nov 2010 \ No newline at end of file

Added:
>
>
META TOPICMOVED by="MichaelRiley" date="1296788036" from="GRM.GrmBugs" to="GRM.NGramBugs"

Revision 62011-01-31 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Known Bugs

Line: 9 to 9
 
  1. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  2. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  3. Shrinking does not terminate (after 10 hours) on a 1 gb input
Added:
>
>
  1. Checking for normalized model is perhaps too exact (allow small delta)
  -- MichaelRiley - 04 Nov 2010 \ No newline at end of file

Revision 52011-01-29 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Known Bugs

Line: 7 to 7
 
  1. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given (BER: fixed, and will also update quick tour)
  2. the ngramapply example says there are 2 sentences but there is only one (BER: fixed)
  3. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
Added:
>
>
  1. Giving ngramprint --ARPA an FST with no symbol tables segfaults
  2. Shrinking does not terminate (after 10 hours) on a 1 gb input
  -- MichaelRiley - 04 Nov 2010 \ No newline at end of file

Revision 42010-12-08 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Known Bugs

Line: 6 to 6
 
  1. Several commands seg fault if given missing files (BER: fixed to be similar to openfst in this regard)
  2. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given (BER: fixed, and will also update quick tour)
  3. the ngramapply example says there are 2 sentences but there is only one (BER: fixed)
Added:
>
>
  1. Giving ngramread a blank line causes models built with missing symbol (at least in the version I'm using).
  -- MichaelRiley - 04 Nov 2010 \ No newline at end of file

Revision 32010-11-11 - BrianRoark

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Known Bugs

Changed:
<
<
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol.
  2. Several commands seg fault if given missing files
  3. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given
  4. the ngramapply example says there are 2 sentences but there is only one
>
>
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol. (BER: fixed -- deals with leading and trailing spaces)
  2. Several commands seg fault if given missing files (BER: fixed to be similar to openfst in this regard)
  3. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given (BER: fixed, and will also update quick tour)
  4. the ngramapply example says there are 2 sentences but there is only one (BER: fixed)
  -- MichaelRiley - 04 Nov 2010

Revision 22010-11-05 - MichaelRiley

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Changed:
<
<
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol:

>
>

Known Bugs

 
Added:
>
>
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol.
  2. Several commands seg fault if given missing files
  3. the ngramapply example in the quick tour segfaults if --keep_isymbols is not given
  4. the ngramapply example says there are 2 sentences but there is only one
  -- MichaelRiley - 04 Nov 2010

Revision 12010-11-04 - MichaelRiley

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"
  1. Giving ngramread a text file where lines are terminiated with space causes models built with this to have a missing symbol:

-- MichaelRiley - 04 Nov 2010

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback