kr.angelov
cab4602b62
the viterbi probability for the epsilon categories is now updated properly
2012-05-25 07:30:35 +00:00
kr.angelov
ec00a42ee6
fixed an alignment bug in libgu which leads to crash on some platforms
2012-05-25 07:29:29 +00:00
kr.angelov
bd102d54d9
fixed memory leak in the pgf-translate tool
2012-05-25 07:28:18 +00:00
kr.angelov
fdcd0de336
added pgf-service.c in the robust parser'
2012-05-25 07:27:29 +00:00
kr.angelov
bd8046f23d
another attempt to port the robust parser to MacOS
2012-05-16 15:18:44 +00:00
kr.angelov
e342e5e7d6
small fix for compiling the robust parser on MacOS
2012-05-16 12:18:50 +00:00
kr.angelov
4aca965109
a new unbiased statistical parser. it is still far from perfect use it on your own risk.
2012-05-08 12:13:28 +00:00
kr.angelov
ed6a53609b
yet another fix for parsing literals
2012-04-18 15:50:55 +00:00
kr.angelov
c6c54f8815
some fixes in the robust parser and a new API for literals
2012-04-12 06:55:25 +00:00
kr.angelov
99cc07ad67
simple cleanup in the robust parser
2012-04-02 19:01:18 +00:00
Sergei Trofimovich
4404be284d
Fix List.foldl / Map.foldl ambiguosity
...
Fixes the following error:
src/runtime/haskell/PGF/Expr.hs:111:14:
Ambiguous occurrence `foldl'
It could refer to either `List.foldl',
imported from `Data.List' at src/runtime/haskell/PGF/Expr.hs:27:1-24
(and originally defined in `GHC.List')
or `Map.foldl',
imported from `Data.Map' at src/runtime/haskell/PGF/Expr.hs:28:1-40
2012-03-26 20:18:23 +00:00
hallgren
c234e58a6a
PGF run-time library: function names in BracketedString (experimental)
...
+ Make room for function names in the BracketedString data structure.
+ Fill in function names when linearizing an abstract syntax tree to a
BracketedString.
+ Fill in wildCId when it is not obvious what the function is.
+ Function bracketedLinearize: for compatibility with the other linearization
functions, return Leaf "" instead of error "cannot linearize".
+ Export flattenBracketedString from module PGF.
+ PGFServce: make function names available in the JSON representation of
BracketedString.
2012-03-18 20:12:26 +00:00
kr.angelov
2bf3f22fac
libpgf: a new implementation for literals which also allows custom literals. the same mechanism is now used for the metavariables
2012-03-12 14:25:51 +00:00
kr.angelov
c1b2246fa9
libpgf: added simple lexer
2012-03-09 09:14:44 +00:00
kr.angelov
1da464a4cc
libpgf: implementation for built in literal categories
2012-03-07 16:39:29 +00:00
kr.angelov
bf81c0f77f
libpgf: simple fix in the parser debugger
2012-03-07 12:23:07 +00:00
kr.angelov
e871330665
libpgf: two APIs - one for finding all parse results and another for finding the best parse result
2012-03-07 11:00:17 +00:00
kr.angelov
791a1a17b0
libpgf: now all concrete functions and categories are explicitly linked to their abstract counter parts
2012-03-05 12:59:31 +00:00
kr.angelov
fdf6dd7798
libpgf: preliminary version for the statistical ranking. we use naive statistical model with random weight for the meta variables.
2012-03-02 19:25:01 +00:00
kr.angelov
79c7141973
libpgf: simple optimization in the implementation for heaps
2012-03-02 17:43:46 +00:00
kr.angelov
862e89db8d
libpgf: an API for building heaps from buffers in gu/seq.c
2012-02-29 18:51:21 +00:00
kr.angelov
aca0bd5ee5
libpgf: the first prototype for the robust parser
2012-02-29 14:43:08 +00:00
kr.angelov
65a69cab91
libpgf: the choice object should remember integers instead of single bytes
2012-02-29 13:41:59 +00:00
kr.angelov
e0bf3c0a07
libpgf: another fix in the parser debugger
2012-02-28 16:37:12 +00:00
kr.angelov
9536cecae8
libpgf: the time measurement in pgf-translate should be made after pgf_parse_result for more accurate timing
2012-02-28 13:14:24 +00:00
kr.angelov
3aa26948de
libpgf: fix in the parser debugger
2012-02-28 13:12:38 +00:00
kr.angelov
9604f3623a
libpgf: pretty printing for expressions with metavaraibles
2012-02-27 13:50:35 +00:00
kr.angelov
695c776065
libpgf: fix in pgf_read_into_map
2012-02-24 15:15:07 +00:00
kr.angelov
0faffc6ffd
libpgf: simple fix in the grammar printer and the reader
2012-02-24 13:52:21 +00:00
kr.angelov
f1d2852c4d
libpgf: now we have both complete bottom up index for robust parsing and fast lexical lookup from the same index
2012-02-22 21:27:54 +00:00
kr.angelov
440b208144
libpgf: two small fixes in the parser debugger
2012-02-22 14:06:49 +00:00
kr.angelov
831de53573
libpgf: the map curr_lindefs must be allocated from a temporary pool
2012-02-22 08:49:08 +00:00
kr.angelov
dc4c3d3b28
libpgf: added index for fast lexicon lookup. Still not perfect
2012-02-21 21:17:50 +00:00
kr.angelov
eff8e1134a
utils/pgf-translate now reports the parsing time
2012-02-21 20:17:18 +00:00
kr.angelov
30d3fc8b4d
libpgf: now the debugging mode for the parser is available only with compilation option.
2012-02-18 19:30:16 +00:00
kr.angelov
0f7b3ed9f4
libpgf: remove the now redundant field extra_ccats in PgfConcr
2012-02-18 16:25:53 +00:00
kr.angelov
0147885e2f
libpgf: now the linearization index is created during the grammar loading which also makes the types PgfLzr and PgfParser redundant.
2012-02-18 16:22:40 +00:00
kr.angelov
75b724ab54
libpgf: simplify the loading of PgfCncCat
2012-02-17 14:26:08 +00:00
kr.angelov
1bb13787a7
libpgf: added printer.c
2012-02-17 14:11:29 +00:00
kr.angelov
92cbbe9173
libpgf: switch to using callbacks and lazy prediction in the parser. this reduce the parsing time from 11 sec down to 3 sec.
2012-01-26 12:32:26 +00:00
kr.angelov
0e05fc08d5
libpgf: use a temporal pool for allocating the arrays in the continuation map of the parser
2012-01-26 09:03:08 +00:00
kr.angelov
469d8cf804
libpgf: fix a warning in reader.c
2012-01-26 08:58:23 +00:00
kr.angelov
51def0c381
libpgf: fix in string.h
2012-01-26 08:58:03 +00:00
kr.angelov
b62d57fd30
libpgf: few fixes to make the loading of grammars with def rules possible
2012-01-24 14:47:11 +00:00
kr.angelov
5b96b55184
libpgf: extra_ccat is now redundant and was removed
2012-01-23 19:47:08 +00:00
kr.angelov
81191787fe
libpgf: forgot to add utils/pgf-print.c
2012-01-23 16:34:02 +00:00
kr.angelov
d8cfb13715
pgf-translate: add \n at the end of two error messages
2012-01-23 15:51:37 +00:00
kr.angelov
21dee01c9d
libpgf: debugging framework for the parser
2012-01-23 15:49:29 +00:00
kr.angelov
f2cfa9888e
libpgf: the concrete categories were allocated from the temporary pool
2012-01-23 13:43:17 +00:00
kr.angelov
e9014902ef
libpgf: printing of literals and flags
2012-01-23 10:17:20 +00:00