1
0
forked from GitHub/gf-core
Commit Graph

256 Commits

Author SHA1 Message Date
kr.angelov
c9c5675e1d now there is a limit of 2000000 items in the chart of the robust parser. This prevents from explosion in the memory size but it will also prevent us from parsing some sentences. 2012-06-12 11:30:01 +00:00
kr.angelov
b27a440ef3 now the robust parser is purely top-down and the meta rules compete on a fair basis with the grammar rules 2012-06-12 09:29:51 +00:00
kr.angelov
06f9965d27 the viterbi probability for the epsilon categories is now updated properly 2012-05-25 07:30:35 +00:00
kr.angelov
ea5fe32d89 fixed an alignment bug in libgu which leads to crash on some platforms 2012-05-25 07:29:29 +00:00
kr.angelov
92488a6592 fixed memory leak in the pgf-translate tool 2012-05-25 07:28:18 +00:00
kr.angelov
5312ef23c6 added pgf-service.c in the robust parser' 2012-05-25 07:27:29 +00:00
kr.angelov
f4c17cb7aa another attempt to port the robust parser to MacOS 2012-05-16 15:18:44 +00:00
kr.angelov
d2e528c7f4 small fix for compiling the robust parser on MacOS 2012-05-16 12:18:50 +00:00
kr.angelov
a6800fc0da a new unbiased statistical parser. it is still far from perfect use it on your own risk. 2012-05-08 12:13:28 +00:00
kr.angelov
931066f6fc yet another fix for parsing literals 2012-04-18 15:50:55 +00:00
kr.angelov
17bc8e5c89 some fixes in the robust parser and a new API for literals 2012-04-12 06:55:25 +00:00
kr.angelov
6644d93ec2 simple cleanup in the robust parser 2012-04-02 19:01:18 +00:00
kr.angelov
230f309317 libpgf: a new implementation for literals which also allows custom literals. the same mechanism is now used for the metavariables 2012-03-12 14:25:51 +00:00
kr.angelov
1726995921 libpgf: added simple lexer 2012-03-09 09:14:44 +00:00
kr.angelov
ed5de8335b libpgf: implementation for built in literal categories 2012-03-07 16:39:29 +00:00
kr.angelov
96493c274b libpgf: simple fix in the parser debugger 2012-03-07 12:23:07 +00:00
kr.angelov
a96da30489 libpgf: two APIs - one for finding all parse results and another for finding the best parse result 2012-03-07 11:00:17 +00:00
kr.angelov
0e90d1ba1f libpgf: now all concrete functions and categories are explicitly linked to their abstract counter parts 2012-03-05 12:59:31 +00:00
kr.angelov
4d1b0859d0 libpgf: preliminary version for the statistical ranking. we use naive statistical model with random weight for the meta variables. 2012-03-02 19:25:01 +00:00
kr.angelov
58b6bbd242 libpgf: simple optimization in the implementation for heaps 2012-03-02 17:43:46 +00:00
kr.angelov
2775faad7a libpgf: an API for building heaps from buffers in gu/seq.c 2012-02-29 18:51:21 +00:00
kr.angelov
e31c883075 libpgf: the first prototype for the robust parser 2012-02-29 14:43:08 +00:00
kr.angelov
b054549082 libpgf: the choice object should remember integers instead of single bytes 2012-02-29 13:41:59 +00:00
kr.angelov
5fa1418194 libpgf: another fix in the parser debugger 2012-02-28 16:37:12 +00:00
kr.angelov
4ddf24429b libpgf: the time measurement in pgf-translate should be made after pgf_parse_result for more accurate timing 2012-02-28 13:14:24 +00:00
kr.angelov
dcbeb63849 libpgf: fix in the parser debugger 2012-02-28 13:12:38 +00:00
kr.angelov
686fcca9a4 libpgf: pretty printing for expressions with metavaraibles 2012-02-27 13:50:35 +00:00
kr.angelov
667ca8e5f7 libpgf: fix in pgf_read_into_map 2012-02-24 15:15:07 +00:00
kr.angelov
1d239ab567 libpgf: simple fix in the grammar printer and the reader 2012-02-24 13:52:21 +00:00
kr.angelov
b99fa6aa9a libpgf: now we have both complete bottom up index for robust parsing and fast lexical lookup from the same index 2012-02-22 21:27:54 +00:00
kr.angelov
42410f80d2 libpgf: two small fixes in the parser debugger 2012-02-22 14:06:49 +00:00
kr.angelov
786bf883b7 libpgf: the map curr_lindefs must be allocated from a temporary pool 2012-02-22 08:49:08 +00:00
kr.angelov
7ddd0d5f3e libpgf: added index for fast lexicon lookup. Still not perfect 2012-02-21 21:17:50 +00:00
kr.angelov
a178608f37 utils/pgf-translate now reports the parsing time 2012-02-21 20:17:18 +00:00
kr.angelov
a55a224dce libpgf: now the debugging mode for the parser is available only with compilation option. 2012-02-18 19:30:16 +00:00
kr.angelov
5259be92e3 libpgf: remove the now redundant field extra_ccats in PgfConcr 2012-02-18 16:25:53 +00:00
kr.angelov
47e5e8c966 libpgf: now the linearization index is created during the grammar loading which also makes the types PgfLzr and PgfParser redundant. 2012-02-18 16:22:40 +00:00
kr.angelov
aed7cc429a libpgf: simplify the loading of PgfCncCat 2012-02-17 14:26:08 +00:00
kr.angelov
4f8ad8c23f libpgf: added printer.c 2012-02-17 14:11:29 +00:00
kr.angelov
6f0795d8a3 libpgf: switch to using callbacks and lazy prediction in the parser. this reduce the parsing time from 11 sec down to 3 sec. 2012-01-26 12:32:26 +00:00
kr.angelov
a2414bc625 libpgf: use a temporal pool for allocating the arrays in the continuation map of the parser 2012-01-26 09:03:08 +00:00
kr.angelov
8256750599 libpgf: fix a warning in reader.c 2012-01-26 08:58:23 +00:00
kr.angelov
ecb5e9f23a libpgf: fix in string.h 2012-01-26 08:58:03 +00:00
kr.angelov
58de345f99 libpgf: few fixes to make the loading of grammars with def rules possible 2012-01-24 14:47:11 +00:00
kr.angelov
acc4f352af libpgf: extra_ccat is now redundant and was removed 2012-01-23 19:47:08 +00:00
kr.angelov
4f289698f0 libpgf: forgot to add utils/pgf-print.c 2012-01-23 16:34:02 +00:00
kr.angelov
1af48d34ec pgf-translate: add \n at the end of two error messages 2012-01-23 15:51:37 +00:00
kr.angelov
5ccd75c8b9 libpgf: debugging framework for the parser 2012-01-23 15:49:29 +00:00
kr.angelov
fcd2c2905e libpgf: the concrete categories were allocated from the temporary pool 2012-01-23 13:43:17 +00:00
kr.angelov
4e4881dba5 libpgf: printing of literals and flags 2012-01-23 10:17:20 +00:00