msyds/gf-core
1
0
Fork 0
forked from GitHub/gf-core
Code Pull Requests Activity
6,312 Commits 21 Branches 11 Tags
44df7a33cf98e443b1a8be0f9001c4c007f214ae
Commit Graph

310 Commits

Author SHA1 Message Date
kr.angelov
44df7a33cf the C runtime now has a type prob_t which is used only for probability values 2012-09-18 09:18:48 +00:00
kr.angelov
cd3cca4aa2 bugfix in the C parser 2012-09-06 14:52:19 +00:00
kr.angelov
37e1ced6cf another fix for teyjus 2012-08-30 08:09:30 +00:00
kr.angelov
fe27540c49 the loading of PGF files was broken by the Teyjus patch. Now this is fixed 2012-08-30 07:41:49 +00:00
peter.ljunglof
f78505d88e Use nub' instead of nub in some places, remove some unused nub imports 2012-08-29 21:48:34 +00:00
peter.ljunglof
87260365c7 Added an O(n log n) version of nub 
The new nub is called nub', and it replaces the old sortNub which was 
not lazy and did not retain the order between the elements.
 2012-08-29 21:45:10 +00:00
kr.angelov
fd5220038d A basic infrastructure for generating Teyjus bytecode from the GF abstract syntax 2012-08-29 11:43:02 +00:00
kr.angelov
3ef3108314 fix some warnings in teyjus 2012-08-03 12:30:01 +00:00
kr.angelov
b34232c6dc the first draft of GF.Compile.Instructions 2012-08-01 09:21:59 +00:00
kr.angelov
2844742afd An initial import of the teyjus source code in the C runtime for GF. The two runtime are still not connected but the source code compiles. 2012-07-31 15:16:04 +00:00
kr.angelov
3a352a953f Use a separated tag for meta productions in the robust parser. This cleans up the code a lot 2012-06-13 05:49:30 +00:00
kr.angelov
7549a4876d now there is a limit of 2000000 items in the chart of the robust parser. This prevents from explosion in the memory size but it will also prevent us from parsing some sentences. 2012-06-12 11:30:01 +00:00
kr.angelov
b765b0c054 now the robust parser is purely top-down and the meta rules compete on a fair basis with the grammar rules 2012-06-12 09:29:51 +00:00
aarne
8ef8af479f command option ma -known to drop unknown words 2012-06-10 10:43:57 +00:00
kr.angelov
cab4602b62 the viterbi probability for the epsilon categories is now updated properly 2012-05-25 07:30:35 +00:00
kr.angelov
ec00a42ee6 fixed an alignment bug in libgu which leads to crash on some platforms 2012-05-25 07:29:29 +00:00
kr.angelov
bd102d54d9 fixed memory leak in the pgf-translate tool 2012-05-25 07:28:18 +00:00
kr.angelov
fdcd0de336 added pgf-service.c in the robust parser' 2012-05-25 07:27:29 +00:00
kr.angelov
bd8046f23d another attempt to port the robust parser to MacOS 2012-05-16 15:18:44 +00:00
kr.angelov
e342e5e7d6 small fix for compiling the robust parser on MacOS 2012-05-16 12:18:50 +00:00
kr.angelov
4aca965109 a new unbiased statistical parser. it is still far from perfect use it on your own risk. 2012-05-08 12:13:28 +00:00
kr.angelov
ed6a53609b yet another fix for parsing literals 2012-04-18 15:50:55 +00:00
kr.angelov
c6c54f8815 some fixes in the robust parser and a new API for literals 2012-04-12 06:55:25 +00:00
kr.angelov
99cc07ad67 simple cleanup in the robust parser 2012-04-02 19:01:18 +00:00
Sergei Trofimovich
4404be284d Fix List.foldl / Map.foldl ambiguosity 
Fixes the following error:
src/runtime/haskell/PGF/Expr.hs:111:14:
    Ambiguous occurrence `foldl'
    It could refer to either `List.foldl',
                             imported from `Data.List' at src/runtime/haskell/PGF/Expr.hs:27:1-24
                             (and originally defined in `GHC.List')
                          or `Map.foldl',
                             imported from `Data.Map' at src/runtime/haskell/PGF/Expr.hs:28:1-40
 2012-03-26 20:18:23 +00:00
hallgren
c234e58a6a PGF run-time library: function names in BracketedString (experimental) 
+ Make room for function names in the BracketedString data structure.
+ Fill in function names when linearizing an abstract syntax tree to a
  BracketedString.
+ Fill in wildCId when it is not obvious what the function is.
+ Function bracketedLinearize: for compatibility with the other linearization
  functions, return Leaf "" instead of error "cannot linearize".
+ Export flattenBracketedString from module PGF.
+ PGFServce: make function names available in the JSON representation of
  BracketedString.
 2012-03-18 20:12:26 +00:00
kr.angelov
2bf3f22fac libpgf: a new implementation for literals which also allows custom literals. the same mechanism is now used for the metavariables 2012-03-12 14:25:51 +00:00
kr.angelov
c1b2246fa9 libpgf: added simple lexer 2012-03-09 09:14:44 +00:00
kr.angelov
1da464a4cc libpgf: implementation for built in literal categories 2012-03-07 16:39:29 +00:00
kr.angelov
bf81c0f77f libpgf: simple fix in the parser debugger 2012-03-07 12:23:07 +00:00
kr.angelov
e871330665 libpgf: two APIs - one for finding all parse results and another for finding the best parse result 2012-03-07 11:00:17 +00:00
kr.angelov
791a1a17b0 libpgf: now all concrete functions and categories are explicitly linked to their abstract counter parts 2012-03-05 12:59:31 +00:00
kr.angelov
fdf6dd7798 libpgf: preliminary version for the statistical ranking. we use naive statistical model with random weight for the meta variables. 2012-03-02 19:25:01 +00:00
kr.angelov
79c7141973 libpgf: simple optimization in the implementation for heaps 2012-03-02 17:43:46 +00:00
kr.angelov
862e89db8d libpgf: an API for building heaps from buffers in gu/seq.c 2012-02-29 18:51:21 +00:00
kr.angelov
aca0bd5ee5 libpgf: the first prototype for the robust parser 2012-02-29 14:43:08 +00:00
kr.angelov
65a69cab91 libpgf: the choice object should remember integers instead of single bytes 2012-02-29 13:41:59 +00:00
kr.angelov
e0bf3c0a07 libpgf: another fix in the parser debugger 2012-02-28 16:37:12 +00:00
kr.angelov
9536cecae8 libpgf: the time measurement in pgf-translate should be made after pgf_parse_result for more accurate timing 2012-02-28 13:14:24 +00:00
kr.angelov
3aa26948de libpgf: fix in the parser debugger 2012-02-28 13:12:38 +00:00
kr.angelov
9604f3623a libpgf: pretty printing for expressions with metavaraibles 2012-02-27 13:50:35 +00:00
kr.angelov
695c776065 libpgf: fix in pgf_read_into_map 2012-02-24 15:15:07 +00:00
kr.angelov
0faffc6ffd libpgf: simple fix in the grammar printer and the reader 2012-02-24 13:52:21 +00:00
kr.angelov
f1d2852c4d libpgf: now we have both complete bottom up index for robust parsing and fast lexical lookup from the same index 2012-02-22 21:27:54 +00:00
kr.angelov
440b208144 libpgf: two small fixes in the parser debugger 2012-02-22 14:06:49 +00:00
kr.angelov
831de53573 libpgf: the map curr_lindefs must be allocated from a temporary pool 2012-02-22 08:49:08 +00:00
kr.angelov
dc4c3d3b28 libpgf: added index for fast lexicon lookup. Still not perfect 2012-02-21 21:17:50 +00:00
kr.angelov
eff8e1134a utils/pgf-translate now reports the parsing time 2012-02-21 20:17:18 +00:00
kr.angelov
30d3fc8b4d libpgf: now the debugging mode for the parser is available only with compilation option. 2012-02-18 19:30:16 +00:00
kr.angelov
0f7b3ed9f4 libpgf: remove the now redundant field extra_ccats in PgfConcr 2012-02-18 16:25:53 +00:00