28b58b6267
add teyjus/simulator/builtins/builtins.h
2012-10-11 11:10:17 +00:00
f0583bfd93
added the forgoten libteyjus.pc.in file in the C runtime
2012-10-11 04:22:38 +00:00
18fe8af964
now the meta probability for a category is explicitly specified in the statistical model instead of computed internally. this avoids rounding errors while computing the sum of a large number of small values.
2012-09-24 09:37:21 +00:00
bb15542a85
in the robust parser we don't have to care about trees which yeld empty strings. this makes the parser a lot faster
2012-09-24 09:30:20 +00:00
f75d1374ff
the Haskell runtime now exports 'functionsByCat' which returns the list of all functions for a given category
2012-09-18 09:48:21 +00:00
44df7a33cf
the C runtime now has a type prob_t which is used only for probability values
2012-09-18 09:18:48 +00:00
cd3cca4aa2
bugfix in the C parser
2012-09-06 14:52:19 +00:00
37e1ced6cf
another fix for teyjus
2012-08-30 08:09:30 +00:00
fe27540c49
the loading of PGF files was broken by the Teyjus patch. Now this is fixed
2012-08-30 07:41:49 +00:00
f78505d88e
Use nub' instead of nub in some places, remove some unused nub imports
2012-08-29 21:48:34 +00:00
87260365c7
Added an O(n log n) version of nub
...
The new nub is called nub', and it replaces the old sortNub which was
not lazy and did not retain the order between the elements.
2012-08-29 21:45:10 +00:00
fd5220038d
A basic infrastructure for generating Teyjus bytecode from the GF abstract syntax
2012-08-29 11:43:02 +00:00
3ef3108314
fix some warnings in teyjus
2012-08-03 12:30:01 +00:00
b34232c6dc
the first draft of GF.Compile.Instructions
2012-08-01 09:21:59 +00:00
2844742afd
An initial import of the teyjus source code in the C runtime for GF. The two runtime are still not connected but the source code compiles.
2012-07-31 15:16:04 +00:00
3a352a953f
Use a separated tag for meta productions in the robust parser. This cleans up the code a lot
2012-06-13 05:49:30 +00:00
7549a4876d
now there is a limit of 2000000 items in the chart of the robust parser. This prevents from explosion in the memory size but it will also prevent us from parsing some sentences.
2012-06-12 11:30:01 +00:00
b765b0c054
now the robust parser is purely top-down and the meta rules compete on a fair basis with the grammar rules
2012-06-12 09:29:51 +00:00
8ef8af479f
command option ma -known to drop unknown words
2012-06-10 10:43:57 +00:00
cab4602b62
the viterbi probability for the epsilon categories is now updated properly
2012-05-25 07:30:35 +00:00
ec00a42ee6
fixed an alignment bug in libgu which leads to crash on some platforms
2012-05-25 07:29:29 +00:00
bd102d54d9
fixed memory leak in the pgf-translate tool
2012-05-25 07:28:18 +00:00
fdcd0de336
added pgf-service.c in the robust parser'
2012-05-25 07:27:29 +00:00
bd8046f23d
another attempt to port the robust parser to MacOS
2012-05-16 15:18:44 +00:00
e342e5e7d6
small fix for compiling the robust parser on MacOS
2012-05-16 12:18:50 +00:00
4aca965109
a new unbiased statistical parser. it is still far from perfect use it on your own risk.
2012-05-08 12:13:28 +00:00
ed6a53609b
yet another fix for parsing literals
2012-04-18 15:50:55 +00:00
c6c54f8815
some fixes in the robust parser and a new API for literals
2012-04-12 06:55:25 +00:00
99cc07ad67
simple cleanup in the robust parser
2012-04-02 19:01:18 +00:00
4404be284d
Fix List.foldl / Map.foldl ambiguosity
...
Fixes the following error:
src/runtime/haskell/PGF/Expr.hs:111:14:
Ambiguous occurrence `foldl'
It could refer to either `List.foldl',
imported from `Data.List' at src/runtime/haskell/PGF/Expr.hs:27:1-24
(and originally defined in `GHC.List')
or `Map.foldl',
imported from `Data.Map' at src/runtime/haskell/PGF/Expr.hs:28:1-40
2012-03-26 20:18:23 +00:00
c234e58a6a
PGF run-time library: function names in BracketedString (experimental)
...
+ Make room for function names in the BracketedString data structure.
+ Fill in function names when linearizing an abstract syntax tree to a
BracketedString.
+ Fill in wildCId when it is not obvious what the function is.
+ Function bracketedLinearize: for compatibility with the other linearization
functions, return Leaf "" instead of error "cannot linearize".
+ Export flattenBracketedString from module PGF.
+ PGFServce: make function names available in the JSON representation of
BracketedString.
2012-03-18 20:12:26 +00:00
2bf3f22fac
libpgf: a new implementation for literals which also allows custom literals. the same mechanism is now used for the metavariables
2012-03-12 14:25:51 +00:00
c1b2246fa9
libpgf: added simple lexer
2012-03-09 09:14:44 +00:00
1da464a4cc
libpgf: implementation for built in literal categories
2012-03-07 16:39:29 +00:00
bf81c0f77f
libpgf: simple fix in the parser debugger
2012-03-07 12:23:07 +00:00
e871330665
libpgf: two APIs - one for finding all parse results and another for finding the best parse result
2012-03-07 11:00:17 +00:00
791a1a17b0
libpgf: now all concrete functions and categories are explicitly linked to their abstract counter parts
2012-03-05 12:59:31 +00:00
fdf6dd7798
libpgf: preliminary version for the statistical ranking. we use naive statistical model with random weight for the meta variables.
2012-03-02 19:25:01 +00:00
79c7141973
libpgf: simple optimization in the implementation for heaps
2012-03-02 17:43:46 +00:00
862e89db8d
libpgf: an API for building heaps from buffers in gu/seq.c
2012-02-29 18:51:21 +00:00
aca0bd5ee5
libpgf: the first prototype for the robust parser
2012-02-29 14:43:08 +00:00
65a69cab91
libpgf: the choice object should remember integers instead of single bytes
2012-02-29 13:41:59 +00:00
e0bf3c0a07
libpgf: another fix in the parser debugger
2012-02-28 16:37:12 +00:00
9536cecae8
libpgf: the time measurement in pgf-translate should be made after pgf_parse_result for more accurate timing
2012-02-28 13:14:24 +00:00
3aa26948de
libpgf: fix in the parser debugger
2012-02-28 13:12:38 +00:00
9604f3623a
libpgf: pretty printing for expressions with metavaraibles
2012-02-27 13:50:35 +00:00
695c776065
libpgf: fix in pgf_read_into_map
2012-02-24 15:15:07 +00:00
0faffc6ffd
libpgf: simple fix in the grammar printer and the reader
2012-02-24 13:52:21 +00:00
f1d2852c4d
libpgf: now we have both complete bottom up index for robust parsing and fast lexical lookup from the same index
2012-02-22 21:27:54 +00:00
440b208144
libpgf: two small fixes in the parser debugger
2012-02-22 14:06:49 +00:00
kr.angelov