kr.angelov
0ad2405d69
forgot to add one #ifdef
2012-10-25 18:37:22 +00:00
kr.angelov
9721833680
a major refactoring in the robust parser: bottom-up filtering and garbage collection for the chart
2012-10-25 14:42:53 +00:00
kr.angelov
28b58b6267
add teyjus/simulator/builtins/builtins.h
2012-10-11 11:10:17 +00:00
kr.angelov
f0583bfd93
added the forgoten libteyjus.pc.in file in the C runtime
2012-10-11 04:22:38 +00:00
kr.angelov
18fe8af964
now the meta probability for a category is explicitly specified in the statistical model instead of computed internally. this avoids rounding errors while computing the sum of a large number of small values.
2012-09-24 09:37:21 +00:00
kr.angelov
bb15542a85
in the robust parser we don't have to care about trees which yeld empty strings. this makes the parser a lot faster
2012-09-24 09:30:20 +00:00
kr.angelov
f75d1374ff
the Haskell runtime now exports 'functionsByCat' which returns the list of all functions for a given category
2012-09-18 09:48:21 +00:00
kr.angelov
44df7a33cf
the C runtime now has a type prob_t which is used only for probability values
2012-09-18 09:18:48 +00:00
kr.angelov
cd3cca4aa2
bugfix in the C parser
2012-09-06 14:52:19 +00:00
kr.angelov
37e1ced6cf
another fix for teyjus
2012-08-30 08:09:30 +00:00
kr.angelov
fe27540c49
the loading of PGF files was broken by the Teyjus patch. Now this is fixed
2012-08-30 07:41:49 +00:00
peter.ljunglof
f78505d88e
Use nub' instead of nub in some places, remove some unused nub imports
2012-08-29 21:48:34 +00:00
peter.ljunglof
87260365c7
Added an O(n log n) version of nub
...
The new nub is called nub', and it replaces the old sortNub which was
not lazy and did not retain the order between the elements.
2012-08-29 21:45:10 +00:00
kr.angelov
fd5220038d
A basic infrastructure for generating Teyjus bytecode from the GF abstract syntax
2012-08-29 11:43:02 +00:00
kr.angelov
3ef3108314
fix some warnings in teyjus
2012-08-03 12:30:01 +00:00
kr.angelov
b34232c6dc
the first draft of GF.Compile.Instructions
2012-08-01 09:21:59 +00:00
kr.angelov
2844742afd
An initial import of the teyjus source code in the C runtime for GF. The two runtime are still not connected but the source code compiles.
2012-07-31 15:16:04 +00:00
kr.angelov
3a352a953f
Use a separated tag for meta productions in the robust parser. This cleans up the code a lot
2012-06-13 05:49:30 +00:00
kr.angelov
7549a4876d
now there is a limit of 2000000 items in the chart of the robust parser. This prevents from explosion in the memory size but it will also prevent us from parsing some sentences.
2012-06-12 11:30:01 +00:00
kr.angelov
b765b0c054
now the robust parser is purely top-down and the meta rules compete on a fair basis with the grammar rules
2012-06-12 09:29:51 +00:00
aarne
8ef8af479f
command option ma -known to drop unknown words
2012-06-10 10:43:57 +00:00
kr.angelov
cab4602b62
the viterbi probability for the epsilon categories is now updated properly
2012-05-25 07:30:35 +00:00
kr.angelov
ec00a42ee6
fixed an alignment bug in libgu which leads to crash on some platforms
2012-05-25 07:29:29 +00:00
kr.angelov
bd102d54d9
fixed memory leak in the pgf-translate tool
2012-05-25 07:28:18 +00:00
kr.angelov
fdcd0de336
added pgf-service.c in the robust parser'
2012-05-25 07:27:29 +00:00
kr.angelov
bd8046f23d
another attempt to port the robust parser to MacOS
2012-05-16 15:18:44 +00:00
kr.angelov
e342e5e7d6
small fix for compiling the robust parser on MacOS
2012-05-16 12:18:50 +00:00
kr.angelov
4aca965109
a new unbiased statistical parser. it is still far from perfect use it on your own risk.
2012-05-08 12:13:28 +00:00
kr.angelov
ed6a53609b
yet another fix for parsing literals
2012-04-18 15:50:55 +00:00
kr.angelov
c6c54f8815
some fixes in the robust parser and a new API for literals
2012-04-12 06:55:25 +00:00
kr.angelov
99cc07ad67
simple cleanup in the robust parser
2012-04-02 19:01:18 +00:00
Sergei Trofimovich
4404be284d
Fix List.foldl / Map.foldl ambiguosity
...
Fixes the following error:
src/runtime/haskell/PGF/Expr.hs:111:14:
Ambiguous occurrence `foldl'
It could refer to either `List.foldl',
imported from `Data.List' at src/runtime/haskell/PGF/Expr.hs:27:1-24
(and originally defined in `GHC.List')
or `Map.foldl',
imported from `Data.Map' at src/runtime/haskell/PGF/Expr.hs:28:1-40
2012-03-26 20:18:23 +00:00
hallgren
c234e58a6a
PGF run-time library: function names in BracketedString (experimental)
...
+ Make room for function names in the BracketedString data structure.
+ Fill in function names when linearizing an abstract syntax tree to a
BracketedString.
+ Fill in wildCId when it is not obvious what the function is.
+ Function bracketedLinearize: for compatibility with the other linearization
functions, return Leaf "" instead of error "cannot linearize".
+ Export flattenBracketedString from module PGF.
+ PGFServce: make function names available in the JSON representation of
BracketedString.
2012-03-18 20:12:26 +00:00
kr.angelov
2bf3f22fac
libpgf: a new implementation for literals which also allows custom literals. the same mechanism is now used for the metavariables
2012-03-12 14:25:51 +00:00
kr.angelov
c1b2246fa9
libpgf: added simple lexer
2012-03-09 09:14:44 +00:00
kr.angelov
1da464a4cc
libpgf: implementation for built in literal categories
2012-03-07 16:39:29 +00:00
kr.angelov
bf81c0f77f
libpgf: simple fix in the parser debugger
2012-03-07 12:23:07 +00:00
kr.angelov
e871330665
libpgf: two APIs - one for finding all parse results and another for finding the best parse result
2012-03-07 11:00:17 +00:00
kr.angelov
791a1a17b0
libpgf: now all concrete functions and categories are explicitly linked to their abstract counter parts
2012-03-05 12:59:31 +00:00
kr.angelov
fdf6dd7798
libpgf: preliminary version for the statistical ranking. we use naive statistical model with random weight for the meta variables.
2012-03-02 19:25:01 +00:00
kr.angelov
79c7141973
libpgf: simple optimization in the implementation for heaps
2012-03-02 17:43:46 +00:00
kr.angelov
862e89db8d
libpgf: an API for building heaps from buffers in gu/seq.c
2012-02-29 18:51:21 +00:00
kr.angelov
aca0bd5ee5
libpgf: the first prototype for the robust parser
2012-02-29 14:43:08 +00:00
kr.angelov
65a69cab91
libpgf: the choice object should remember integers instead of single bytes
2012-02-29 13:41:59 +00:00
kr.angelov
e0bf3c0a07
libpgf: another fix in the parser debugger
2012-02-28 16:37:12 +00:00
kr.angelov
9536cecae8
libpgf: the time measurement in pgf-translate should be made after pgf_parse_result for more accurate timing
2012-02-28 13:14:24 +00:00
kr.angelov
3aa26948de
libpgf: fix in the parser debugger
2012-02-28 13:12:38 +00:00
kr.angelov
9604f3623a
libpgf: pretty printing for expressions with metavaraibles
2012-02-27 13:50:35 +00:00
kr.angelov
695c776065
libpgf: fix in pgf_read_into_map
2012-02-24 15:15:07 +00:00
kr.angelov
0faffc6ffd
libpgf: simple fix in the grammar printer and the reader
2012-02-24 13:52:21 +00:00
