kr.angelov
912225a5dd
pattern matching in def rules is now supported
2014-08-11 15:53:41 +00:00
kr.angelov
03b067782c
a partial support for def rules in the C runtime
...
The def rules are now compiled to byte code by the compiler and then to
native code by the JIT compiler in the runtime. Not all constructions
are implemented yet. The partial implementation is now in the repository
but it is not activated by default since this requires changes in the
PGF format. I will enable it only after it is complete.
2014-08-11 10:59:10 +00:00
kr.angelov
0138869499
implemented computing with abstract syntax trees. It passes all test cases except those that require def rules. The design is consistent with the STG virtual machine
2014-07-08 19:45:49 +00:00
kr.angelov
b3397f8071
bugfix for the typechecker in the C runtime
2014-07-08 19:19:48 +00:00
kr.angelov
7afbff6fa8
embedded mode for GF grammar in Python. Only generation for now
2014-07-06 19:49:17 +00:00
kr.angelov
b21f2c04e1
an initial Java/C API for predicting literals. Still not utilized
2014-04-25 08:53:18 +00:00
kr.angelov
68c8d3cba8
bugfix in the handling of BIND in the C runtime
2014-04-22 13:53:18 +00:00
kr.angelov
d8e5206e7f
now word completion from Java works. It could be made better
2014-04-17 11:00:27 +00:00
kr.angelov
a9ebeaea44
now fully functional Java API for custom literals
2014-04-10 14:14:31 +00:00
kr.angelov
3a0aa8b997
bugfix in the C runtime
2014-04-10 07:42:49 +00:00
kr.angelov
66d60ce9d1
a quick hack to enable the NERC from bindings. This should be made available from the API but for now I just hacked the C runtime
2014-04-10 07:27:07 +00:00
kr.angelov
52377b46cf
bugfix in the C runtime that shows up with only some grammars
2014-04-08 12:41:41 +00:00
kr.angelov
709f5dfcd8
small fixes in the C runtime
2014-03-25 13:57:57 +00:00
kr.angelov
bc81d163fb
whitespace cleanup in the parser
2014-03-18 10:19:35 +00:00
kr.angelov
1a1e7cdb2e
compute the right word probability
2014-03-12 15:36:40 +00:00
kr.angelov
a77dc568bb
added pgf_lookup_word_prefix which makes it possible to do simple word prediction
2014-03-07 21:24:20 +00:00
hallgren
8d9821a977
C run-time: protect from Windows specific #includes with #ifdef __MINGW32__
2014-03-06 13:42:27 +00:00
kr.angelov
487647b393
implementation for pre in the C runtime
2014-03-05 10:17:42 +00:00
kr.angelov
2e51ddceae
memory leak in parseval.c
2014-03-04 10:29:18 +00:00
kr.angelov
903abb5a4f
rename pgf_lzr_linearize_table to pgf_lzr_get_table
2014-03-04 10:13:23 +00:00
kr.angelov
ab8dd16e8d
include malloc.h in a few places to avoid warnings on Windows
2014-02-27 19:34:14 +00:00
kr.angelov
7c66e438e1
GuVariant is now plain uintptr_t instead of a structure to make it easier to write Haskell bindings
2014-02-09 19:07:15 +00:00
kr.angelov
4b8c1db6d2
bugfix in the recognizer for literals in the C runtime
2014-02-05 20:13:52 +00:00
kr.angelov
ac835fe3b0
make sure that pgf_concrete_load has no effect on grammars that are completely loaded
2013-12-17 13:57:16 +00:00
kr.angelov
6028a63b42
loading and unloading of languages in the C runtime and in the Python bindings
2013-12-10 15:00:52 +00:00
kr.angelov
3509a8d4cc
added API in the C runtime and the Java binding for checking whether a given function is linearizable in a given language. This is used in the Android UI for better vizualizations
2013-11-27 12:35:11 +00:00
kr.angelov
4254b101f4
the GF syntax for identifiers is exteded with quoted forms, i.e. you could write for instance 'ab.c' and then everything between the quites is identifier. This includes Unicode characters and non-ASCII symbols. This is useful for automatically generated GF grammars.
2013-11-22 13:30:18 +00:00
kr.angelov
cddc19a5ad
bugfix in the debug mode for the parser
2013-11-22 12:26:49 +00:00
kr.angelov
e77c19c783
bugfix in the C runtime
2013-11-21 14:31:28 +00:00
kr.angelov
b255f19b63
fix in the Python binding
2013-11-20 09:54:37 +00:00
kr.angelov
33a76f1cd5
bugfix in the robust parser
2013-11-18 09:05:27 +00:00
kr.angelov
fb8de0e8ea
fixes in the C runtime to avoid warnings when compiling on MacOS
2013-11-15 10:03:22 +00:00
kr.angelov
684a3b8df5
pgf_read should open the grammar file in binary mode to prevent the Windows runtime from messing up the content.
2013-11-15 09:04:00 +00:00
kr.angelov
254aba33a1
pgf_reader_done should do nothing if the reading has failed
2013-11-15 08:59:18 +00:00
kr.angelov
63a90f34af
bugfix in the C runtime which had made the parser up to 200 times slower for some sentences
2013-11-13 15:15:28 +00:00
kr.angelov
1d7b6f44b6
added Predef.SOFT_BIND. This special token allows zero or more spaces between ordinary tokens. It is also used in the English RGL to attach the commas to the previous word.
2013-11-12 09:54:57 +00:00
kr.angelov
6729cca568
factor of 3 speedup for the translation without slowing down the grammar loading. The parser still seems to be 8 times slower than before I introduced the BIND. At least the Android UI now feels a lot more comfortable
2013-11-07 11:14:32 +00:00
kr.angelov
fe41356a9d
fix for the memory allocation in the jitter which should work for Windows.
2013-11-07 08:47:35 +00:00
kr.angelov
6c71830c10
fix in the parsing with pre
2013-11-06 16:25:25 +00:00
kr.angelov
475f213c99
the content of ParseEngAbs3.probs is now merged with ParseEngAbs.probs. The later is now retrained. Once the grammar is compiled with the .probs file now it doesn't need anything more to do robust parsing. The robustness itself is controlled by the flags 'heuristic_search_factor', 'meta_prob' and 'meta_token_prob' in ParseEngAbs.gf
2013-11-06 10:21:46 +00:00
kr.angelov
d094d671bd
when printing floating literals use %lg instead of %lf for better output
2013-11-06 09:46:29 +00:00
kr.angelov
d2186b71e3
fix the debug mode of the JIT compiler after the refactoring in libgu
2013-11-04 19:33:29 +00:00
kr.angelov
81ef6714db
A simple type checker in the C runtime. Dependent types are not supported yet but HOAS is implemented. The API is accessible from Python as well
2013-11-04 17:10:46 +00:00
kr.angelov
5683367818
bug fix in the linearizer
2013-11-04 12:40:53 +00:00
kr.angelov
0cb3245e26
linearization for HOAS trees. It should word but we need a type checker in order to test it properly
2013-11-02 12:34:00 +00:00
kr.angelov
58b20a7e2e
fix the parseval metric after the redesign in the C runtime
2013-11-01 17:36:22 +00:00
kr.angelov
72e0c89abe
bugfix in the linearizer
2013-11-01 17:26:35 +00:00
kr.angelov
d7cd5ba195
fix the robust parser for unknown tokens
2013-11-01 13:05:17 +00:00
kr.angelov
ffa143f1d2
bugfix in linearizer.c
2013-11-01 11:02:12 +00:00
kr.angelov
b05f61e6c6
remove the include to mman.h in jit.c since it doesn't seem to be used
2013-11-01 07:46:24 +00:00
