2483dc7728
the content of ParseEngAbs3.probs is now merged with ParseEngAbs.probs. The later is now retrained. Once the grammar is compiled with the .probs file now it doesn't need anything more to do robust parsing. The robustness itself is controlled by the flags 'heuristic_search_factor', 'meta_prob' and 'meta_token_prob' in ParseEngAbs.gf
2013-11-06 10:21:46 +00:00
84ef5fa5fa
when printing floating literals use %lg instead of %lf for better output
2013-11-06 09:46:29 +00:00
6e1451e142
fix the debug mode of the JIT compiler after the refactoring in libgu
2013-11-04 19:33:29 +00:00
546c7ac859
A simple type checker in the C runtime. Dependent types are not supported yet but HOAS is implemented. The API is accessible from Python as well
2013-11-04 17:10:46 +00:00
585a192d0b
bug fix in the linearizer
2013-11-04 12:40:53 +00:00
a7d245fb25
linearization for HOAS trees. It should word but we need a type checker in order to test it properly
2013-11-02 12:34:00 +00:00
523259b06d
fix the parseval metric after the redesign in the C runtime
2013-11-01 17:36:22 +00:00
fda1416c4d
bugfix in the linearizer
2013-11-01 17:26:35 +00:00
981a728d13
fix the robust parser for unknown tokens
2013-11-01 13:05:17 +00:00
ad7d18a448
bugfix in linearizer.c
2013-11-01 11:02:12 +00:00
a0505da063
remove the include to mman.h in jit.c since it doesn't seem to be used
2013-11-01 07:46:24 +00:00
050ebd469c
bracketedLinearize in Python is now using the linref
2013-10-31 09:04:07 +00:00
fed16ca9e5
use linref in the C linearizer. The robust linearization is now fully supported
2013-10-30 21:43:52 +00:00
48b639e64e
fix the debug mode in the linearizer after the refactoring in libgu
2013-10-30 21:06:55 +00:00
042243f08a
added the linref construction in GF. The PGF version number is now bumped
2013-10-30 12:53:36 +00:00
c60a019b70
another fix for 'pre'
2013-10-28 13:54:06 +00:00
151f86c1e9
fix the handling of 'pre' in the C runtime
2013-10-28 12:35:37 +00:00
0882396875
tabular linearization in the C and Java runtimes
2013-10-23 14:49:28 +00:00
53631576dc
bugfix for the custom literals in the C runtime
2013-10-21 12:34:57 +00:00
268e9a7960
avoid warning in parser.c when debugging is OFF
2013-10-09 13:41:02 +00:00
8cf03bc5b6
a major redesign in the C runtime. The parser and the linearizer now fully support BIND. The following things are still broken: parseval, word completion, handling 'pre', the robust mode
2013-10-09 12:08:51 +00:00
ebb5737c0e
fix the robust parser after the change of GuString
2013-10-08 15:00:42 +00:00
4a50440db9
bugfix in GNU lightning for ARM
2013-10-08 13:33:18 +00:00
c8df5997a7
fix the grammar printer after the change of GuString in libgu
2013-10-07 09:46:35 +00:00
73fa1ec0e6
suppress warning in graphviz.c
2013-10-04 12:56:45 +00:00
e8335806af
GuString is now an ordinary C string - it makes live easier. In addition PgfSymbolKS, PgfExprFun and PgfLiteralStr now keep their strings as embedded flexible arrays. The latest change gives us the same compactness as the old representation but it is a lot easier to use.
2013-10-04 12:04:39 +00:00
71868fa053
the symbol for nonExist in the GF runtime should be the last. this simplifies the binary search in the C runtime
2013-10-03 08:21:31 +00:00
f5d7b4787c
fix the graphviz visualization after the introduction of nonExist and BIND
2013-09-30 10:38:28 +00:00
13822c9a2d
better handling for nonExist in the C runtime. BIND is also supported in the linearizer but not in the parser yet
2013-09-30 10:25:39 +00:00
426bc49a52
a major refactoring in the C and the Haskell runtimes. Note incompatible change in the PGF format!!!
...
The following are the outcomes:
- Predef.nonExist is fully supported by both the Haskell and the C runtimes
- Predef.BIND is now an internal compiler defined token. For now
it behaves just as usual for the Haskell runtime, i.e. it generates &+.
However, the special treatment will let us to handle it properly in
the C runtime.
- This required a major change in the PGF format since both
nonExist and BIND may appear inside 'pre' and this was not supported
before.
2013-09-27 15:09:48 +00:00
780ba65c25
remove pgf/edsl.h from the C runtime
2013-09-26 11:59:35 +00:00
2e2f74741a
fix the debug mode of the parser after the refactoring in libgu
2013-09-25 10:21:35 +00:00
4f05852b22
added assertion in the JIT compiler which checks that we are not going outside of the compilation window
2013-09-25 07:53:10 +00:00
c08f42ce9f
the PGF reader now releases strings that are not used after the loading
2013-09-18 08:26:11 +00:00
2a49e4e1d6
a major refactoring in the C runtime. GuList is now removed and replaced with GuSeq. The GuSeq/GuBuf API is simplified
2013-09-17 12:45:00 +00:00
470eb46e96
remove leftcorner_cat_idx which is now redundant
2013-09-13 13:49:17 +00:00
c721c5548e
minor optimization/refactoring in the grammar reader
2013-09-13 11:02:17 +00:00
df91908e63
the leftcorner indexing is now completely removed since it slowed down the loading without speeding up parsing a lot
2013-09-13 10:26:33 +00:00
4eb9aa3911
fix the debug mode of the parser after the changes in the libgu API
2013-09-13 09:58:20 +00:00
ba60e6f0e4
tiny optimization in pgf/reader
2013-09-13 09:50:44 +00:00
2e8f055164
optimize the reading of strings in the grammar loader.
2013-09-13 08:28:20 +00:00
9c3dd1e1e1
remove the logging from libgu
2013-09-12 09:30:02 +00:00
2105188bd0
enable the PGF JIT compiler for Android
2013-09-12 09:05:43 +00:00
bfafdbfec3
rewrite the ARM port of GNU lightning to a form compatible with the versions for the other CPUs
2013-09-11 20:17:50 +00:00
14f8b96b56
remove the string internalization since it slows down grammar loading with little benefit
2013-09-05 13:34:49 +00:00
7c0bad5092
remove the read and write modules from libgu. this simplifies the i/o layer
2013-09-05 11:20:39 +00:00
504341dfba
remove dump and yaml from libgu
2013-09-05 10:01:47 +00:00
35a98594be
added make file for compiling the C runtime for Android. The JIT compiler for Android is temporary disabled
2013-09-04 11:56:47 +00:00
805f95eac6
remove the dependency on the HAVE_STATEMENT_EXPRESSIONS flag. This reduces the dependency on the ./configure script
2013-09-04 10:06:07 +00:00
0aef8d1c72
slight optimization for the linearizer in the C runtime
2013-09-04 07:11:14 +00:00
kr.angelov