kr.angelov
edb4f7320d
add gu_buf_insert in libgu
2013-11-18 09:05:09 +00:00
kr.angelov
a6d60f9c8d
fixes in the C runtime to avoid warnings when compiling on MacOS
2013-11-15 10:03:22 +00:00
kr.angelov
d997df2864
pgf_read should open the grammar file in binary mode to prevent the Windows runtime from messing up the content.
2013-11-15 09:04:00 +00:00
kr.angelov
b3149b7897
pgf_reader_done should do nothing if the reading has failed
2013-11-15 08:59:18 +00:00
kr.angelov
126d5e0278
bugfix in the C runtime which had made the parser up to 200 times slower for some sentences
2013-11-13 15:15:28 +00:00
kr.angelov
0095119ec0
added Predef.SOFT_BIND. This special token allows zero or more spaces between ordinary tokens. It is also used in the English RGL to attach the commas to the previous word.
2013-11-12 09:54:57 +00:00
kr.angelov
af4a1f628d
factor of 3 speedup for the translation without slowing down the grammar loading. The parser still seems to be 8 times slower than before I introduced the BIND. At least the Android UI now feels a lot more comfortable
2013-11-07 11:14:32 +00:00
kr.angelov
3f5ae22a0c
bugfix in the binary search implementation in libgu
2013-11-07 11:13:47 +00:00
kr.angelov
7160a06a30
remove redundant type signature in gu/seq.h
2013-11-07 09:47:07 +00:00
kr.angelov
71744f7642
fix for the memory allocation in the jitter which should work for Windows.
2013-11-07 08:47:35 +00:00
kr.angelov
f9d044d294
fix in the parsing with pre
2013-11-06 16:25:25 +00:00
kr.angelov
2483dc7728
the content of ParseEngAbs3.probs is now merged with ParseEngAbs.probs. The later is now retrained. Once the grammar is compiled with the .probs file now it doesn't need anything more to do robust parsing. The robustness itself is controlled by the flags 'heuristic_search_factor', 'meta_prob' and 'meta_token_prob' in ParseEngAbs.gf
2013-11-06 10:21:46 +00:00
kr.angelov
84ef5fa5fa
when printing floating literals use %lg instead of %lf for better output
2013-11-06 09:46:29 +00:00
kr.angelov
6e1451e142
fix the debug mode of the JIT compiler after the refactoring in libgu
2013-11-04 19:33:29 +00:00
kr.angelov
546c7ac859
A simple type checker in the C runtime. Dependent types are not supported yet but HOAS is implemented. The API is accessible from Python as well
2013-11-04 17:10:46 +00:00
kr.angelov
585a192d0b
bug fix in the linearizer
2013-11-04 12:40:53 +00:00
kr.angelov
a7d245fb25
linearization for HOAS trees. It should word but we need a type checker in order to test it properly
2013-11-02 12:34:00 +00:00
kr.angelov
4e7781b606
remove the include of lexer.h from pgf-parse
2013-11-02 11:28:55 +00:00
kr.angelov
523259b06d
fix the parseval metric after the redesign in the C runtime
2013-11-01 17:36:22 +00:00
kr.angelov
fda1416c4d
bugfix in the linearizer
2013-11-01 17:26:35 +00:00
kr.angelov
8073f9abf5
make gu_exn_is_raised non inlined. this is useful to make it callable from Haskell
2013-11-01 16:38:16 +00:00
kr.angelov
981a728d13
fix the robust parser for unknown tokens
2013-11-01 13:05:17 +00:00
kr.angelov
ad7d18a448
bugfix in linearizer.c
2013-11-01 11:02:12 +00:00
kr.angelov
a0505da063
remove the include to mman.h in jit.c since it doesn't seem to be used
2013-11-01 07:46:24 +00:00
kr.angelov
20d465ca8c
fixed utf-8 decoding problem in libgu
2013-10-31 13:20:12 +00:00
kr.angelov
050ebd469c
bracketedLinearize in Python is now using the linref
2013-10-31 09:04:07 +00:00
kr.angelov
fed16ca9e5
use linref in the C linearizer. The robust linearization is now fully supported
2013-10-30 21:43:52 +00:00
kr.angelov
48b639e64e
fix the debug mode in the linearizer after the refactoring in libgu
2013-10-30 21:06:55 +00:00
kr.angelov
042243f08a
added the linref construction in GF. The PGF version number is now bumped
2013-10-30 12:53:36 +00:00
kr.angelov
c60a019b70
another fix for 'pre'
2013-10-28 13:54:06 +00:00
kr.angelov
151f86c1e9
fix the handling of 'pre' in the C runtime
2013-10-28 12:35:37 +00:00
kr.angelov
cd5a0de253
bugfix in gu/seq.h
2013-10-28 08:58:36 +00:00
kr.angelov
0882396875
tabular linearization in the C and Java runtimes
2013-10-23 14:49:28 +00:00
kr.angelov
e408f0a0db
clumsy fix for nonExist in pgf-translate
2013-10-21 12:35:34 +00:00
kr.angelov
53631576dc
bugfix for the custom literals in the C runtime
2013-10-21 12:34:57 +00:00
kr.angelov
268e9a7960
avoid warning in parser.c when debugging is OFF
2013-10-09 13:41:02 +00:00
kr.angelov
8cf03bc5b6
a major redesign in the C runtime. The parser and the linearizer now fully support BIND. The following things are still broken: parseval, word completion, handling 'pre', the robust mode
2013-10-09 12:08:51 +00:00
kr.angelov
20e4970ec1
added gu_is_space in gu/utf8.h. this helps to avoid the dependency on the broken unicode library for C.
2013-10-09 08:37:42 +00:00
kr.angelov
ebb5737c0e
fix the robust parser after the change of GuString
2013-10-08 15:00:42 +00:00
kr.angelov
4a50440db9
bugfix in GNU lightning for ARM
2013-10-08 13:33:18 +00:00
kr.angelov
c8df5997a7
fix the grammar printer after the change of GuString in libgu
2013-10-07 09:46:35 +00:00
kr.angelov
73fa1ec0e6
suppress warning in graphviz.c
2013-10-04 12:56:45 +00:00
kr.angelov
e8335806af
GuString is now an ordinary C string - it makes live easier. In addition PgfSymbolKS, PgfExprFun and PgfLiteralStr now keep their strings as embedded flexible arrays. The latest change gives us the same compactness as the old representation but it is a lot easier to use.
2013-10-04 12:04:39 +00:00
kr.angelov
71868fa053
the symbol for nonExist in the GF runtime should be the last. this simplifies the binary search in the C runtime
2013-10-03 08:21:31 +00:00
kr.angelov
f5d7b4787c
fix the graphviz visualization after the introduction of nonExist and BIND
2013-09-30 10:38:28 +00:00
kr.angelov
13822c9a2d
better handling for nonExist in the C runtime. BIND is also supported in the linearizer but not in the parser yet
2013-09-30 10:25:39 +00:00
kr.angelov
426bc49a52
a major refactoring in the C and the Haskell runtimes. Note incompatible change in the PGF format!!!
...
The following are the outcomes:
- Predef.nonExist is fully supported by both the Haskell and the C runtimes
- Predef.BIND is now an internal compiler defined token. For now
it behaves just as usual for the Haskell runtime, i.e. it generates &+.
However, the special treatment will let us to handle it properly in
the C runtime.
- This required a major change in the PGF format since both
nonExist and BIND may appear inside 'pre' and this was not supported
before.
2013-09-27 15:09:48 +00:00
kr.angelov
780ba65c25
remove pgf/edsl.h from the C runtime
2013-09-26 11:59:35 +00:00
kr.angelov
216490f275
add gu_variant_close in libgu
2013-09-26 10:41:52 +00:00
kr.angelov
2e2f74741a
fix the debug mode of the parser after the refactoring in libgu
2013-09-25 10:21:35 +00:00
