kr.angelov
6729cca568
factor of 3 speedup for the translation without slowing down the grammar loading. The parser still seems to be 8 times slower than before I introduced the BIND. At least the Android UI now feels a lot more comfortable
2013-11-07 11:14:32 +00:00
kr.angelov
03e7c287fd
bugfix in the binary search implementation in libgu
2013-11-07 11:13:47 +00:00
kr.angelov
ceb156b93b
remove redundant type signature in gu/seq.h
2013-11-07 09:47:07 +00:00
kr.angelov
fe41356a9d
fix for the memory allocation in the jitter which should work for Windows.
2013-11-07 08:47:35 +00:00
kr.angelov
cbfa65c7ae
the 'Release' configuration in Eclipse is renamed to 'Release (posix)'. In addition now there is 'Release (mingw)' for Windows.
2013-11-07 08:36:17 +00:00
kr.angelov
4265a31003
added #ifdef to detect MinGW in the Java binding and to import the right header for alloca
2013-11-07 08:08:41 +00:00
kr.angelov
6c71830c10
fix in the parsing with pre
2013-11-06 16:25:25 +00:00
kr.angelov
5739785c77
bugfix in the Java binding
2013-11-06 14:41:42 +00:00
hallgren
06453afb1c
Remove PGF.Signature
...
This module should not be part of the public PGF library API, and it was only
used in GF.CompileToAPI, so the code was moved there. The module defined
constFuncs and syntaxFuncs, but only syntaxFuncs was used.
2013-11-06 13:27:29 +00:00
kr.angelov
475f213c99
the content of ParseEngAbs3.probs is now merged with ParseEngAbs.probs. The later is now retrained. Once the grammar is compiled with the .probs file now it doesn't need anything more to do robust parsing. The robustness itself is controlled by the flags 'heuristic_search_factor', 'meta_prob' and 'meta_token_prob' in ParseEngAbs.gf
2013-11-06 10:21:46 +00:00
kr.angelov
d094d671bd
when printing floating literals use %lg instead of %lf for better output
2013-11-06 09:46:29 +00:00
aarne
6bc1baa7f7
linearization by chunks in the GF shell: a new command 'lc' needed because 'l' requires type checking and trees with metavariable function heads don't type check. This will hopefully be a temporary command.
2013-11-05 17:28:47 +00:00
hallgren
decd7122de
Eliminate mutual dependencies between the GF compiler and the PGF library
...
+ References to modules under src/compiler have been eliminated from the PGF
library (under src/runtime/haskell). Only two functions had to be moved (from
GF.Data.Utilities to PGF.Utilities) to make this possible, other apparent
dependencies turned out to be vacuous.
+ In gf.cabal, the GF executable no longer directly depends on the PGF library
source directory, but only on the exposed library modules. This means that
there is less duplication in gf.cabal and that the 30 modules in the
PGF library will no longer be compiled twice while building GF.
To make this possible, additional PGF library modules have been exposed, even
though they should probably be considered for internal use only. They could
be collected in a PGF.Internal module, or marked as "unstable", to make
this explicit.
+ Also, by using the -fwarn-unused-imports flag, ~220 redundant imports were
found and removed, reducing the total number of imports by ~15%.
2013-11-05 13:11:10 +00:00
kr.angelov
d2186b71e3
fix the debug mode of the JIT compiler after the refactoring in libgu
2013-11-04 19:33:29 +00:00
kr.angelov
81ef6714db
A simple type checker in the C runtime. Dependent types are not supported yet but HOAS is implemented. The API is accessible from Python as well
2013-11-04 17:10:46 +00:00
kr.angelov
5683367818
bug fix in the linearizer
2013-11-04 12:40:53 +00:00
kr.angelov
0cb3245e26
linearization for HOAS trees. It should word but we need a type checker in order to test it properly
2013-11-02 12:34:00 +00:00
kr.angelov
b9cf05073f
remove the include of lexer.h from pgf-parse
2013-11-02 11:28:55 +00:00
kr.angelov
58b20a7e2e
fix the parseval metric after the redesign in the C runtime
2013-11-01 17:36:22 +00:00
kr.angelov
72e0c89abe
bugfix in the linearizer
2013-11-01 17:26:35 +00:00
kr.angelov
330e33a386
make gu_exn_is_raised non inlined. this is useful to make it callable from Haskell
2013-11-01 16:38:16 +00:00
kr.angelov
d7cd5ba195
fix the robust parser for unknown tokens
2013-11-01 13:05:17 +00:00
kr.angelov
ffa143f1d2
bugfix in linearizer.c
2013-11-01 11:02:12 +00:00
kr.angelov
b05f61e6c6
remove the include to mman.h in jit.c since it doesn't seem to be used
2013-11-01 07:46:24 +00:00
hallgren
d7300ba9fb
Add a cabal flag to use the standard binary package
...
The standard binary package has improved efficiency and error handling [1], so
in the long run we should consider switching to it. At the moment, using it is
possible but not recommended, since it results in incomatible PGF files.
The modified modules from the binary package have been moved from
src/runtime/haskell to src/binary.
[1] http://lennartkolmodin.blogspot.se/2013/03/binary-07.html
2013-10-31 15:43:12 +00:00
kr.angelov
90cc7b8379
fixed utf-8 decoding problem in libgu
2013-10-31 13:20:12 +00:00
kr.angelov
8f565302cc
bracketedLinearize in Python is now using the linref
2013-10-31 09:04:07 +00:00
kr.angelov
8019d3a615
use linref in the C linearizer. The robust linearization is now fully supported
2013-10-30 21:43:52 +00:00
kr.angelov
68b40ff0a8
fix the debug mode in the linearizer after the refactoring in libgu
2013-10-30 21:06:55 +00:00
kr.angelov
620e880155
linref is now used by the linearizer. The visible change is that the 'l' command in the shell now can linearize discontinuous phrases
2013-10-30 14:42:29 +00:00
kr.angelov
43fb9b3b7a
added the linref construction in GF. The PGF version number is now bumped
2013-10-30 12:53:36 +00:00
kr.angelov
56893dbf54
another fix for 'pre'
2013-10-28 13:54:06 +00:00
kr.angelov
841880144d
fix the handling of 'pre' in the C runtime
2013-10-28 12:35:37 +00:00
kr.angelov
fad9947aab
bugfix in gu/seq.h
2013-10-28 08:58:36 +00:00
hallgren
ad0e67530b
Functions merge trees into tries in the GF Shell and the PGF web service
...
* In the shell, the new command tt (to_trie) merges a list of trees into a
trie and prints it in a readable way, where unique subtrees are marked with
a "*" and alternative subtrees are marked with numbers.
* In the PGF web service, adding the parameter trie=yes to the parse and
translate commands augments the JSON output with a trie.
Example to try in the shell:
Phrasebook> p -lang=Eng "your son waits for you" | tt
2013-10-24 17:29:02 +00:00
kr.angelov
c98a9a3266
tabular linearization in the C and Java runtimes
2013-10-23 14:49:28 +00:00
kr.angelov
cf05e78712
clumsy fix for nonExist in pgf-translate
2013-10-21 12:35:34 +00:00
kr.angelov
e3dc98dd0f
bugfix for the custom literals in the C runtime
2013-10-21 12:34:57 +00:00
kr.angelov
8103703858
fix the grammar serialization for nonExist and BIND
2013-10-21 10:03:43 +00:00
kr.angelov
3f3c5d968a
make MorphoAnalysis serializable
2013-10-11 08:10:58 +00:00
kr.angelov
7b1db5d36e
readExpr in the Java binding
2013-10-11 08:10:04 +00:00
kr.angelov
76014aa2cc
added lookupMorpho in the Java binding
2013-10-09 19:39:50 +00:00
kr.angelov
835a15a343
fix in the Java binding
2013-10-09 19:37:57 +00:00
kr.angelov
82544f74c0
avoid warning in parser.c when debugging is OFF
2013-10-09 13:41:02 +00:00
kr.angelov
b058fdd17d
a major redesign in the C runtime. The parser and the linearizer now fully support BIND. The following things are still broken: parseval, word completion, handling 'pre', the robust mode
2013-10-09 12:08:51 +00:00
kr.angelov
eff9a3011c
added gu_is_space in gu/utf8.h. this helps to avoid the dependency on the broken unicode library for C.
2013-10-09 08:37:42 +00:00
kr.angelov
adc952a61d
fix the robust parser after the change of GuString
2013-10-08 15:00:42 +00:00
kr.angelov
527ea8fc5c
bugfix in GNU lightning for ARM
2013-10-08 13:33:18 +00:00
kr.angelov
f6b708ecab
fix the grammar printer after the change of GuString in libgu
2013-10-07 09:46:35 +00:00
kr.angelov
0d9d926131
fixes in the Java binding after the refactoring of GuString
2013-10-04 19:53:19 +00:00
