krasimir
b4e41cabdd
"flags case_sensitive=off" makes the parser case insensitive
2015-05-11 14:11:42 +00:00
krasimir
1e0d7be4f4
added all orthographic primitives
2015-05-11 13:01:39 +00:00
krasimir
13998e3287
implemented CAPIT in parsing
2015-05-08 18:54:50 +00:00
krasimir
483df35954
fix in the dictionary lookup
2015-05-08 18:12:24 +00:00
krasimir
ea0f74d455
a new nice and elegant algorithm for dictionary lookup in the parser
2015-05-08 14:38:24 +00:00
krasimir
365c7bb1d8
the parser is now fully Unicode compatible
2015-05-08 09:23:29 +00:00
krasimir
b961e9a255
fix gu_ucs_is_space in libgu
2015-05-07 15:50:55 +00:00
krasimir
bf3b6f2794
fix the NERC in C to work for PN as literal
2015-05-07 15:16:55 +00:00
krasimir
7e43e5727a
fix pgf-translate to use the NERC again
2015-05-07 14:49:30 +00:00
krasimir
01c4836d4d
fix the UTF8 implementation in libgu
2015-05-06 15:51:12 +00:00
hallgren
c1265db3a7
GF.Haskell: small pretty printing improvement
2015-05-05 14:06:20 +00:00
hallgren
b0e8a49b9a
GF.CompileOne: use random numbers to avoid temporary file name clashes
...
When using make -j to compile examples/app or examples/phrasebook, since
the dependencies are not completely specified in the Makefiles, it can
happen that the same file is compiled at the same by more than one process,
resulting in an error when they try to write the same .gfo.tmp file. Adding a
random number to the temporary file name avoids this problem.
2015-05-05 13:51:35 +00:00
krasimir
3649412ce2
use a temporary pool for linearizeAll in Haskell too
2015-04-27 19:39:16 +00:00
krasimir
82eeb3ef2b
fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant
2015-04-27 19:27:11 +00:00
krasimir
c1129e15fa
fix warning in the Python binding
2015-04-27 18:33:18 +00:00
krasimir
5f25804b73
mark two more functions as static in the Python binding
2015-04-27 18:24:21 +00:00
krasimir
fc4b39d65f
make linearizeAll in the Haskell binding lazy
2015-04-27 16:28:45 +00:00
prasanth.kolachina
8efff76703
K translations in pipeline
2015-04-27 15:59:49 +00:00
prasanth.kolachina
53f0307404
K Linearizations
2015-04-27 15:59:25 +00:00
prasanth.kolachina
dedad558a8
Python linearizeAll with lazyness
...
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
9b723af995
remove parsing for long sentences, to stop pipeline from crashing/hanging
2015-04-27 13:05:14 +00:00
prasant.kolachina
2555891654
bug fix in python examples
2015-04-26 11:00:17 +00:00
prasant.kolachina
3ec571b03d
bug fix python examples
2015-04-26 10:18:21 +00:00
prasant.kolachina
aa79f6bb28
Bug fix python examples
2015-04-26 10:16:23 +00:00
prasanth.kolachina
c17501540a
Changes in lexer
2015-04-26 07:44:18 +00:00
prasanth.kolachina
100c583916
Bug fix in gf_utils
2015-04-24 18:46:03 +00:00
prasanth.kolachina
7d876fd665
No debug messages
2015-04-22 18:51:55 +00:00
prasanth.kolachina
12216449e0
Minor bug in pgf parse and kparse
2015-04-22 18:49:49 +00:00
prasanth.kolachina
57006b6296
README for Python translation pipeline
2015-04-22 13:14:26 +00:00
prasanth.kolachina
c3a626686e
Cleaned up Python Translation pipeline
2015-04-22 11:30:26 +00:00
prasanth.kolachina
2b1b0568a1
Examples for using Python bindings
...
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
2804160f07
some translate.probs decreased ; fine-tuning in pgf-hsbind-trans
2015-04-21 14:13:13 +00:00
krasimir
8c697b72a4
drop the dependency to FST
2015-04-20 11:56:13 +00:00
krasimir
5d7633fdb4
added getpagesize() definition for Windows
2015-04-20 09:57:28 +00:00
krasimir
aebc868c22
fix in the Haskell binding for Windows
2015-04-20 09:55:15 +00:00
aarne
0add1bdb20
pgf-hsbind-trans now with linearizeAll
2015-04-17 14:33:28 +00:00
hallgren
78a34bc52b
pgf-shell.hs: remove call to performGC and document the 'i' command
2015-04-17 13:34:41 +00:00
hallgren
3263968c79
gf -server: include grammar modification time in the info returned by /version
2015-04-17 13:21:20 +00:00
hallgren
9e3afea129
PGF web service: add command c-linearizeAll to obtain all variants
...
Implemented by calling the recently added function PGF2.linearizeAll.
2015-04-17 12:59:03 +00:00
krasimir
86e16d9e3d
added linearizeAll in the Haskell bindings
2015-04-17 12:33:22 +00:00
krasimir
4221757895
bugfix in the java binding
2015-04-16 13:53:03 +00:00
aarne
a5305f1d9f
simplified the example translator and renamed it to pgf-hsbind-trans
2015-04-16 13:51:18 +00:00
hallgren
1420e35cbb
Wide Coverage Translation Demo: length limit test uses # of source chars now
...
The length limit test previously used the URL-encoded UTF-8 representation
of the source sentense. This was needed because of a fixed size buffer in C.
Now that the server is in Haskell, the only reason the length is limited
is to avoid excessive time and space use in the parser, so it is better to
count source characters. This also avoids being too restrictive with
non-European languages.
2015-04-16 12:21:32 +00:00
aarne
e2175a31ce
restored Cantonese as app Chi speech output: nothing else seems to work
2015-04-16 06:52:09 +00:00
aarne
b908b2ba3f
extended pgf-shell functionalities: batch translation with many trees, and intervening context-dependent tree manipulation
2015-04-15 15:53:44 +00:00
hallgren
8cfb989c9c
Translating linearization functions to Haskell: move Haskell AST and pretty printer to GF.Haskell
...
For further separation of pretty printing concerns from conversion concerns,
the Haskell AST and pretty printer has been moved to its own module,
GF.Haskell, also allowing it to be reused in other places where Haskell
code is generated.
2015-04-14 12:44:14 +00:00
aarne
9aeffa15c9
updated app help file ; added backslash to ? in Thai keyboard xml to make it compile
2015-04-13 09:45:05 +00:00
hallgren
71de9a26ef
Wide coverage translation demo: show an informative error message for sentences that exceed the length limit
2015-04-09 10:18:41 +00:00
hallgren
d249538469
GF.Compile.ConcreteToHaskell: some documentation
2015-04-07 14:51:52 +00:00
hallgren
6e81383231
GF.CompileInParallel: get rid of the cryptic 'thread blocked indefinitely in an MVar operation' message after compilation errors
...
Instead show a message saying how many modules were affected by the compilation
errors.
2015-03-31 13:26:51 +00:00
