Commit Graph

4039 Commits

Author SHA1 Message Date
krasimir
472a95a844 "flags case_sensitive=off" makes the parser case insensitive 2015-05-11 14:11:42 +00:00
krasimir
3d502a76b3 added all orthographic primitives 2015-05-11 13:01:39 +00:00
krasimir
949310ef1b implemented CAPIT in parsing 2015-05-08 18:54:50 +00:00
krasimir
7ee9edd080 fix in the dictionary lookup 2015-05-08 18:12:24 +00:00
krasimir
b87ed432a5 a new nice and elegant algorithm for dictionary lookup in the parser 2015-05-08 14:38:24 +00:00
krasimir
e600eb764a the parser is now fully Unicode compatible 2015-05-08 09:23:29 +00:00
krasimir
5b60c3a00e fix gu_ucs_is_space in libgu 2015-05-07 15:50:55 +00:00
krasimir
6eb15eb585 fix the NERC in C to work for PN as literal 2015-05-07 15:16:55 +00:00
krasimir
4ae661e19e fix pgf-translate to use the NERC again 2015-05-07 14:49:30 +00:00
krasimir
77f14f3cc8 fix the UTF8 implementation in libgu 2015-05-06 15:51:12 +00:00
hallgren
dfd42bade2 GF.Haskell: small pretty printing improvement 2015-05-05 14:06:20 +00:00
hallgren
c13f5a0d68 GF.CompileOne: use random numbers to avoid temporary file name clashes
When using make -j to compile examples/app or examples/phrasebook, since
the dependencies are not completely specified in the Makefiles, it can
happen that the same file is compiled at the same by more than one process,
resulting in an error when they try to write the same .gfo.tmp file. Adding a
random number to the temporary file name avoids this problem.
2015-05-05 13:51:35 +00:00
krasimir
e83d2b590b use a temporary pool for linearizeAll in Haskell too 2015-04-27 19:39:16 +00:00
krasimir
be8302febe fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant 2015-04-27 19:27:11 +00:00
krasimir
b115b97718 fix warning in the Python binding 2015-04-27 18:33:18 +00:00
krasimir
add8c83d93 mark two more functions as static in the Python binding 2015-04-27 18:24:21 +00:00
krasimir
57704a1b51 make linearizeAll in the Haskell binding lazy 2015-04-27 16:28:45 +00:00
prasanth.kolachina
93ab6c79d4 K translations in pipeline 2015-04-27 15:59:49 +00:00
prasanth.kolachina
fd566e123a K Linearizations 2015-04-27 15:59:25 +00:00
prasanth.kolachina
a82d8c9ea6 Python linearizeAll with lazyness
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant 
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
e9474e2a3f remove parsing for long sentences, to stop pipeline from crashing/hanging 2015-04-27 13:05:14 +00:00
prasant.kolachina
beedd6dbb7 bug fix in python examples 2015-04-26 11:00:17 +00:00
prasant.kolachina
20a234521e bug fix python examples 2015-04-26 10:18:21 +00:00
prasant.kolachina
db2d012fe5 Bug fix python examples 2015-04-26 10:16:23 +00:00
prasanth.kolachina
c43af4d991 Changes in lexer 2015-04-26 07:44:18 +00:00
prasanth.kolachina
c921136a9b Bug fix in gf_utils 2015-04-24 18:46:03 +00:00
prasanth.kolachina
98bfbd8d60 No debug messages 2015-04-22 18:51:55 +00:00
prasanth.kolachina
a57b9b9275 Minor bug in pgf parse and kparse 2015-04-22 18:49:49 +00:00
prasanth.kolachina
b18669992d README for Python translation pipeline 2015-04-22 13:14:26 +00:00
prasanth.kolachina
6ad6763a7f Cleaned up Python Translation pipeline 2015-04-22 11:30:26 +00:00
prasanth.kolachina
4c103be4de Examples for using Python bindings
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
f0f1748360 some translate.probs decreased ; fine-tuning in pgf-hsbind-trans 2015-04-21 14:13:13 +00:00
krasimir
61e37c9e5e drop the dependency to FST 2015-04-20 11:56:13 +00:00
krasimir
79b710a6b7 added getpagesize() definition for Windows 2015-04-20 09:57:28 +00:00
krasimir
bfc2df3d04 fix in the Haskell binding for Windows 2015-04-20 09:55:15 +00:00
aarne
168e6a04d8 pgf-hsbind-trans now with linearizeAll 2015-04-17 14:33:28 +00:00
hallgren
54b69e25ea pgf-shell.hs: remove call to performGC and document the 'i' command 2015-04-17 13:34:41 +00:00
hallgren
409f7ab3e3 gf -server: include grammar modification time in the info returned by /version 2015-04-17 13:21:20 +00:00
hallgren
69a192308b PGF web service: add command c-linearizeAll to obtain all variants
Implemented by calling the recently added function PGF2.linearizeAll.
2015-04-17 12:59:03 +00:00
krasimir
a76ea1a99b added linearizeAll in the Haskell bindings 2015-04-17 12:33:22 +00:00
krasimir
5754848626 bugfix in the java binding 2015-04-16 13:53:03 +00:00
aarne
3ddbc44789 simplified the example translator and renamed it to pgf-hsbind-trans 2015-04-16 13:51:18 +00:00
hallgren
9495fc309f Wide Coverage Translation Demo: length limit test uses # of source chars now
The length limit test previously used the URL-encoded UTF-8 representation
of the source sentense. This was needed because of a fixed size buffer in C.
Now that the server is in Haskell, the only reason the length is limited
is to avoid excessive time and space use in the parser, so it is better to
count source characters. This also avoids being too restrictive with
non-European languages.
2015-04-16 12:21:32 +00:00
aarne
538784e6dc restored Cantonese as app Chi speech output: nothing else seems to work 2015-04-16 06:52:09 +00:00
aarne
23992d412d extended pgf-shell functionalities: batch translation with many trees, and intervening context-dependent tree manipulation 2015-04-15 15:53:44 +00:00
hallgren
3aaeaf1325 Translating linearization functions to Haskell: move Haskell AST and pretty printer to GF.Haskell
For further separation of pretty printing concerns from conversion concerns,
the Haskell AST and pretty printer has been moved to its own module,
GF.Haskell, also allowing it to be reused in other places where Haskell
code is generated.
2015-04-14 12:44:14 +00:00
aarne
ca2ef47a47 updated app help file ; added backslash to ? in Thai keyboard xml to make it compile 2015-04-13 09:45:05 +00:00
hallgren
29712a43ac Wide coverage translation demo: show an informative error message for sentences that exceed the length limit 2015-04-09 10:18:41 +00:00
hallgren
e2e943eabc GF.Compile.ConcreteToHaskell: some documentation 2015-04-07 14:51:52 +00:00
hallgren
33442e6b4f GF.CompileInParallel: get rid of the cryptic 'thread blocked indefinitely in an MVar operation' message after compilation errors
Instead show a message saying how many modules were affected by the compilation
errors.
2015-03-31 13:26:51 +00:00