Commit Graph

7110 Commits

Author SHA1 Message Date
krasimir
bf3b6f2794 fix the NERC in C to work for PN as literal 2015-05-07 15:16:55 +00:00
krasimir
7e43e5727a fix pgf-translate to use the NERC again 2015-05-07 14:49:30 +00:00
krasimir
01c4836d4d fix the UTF8 implementation in libgu 2015-05-06 15:51:12 +00:00
hallgren
c1265db3a7 GF.Haskell: small pretty printing improvement 2015-05-05 14:06:20 +00:00
hallgren
b0e8a49b9a GF.CompileOne: use random numbers to avoid temporary file name clashes
When using make -j to compile examples/app or examples/phrasebook, since
the dependencies are not completely specified in the Makefiles, it can
happen that the same file is compiled at the same by more than one process,
resulting in an error when they try to write the same .gfo.tmp file. Adding a
random number to the temporary file name avoids this problem.
2015-05-05 13:51:35 +00:00
krasimir
3649412ce2 use a temporary pool for linearizeAll in Haskell too 2015-04-27 19:39:16 +00:00
krasimir
82eeb3ef2b fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant 2015-04-27 19:27:11 +00:00
krasimir
c1129e15fa fix warning in the Python binding 2015-04-27 18:33:18 +00:00
krasimir
5f25804b73 mark two more functions as static in the Python binding 2015-04-27 18:24:21 +00:00
krasimir
fc4b39d65f make linearizeAll in the Haskell binding lazy 2015-04-27 16:28:45 +00:00
prasanth.kolachina
8efff76703 K translations in pipeline 2015-04-27 15:59:49 +00:00
prasanth.kolachina
53f0307404 K Linearizations 2015-04-27 15:59:25 +00:00
prasanth.kolachina
dedad558a8 Python linearizeAll with lazyness
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant 
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
9b723af995 remove parsing for long sentences, to stop pipeline from crashing/hanging 2015-04-27 13:05:14 +00:00
prasant.kolachina
2555891654 bug fix in python examples 2015-04-26 11:00:17 +00:00
prasant.kolachina
3ec571b03d bug fix python examples 2015-04-26 10:18:21 +00:00
prasant.kolachina
aa79f6bb28 Bug fix python examples 2015-04-26 10:16:23 +00:00
prasanth.kolachina
c17501540a Changes in lexer 2015-04-26 07:44:18 +00:00
prasanth.kolachina
100c583916 Bug fix in gf_utils 2015-04-24 18:46:03 +00:00
prasanth.kolachina
7d876fd665 No debug messages 2015-04-22 18:51:55 +00:00
prasanth.kolachina
12216449e0 Minor bug in pgf parse and kparse 2015-04-22 18:49:49 +00:00
prasanth.kolachina
57006b6296 README for Python translation pipeline 2015-04-22 13:14:26 +00:00
prasanth.kolachina
c3a626686e Cleaned up Python Translation pipeline 2015-04-22 11:30:26 +00:00
prasanth.kolachina
2b1b0568a1 Examples for using Python bindings
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
2804160f07 some translate.probs decreased ; fine-tuning in pgf-hsbind-trans 2015-04-21 14:13:13 +00:00
krasimir
27bd12ce67 forgot to update gf.cabal 2015-04-20 12:25:52 +00:00
krasimir
8c697b72a4 drop the dependency to FST 2015-04-20 11:56:13 +00:00
krasimir
5d7633fdb4 added getpagesize() definition for Windows 2015-04-20 09:57:28 +00:00
krasimir
aebc868c22 fix in the Haskell binding for Windows 2015-04-20 09:55:15 +00:00
aarne
0add1bdb20 pgf-hsbind-trans now with linearizeAll 2015-04-17 14:33:28 +00:00
hallgren
78a34bc52b pgf-shell.hs: remove call to performGC and document the 'i' command 2015-04-17 13:34:41 +00:00
hallgren
3263968c79 gf -server: include grammar modification time in the info returned by /version 2015-04-17 13:21:20 +00:00
hallgren
9e3afea129 PGF web service: add command c-linearizeAll to obtain all variants
Implemented by calling the recently added function PGF2.linearizeAll.
2015-04-17 12:59:03 +00:00
krasimir
86e16d9e3d added linearizeAll in the Haskell bindings 2015-04-17 12:33:22 +00:00
krasimir
4221757895 bugfix in the java binding 2015-04-16 13:53:03 +00:00
aarne
a5305f1d9f simplified the example translator and renamed it to pgf-hsbind-trans 2015-04-16 13:51:18 +00:00
hallgren
1420e35cbb Wide Coverage Translation Demo: length limit test uses # of source chars now
The length limit test previously used the URL-encoded UTF-8 representation
of the source sentense. This was needed because of a fixed size buffer in C.
Now that the server is in Haskell, the only reason the length is limited
is to avoid excessive time and space use in the parser, so it is better to
count source characters. This also avoids being too restrictive with
non-European languages.
2015-04-16 12:21:32 +00:00
aarne
2ceeea17fd lower probability for chunked phrases 2015-04-16 11:39:28 +00:00
aarne
e2175a31ce restored Cantonese as app Chi speech output: nothing else seems to work 2015-04-16 06:52:09 +00:00
aarne
b908b2ba3f extended pgf-shell functionalities: batch translation with many trees, and intervening context-dependent tree manipulation 2015-04-15 15:53:44 +00:00
hallgren
8cfb989c9c Translating linearization functions to Haskell: move Haskell AST and pretty printer to GF.Haskell
For further separation of pretty printing concerns from conversion concerns,
the Haskell AST and pretty printer has been moved to its own module,
GF.Haskell, also allowing it to be reused in other places where Haskell
code is generated.
2015-04-14 12:44:14 +00:00
aarne
9aeffa15c9 updated app help file ; added backslash to ? in Thai keyboard xml to make it compile 2015-04-13 09:45:05 +00:00
hallgren
71de9a26ef Wide coverage translation demo: show an informative error message for sentences that exceed the length limit 2015-04-09 10:18:41 +00:00
hallgren
d249538469 GF.Compile.ConcreteToHaskell: some documentation 2015-04-07 14:51:52 +00:00
hallgren
6e81383231 GF.CompileInParallel: get rid of the cryptic 'thread blocked indefinitely in an MVar operation' message after compilation errors
Instead show a message saying how many modules were affected by the compilation
errors.
2015-03-31 13:26:51 +00:00
hallgren
12f5dc9ece Wide Coverage Translation Demo: zoomable panable collapsible syntax trees
This is an experimental solution using JavaScript code from
https://github.com/christos-c/tree-viewer, d3js.org and jquery.com.
2015-03-24 18:03:10 +00:00
hallgren
6d72126ffc PGF Service: add an option to return syntax trees in JSON format
The parse/translate/c-parse/c-translate commands now recognize the option
jsontree=true to augment the returned JSON structure with a field called
"jsontree" next to the field "tree", or "jsontrees" next to "trees",
containing the the returned syntax tree in JSON format (the same format
returned by the abstrjson command, similar to the format returned in the
"brackets" field).
2015-03-24 17:37:43 +00:00
hallgren
2041578406 Wide Coverage Translation Demo: add a way to obtain inflection tables
Too see inflection tables, click on a translated sentense, then click on a
blue function name in the textual representation of the abstract syntax tree.
2015-03-22 22:54:05 +00:00
hallgren
e475fb1091 Wide Coverage Translation Demo: draw abstract trees and parse trees
You can now click on a tree to toggle between the abstract syntax tree and
the parse tree.

Also, the implementation now uses the new C run-time requests, e.g.

	App14.pgf?command=c-abstrtree&tree=...

so no need to install AppEng.pgf on the server any more.
2015-03-19 15:26:18 +00:00
hallgren
5db57b1a58 PGF service: add commands c-abstrtree and c-parsetree
These are the C runtime variants of the absttree and parsetree commands. They
work in the same way, but support fewer rendering options.
2015-03-19 14:17:45 +00:00