Commit Graph

969 Commits

Author SHA1 Message Date
krasimir
815d1f441f bugfix in the NERC in C 2015-05-18 15:02:44 +00:00
krasimir
3ebadcbc3b the callbacks in C now take the concrete syntax as a parameter 2015-05-18 14:41:33 +00:00
krasimir
8cfd46b9bb pgf_lookup_morpho and pgf_lookup_word_prefix are now also case insensitive if case_sensitive=off 2015-05-18 14:20:35 +00:00
krasimir
472a95a844 "flags case_sensitive=off" makes the parser case insensitive 2015-05-11 14:11:42 +00:00
krasimir
3d502a76b3 added all orthographic primitives 2015-05-11 13:01:39 +00:00
krasimir
949310ef1b implemented CAPIT in parsing 2015-05-08 18:54:50 +00:00
krasimir
7ee9edd080 fix in the dictionary lookup 2015-05-08 18:12:24 +00:00
krasimir
b87ed432a5 a new nice and elegant algorithm for dictionary lookup in the parser 2015-05-08 14:38:24 +00:00
krasimir
e600eb764a the parser is now fully Unicode compatible 2015-05-08 09:23:29 +00:00
krasimir
5b60c3a00e fix gu_ucs_is_space in libgu 2015-05-07 15:50:55 +00:00
krasimir
6eb15eb585 fix the NERC in C to work for PN as literal 2015-05-07 15:16:55 +00:00
krasimir
4ae661e19e fix pgf-translate to use the NERC again 2015-05-07 14:49:30 +00:00
krasimir
77f14f3cc8 fix the UTF8 implementation in libgu 2015-05-06 15:51:12 +00:00
krasimir
e83d2b590b use a temporary pool for linearizeAll in Haskell too 2015-04-27 19:39:16 +00:00
krasimir
be8302febe fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant 2015-04-27 19:27:11 +00:00
krasimir
b115b97718 fix warning in the Python binding 2015-04-27 18:33:18 +00:00
krasimir
add8c83d93 mark two more functions as static in the Python binding 2015-04-27 18:24:21 +00:00
krasimir
57704a1b51 make linearizeAll in the Haskell binding lazy 2015-04-27 16:28:45 +00:00
prasanth.kolachina
93ab6c79d4 K translations in pipeline 2015-04-27 15:59:49 +00:00
prasanth.kolachina
fd566e123a K Linearizations 2015-04-27 15:59:25 +00:00
prasanth.kolachina
a82d8c9ea6 Python linearizeAll with lazyness
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant 
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
e9474e2a3f remove parsing for long sentences, to stop pipeline from crashing/hanging 2015-04-27 13:05:14 +00:00
prasant.kolachina
beedd6dbb7 bug fix in python examples 2015-04-26 11:00:17 +00:00
prasant.kolachina
20a234521e bug fix python examples 2015-04-26 10:18:21 +00:00
prasant.kolachina
db2d012fe5 Bug fix python examples 2015-04-26 10:16:23 +00:00
prasanth.kolachina
c43af4d991 Changes in lexer 2015-04-26 07:44:18 +00:00
prasanth.kolachina
c921136a9b Bug fix in gf_utils 2015-04-24 18:46:03 +00:00
prasanth.kolachina
98bfbd8d60 No debug messages 2015-04-22 18:51:55 +00:00
prasanth.kolachina
a57b9b9275 Minor bug in pgf parse and kparse 2015-04-22 18:49:49 +00:00
prasanth.kolachina
b18669992d README for Python translation pipeline 2015-04-22 13:14:26 +00:00
prasanth.kolachina
6ad6763a7f Cleaned up Python Translation pipeline 2015-04-22 11:30:26 +00:00
prasanth.kolachina
4c103be4de Examples for using Python bindings
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
f0f1748360 some translate.probs decreased ; fine-tuning in pgf-hsbind-trans 2015-04-21 14:13:13 +00:00
krasimir
61e37c9e5e drop the dependency to FST 2015-04-20 11:56:13 +00:00
krasimir
79b710a6b7 added getpagesize() definition for Windows 2015-04-20 09:57:28 +00:00
krasimir
bfc2df3d04 fix in the Haskell binding for Windows 2015-04-20 09:55:15 +00:00
aarne
168e6a04d8 pgf-hsbind-trans now with linearizeAll 2015-04-17 14:33:28 +00:00
hallgren
54b69e25ea pgf-shell.hs: remove call to performGC and document the 'i' command 2015-04-17 13:34:41 +00:00
krasimir
a76ea1a99b added linearizeAll in the Haskell bindings 2015-04-17 12:33:22 +00:00
krasimir
5754848626 bugfix in the java binding 2015-04-16 13:53:03 +00:00
aarne
3ddbc44789 simplified the example translator and renamed it to pgf-hsbind-trans 2015-04-16 13:51:18 +00:00
aarne
23992d412d extended pgf-shell functionalities: batch translation with many trees, and intervening context-dependent tree manipulation 2015-04-15 15:53:44 +00:00
hallgren
40c431ec6c PGF Service: add an option to return syntax trees in JSON format
The parse/translate/c-parse/c-translate commands now recognize the option
jsontree=true to augment the returned JSON structure with a field called
"jsontree" next to the field "tree", or "jsontrees" next to "trees",
containing the the returned syntax tree in JSON format (the same format
returned by the abstrjson command, similar to the format returned in the
"brackets" field).
2015-03-24 17:37:43 +00:00
hallgren
fac915e783 haskell-bind: add bindings to graphviz rendering functions for abstract&parse trees 2015-03-19 14:14:30 +00:00
krasimir
7c24ce9758 fix the compilation of gu/mem.c on Windows. For now memory mapped pools on Windows are just not supported. 2015-03-19 09:28:31 +00:00
krasimir
35c4b5f3eb remove the meta_item variable from the parse state 2015-03-06 15:18:50 +00:00
krasimir
0764d518c7 fix some out-of-date code for the PGF_RESULT_DEBUG mode in the parser 2015-02-26 13:31:26 +00:00
krasimir
42908bd95f use the same trick for comparison of doubles in cmp_expr_state 2015-02-26 13:10:01 +00:00
krasimir
dfd69d5d4b bugfix in the parser which caused some items to be poped in the wrong order if their probability differ with less that 0.5 2015-02-26 12:17:59 +00:00
krasimir
79a7ae6553 remove three more uses of meta productions that were left in debugging mode 2015-02-24 10:59:18 +00:00