krasimir
51c13f7aac
bugfix in the bottom-up prediction for the parser
2015-06-25 09:46:43 +00:00
hallgren
71c037b4df
runtime/c/pf/jit.c: silence warning about alloca on MINGW32
2015-06-23 15:49:31 +00:00
hallgren
5390f6a862
Bump version of .gfo and .pgf files, improve error messages on version mismatch
...
Becacuse of the new special tokens added to the Symbol type, .gfo and .pgf
files produced with the current version of GF can not always be used with
older versions of GF and the PGF run-time system.
The PGF version number was increased from (2,0) to (2,1). GF can still
read version (2,0) and (1,0), so old PGF files continue to work.
The GFO version was increased from "GF03" to "GF04".
2015-06-23 12:58:14 +00:00
krasimir
1d5043bde2
forgot changes in the serialization in the Haskell runtime
2015-06-17 12:58:46 +00:00
krasimir
324cdffc26
the orthographic tokens were broken when they appear inside a dictionary entry. Now this is fixed by treating those as syntactic rules
2015-06-12 13:03:19 +00:00
krasimir
0804f386ff
fixed typo in the Haskell runtime
2015-06-11 07:41:28 +00:00
krasimir
aa87b0d272
print error message for missing abstract categories in the C runtime
2015-06-05 07:41:59 +00:00
krasimir
121fe53968
added callback in C for unknown words
2015-05-19 09:15:48 +00:00
krasimir
4347ce727a
the NERC in C is now fully up-to-date with the other NERCs. In addition the NERC in Haskell and Java now refuses to recognize names that match words in the lexicon. The latest is useful for German
2015-05-19 07:26:56 +00:00
krasimir
815d1f441f
bugfix in the NERC in C
2015-05-18 15:02:44 +00:00
krasimir
3ebadcbc3b
the callbacks in C now take the concrete syntax as a parameter
2015-05-18 14:41:33 +00:00
krasimir
8cfd46b9bb
pgf_lookup_morpho and pgf_lookup_word_prefix are now also case insensitive if case_sensitive=off
2015-05-18 14:20:35 +00:00
krasimir
472a95a844
"flags case_sensitive=off" makes the parser case insensitive
2015-05-11 14:11:42 +00:00
krasimir
3d502a76b3
added all orthographic primitives
2015-05-11 13:01:39 +00:00
krasimir
949310ef1b
implemented CAPIT in parsing
2015-05-08 18:54:50 +00:00
krasimir
7ee9edd080
fix in the dictionary lookup
2015-05-08 18:12:24 +00:00
krasimir
b87ed432a5
a new nice and elegant algorithm for dictionary lookup in the parser
2015-05-08 14:38:24 +00:00
krasimir
e600eb764a
the parser is now fully Unicode compatible
2015-05-08 09:23:29 +00:00
krasimir
5b60c3a00e
fix gu_ucs_is_space in libgu
2015-05-07 15:50:55 +00:00
krasimir
6eb15eb585
fix the NERC in C to work for PN as literal
2015-05-07 15:16:55 +00:00
krasimir
4ae661e19e
fix pgf-translate to use the NERC again
2015-05-07 14:49:30 +00:00
krasimir
77f14f3cc8
fix the UTF8 implementation in libgu
2015-05-06 15:51:12 +00:00
krasimir
e83d2b590b
use a temporary pool for linearizeAll in Haskell too
2015-04-27 19:39:16 +00:00
krasimir
be8302febe
fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant
2015-04-27 19:27:11 +00:00
krasimir
b115b97718
fix warning in the Python binding
2015-04-27 18:33:18 +00:00
krasimir
add8c83d93
mark two more functions as static in the Python binding
2015-04-27 18:24:21 +00:00
krasimir
57704a1b51
make linearizeAll in the Haskell binding lazy
2015-04-27 16:28:45 +00:00
prasanth.kolachina
93ab6c79d4
K translations in pipeline
2015-04-27 15:59:49 +00:00
prasanth.kolachina
fd566e123a
K Linearizations
2015-04-27 15:59:25 +00:00
prasanth.kolachina
a82d8c9ea6
Python linearizeAll with lazyness
...
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
e9474e2a3f
remove parsing for long sentences, to stop pipeline from crashing/hanging
2015-04-27 13:05:14 +00:00
prasant.kolachina
beedd6dbb7
bug fix in python examples
2015-04-26 11:00:17 +00:00
prasant.kolachina
20a234521e
bug fix python examples
2015-04-26 10:18:21 +00:00
prasant.kolachina
db2d012fe5
Bug fix python examples
2015-04-26 10:16:23 +00:00
prasanth.kolachina
c43af4d991
Changes in lexer
2015-04-26 07:44:18 +00:00
prasanth.kolachina
c921136a9b
Bug fix in gf_utils
2015-04-24 18:46:03 +00:00
prasanth.kolachina
98bfbd8d60
No debug messages
2015-04-22 18:51:55 +00:00
prasanth.kolachina
a57b9b9275
Minor bug in pgf parse and kparse
2015-04-22 18:49:49 +00:00
prasanth.kolachina
b18669992d
README for Python translation pipeline
2015-04-22 13:14:26 +00:00
prasanth.kolachina
6ad6763a7f
Cleaned up Python Translation pipeline
2015-04-22 11:30:26 +00:00
prasanth.kolachina
4c103be4de
Examples for using Python bindings
...
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
f0f1748360
some translate.probs decreased ; fine-tuning in pgf-hsbind-trans
2015-04-21 14:13:13 +00:00
krasimir
61e37c9e5e
drop the dependency to FST
2015-04-20 11:56:13 +00:00
krasimir
79b710a6b7
added getpagesize() definition for Windows
2015-04-20 09:57:28 +00:00
krasimir
bfc2df3d04
fix in the Haskell binding for Windows
2015-04-20 09:55:15 +00:00
aarne
168e6a04d8
pgf-hsbind-trans now with linearizeAll
2015-04-17 14:33:28 +00:00
hallgren
54b69e25ea
pgf-shell.hs: remove call to performGC and document the 'i' command
2015-04-17 13:34:41 +00:00
krasimir
a76ea1a99b
added linearizeAll in the Haskell bindings
2015-04-17 12:33:22 +00:00
krasimir
5754848626
bugfix in the java binding
2015-04-16 13:53:03 +00:00
aarne
3ddbc44789
simplified the example translator and renamed it to pgf-hsbind-trans
2015-04-16 13:51:18 +00:00