1
0
forked from GitHub/gf-core
Commit Graph

878 Commits

Author SHA1 Message Date
krasimir
51c13f7aac bugfix in the bottom-up prediction for the parser 2015-06-25 09:46:43 +00:00
hallgren
71c037b4df runtime/c/pf/jit.c: silence warning about alloca on MINGW32 2015-06-23 15:49:31 +00:00
hallgren
5390f6a862 Bump version of .gfo and .pgf files, improve error messages on version mismatch
Becacuse of the new special tokens added to the Symbol type, .gfo and .pgf
files produced with the current version of GF can not always be used with
older versions of GF and the PGF run-time system.

The PGF version number was increased from (2,0) to (2,1). GF can still
read version (2,0) and (1,0), so old PGF files continue to work.

The GFO version was increased from "GF03" to "GF04".
2015-06-23 12:58:14 +00:00
krasimir
1d5043bde2 forgot changes in the serialization in the Haskell runtime 2015-06-17 12:58:46 +00:00
krasimir
324cdffc26 the orthographic tokens were broken when they appear inside a dictionary entry. Now this is fixed by treating those as syntactic rules 2015-06-12 13:03:19 +00:00
krasimir
0804f386ff fixed typo in the Haskell runtime 2015-06-11 07:41:28 +00:00
krasimir
aa87b0d272 print error message for missing abstract categories in the C runtime 2015-06-05 07:41:59 +00:00
krasimir
121fe53968 added callback in C for unknown words 2015-05-19 09:15:48 +00:00
krasimir
4347ce727a the NERC in C is now fully up-to-date with the other NERCs. In addition the NERC in Haskell and Java now refuses to recognize names that match words in the lexicon. The latest is useful for German 2015-05-19 07:26:56 +00:00
krasimir
815d1f441f bugfix in the NERC in C 2015-05-18 15:02:44 +00:00
krasimir
3ebadcbc3b the callbacks in C now take the concrete syntax as a parameter 2015-05-18 14:41:33 +00:00
krasimir
8cfd46b9bb pgf_lookup_morpho and pgf_lookup_word_prefix are now also case insensitive if case_sensitive=off 2015-05-18 14:20:35 +00:00
krasimir
472a95a844 "flags case_sensitive=off" makes the parser case insensitive 2015-05-11 14:11:42 +00:00
krasimir
3d502a76b3 added all orthographic primitives 2015-05-11 13:01:39 +00:00
krasimir
949310ef1b implemented CAPIT in parsing 2015-05-08 18:54:50 +00:00
krasimir
7ee9edd080 fix in the dictionary lookup 2015-05-08 18:12:24 +00:00
krasimir
b87ed432a5 a new nice and elegant algorithm for dictionary lookup in the parser 2015-05-08 14:38:24 +00:00
krasimir
e600eb764a the parser is now fully Unicode compatible 2015-05-08 09:23:29 +00:00
krasimir
5b60c3a00e fix gu_ucs_is_space in libgu 2015-05-07 15:50:55 +00:00
krasimir
6eb15eb585 fix the NERC in C to work for PN as literal 2015-05-07 15:16:55 +00:00
krasimir
4ae661e19e fix pgf-translate to use the NERC again 2015-05-07 14:49:30 +00:00
krasimir
77f14f3cc8 fix the UTF8 implementation in libgu 2015-05-06 15:51:12 +00:00
krasimir
e83d2b590b use a temporary pool for linearizeAll in Haskell too 2015-04-27 19:39:16 +00:00
krasimir
be8302febe fix a memory management error in linearizeAll in the python binding. a new temporary pool is used on every iteration to keep memory allocation to constant 2015-04-27 19:27:11 +00:00
krasimir
b115b97718 fix warning in the Python binding 2015-04-27 18:33:18 +00:00
krasimir
add8c83d93 mark two more functions as static in the Python binding 2015-04-27 18:24:21 +00:00
krasimir
57704a1b51 make linearizeAll in the Haskell binding lazy 2015-04-27 16:28:45 +00:00
prasanth.kolachina
93ab6c79d4 K translations in pipeline 2015-04-27 15:59:49 +00:00
prasanth.kolachina
fd566e123a K Linearizations 2015-04-27 15:59:25 +00:00
prasanth.kolachina
a82d8c9ea6 Python linearizeAll with lazyness
linearizeAll function will take an expression and an optional
n keyword argument and return an iterator to the n-variant 
linearizations of the expression.
2015-04-27 15:47:57 +00:00
prasant.kolachina
e9474e2a3f remove parsing for long sentences, to stop pipeline from crashing/hanging 2015-04-27 13:05:14 +00:00
prasant.kolachina
beedd6dbb7 bug fix in python examples 2015-04-26 11:00:17 +00:00
prasant.kolachina
20a234521e bug fix python examples 2015-04-26 10:18:21 +00:00
prasant.kolachina
db2d012fe5 Bug fix python examples 2015-04-26 10:16:23 +00:00
prasanth.kolachina
c43af4d991 Changes in lexer 2015-04-26 07:44:18 +00:00
prasanth.kolachina
c921136a9b Bug fix in gf_utils 2015-04-24 18:46:03 +00:00
prasanth.kolachina
98bfbd8d60 No debug messages 2015-04-22 18:51:55 +00:00
prasanth.kolachina
a57b9b9275 Minor bug in pgf parse and kparse 2015-04-22 18:49:49 +00:00
prasanth.kolachina
b18669992d README for Python translation pipeline 2015-04-22 13:14:26 +00:00
prasanth.kolachina
6ad6763a7f Cleaned up Python Translation pipeline 2015-04-22 11:30:26 +00:00
prasanth.kolachina
4c103be4de Examples for using Python bindings
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
f0f1748360 some translate.probs decreased ; fine-tuning in pgf-hsbind-trans 2015-04-21 14:13:13 +00:00
krasimir
61e37c9e5e drop the dependency to FST 2015-04-20 11:56:13 +00:00
krasimir
79b710a6b7 added getpagesize() definition for Windows 2015-04-20 09:57:28 +00:00
krasimir
bfc2df3d04 fix in the Haskell binding for Windows 2015-04-20 09:55:15 +00:00
aarne
168e6a04d8 pgf-hsbind-trans now with linearizeAll 2015-04-17 14:33:28 +00:00
hallgren
54b69e25ea pgf-shell.hs: remove call to performGC and document the 'i' command 2015-04-17 13:34:41 +00:00
krasimir
a76ea1a99b added linearizeAll in the Haskell bindings 2015-04-17 12:33:22 +00:00
krasimir
5754848626 bugfix in the java binding 2015-04-16 13:53:03 +00:00
aarne
3ddbc44789 simplified the example translator and renamed it to pgf-hsbind-trans 2015-04-16 13:51:18 +00:00