1
0
forked from GitHub/gf-core
Commit Graph

847 Commits

Author SHA1 Message Date
prasant.kolachina
beedd6dbb7 bug fix in python examples 2015-04-26 11:00:17 +00:00
prasant.kolachina
20a234521e bug fix python examples 2015-04-26 10:18:21 +00:00
prasant.kolachina
db2d012fe5 Bug fix python examples 2015-04-26 10:16:23 +00:00
prasanth.kolachina
c43af4d991 Changes in lexer 2015-04-26 07:44:18 +00:00
prasanth.kolachina
c921136a9b Bug fix in gf_utils 2015-04-24 18:46:03 +00:00
prasanth.kolachina
98bfbd8d60 No debug messages 2015-04-22 18:51:55 +00:00
prasanth.kolachina
a57b9b9275 Minor bug in pgf parse and kparse 2015-04-22 18:49:49 +00:00
prasanth.kolachina
b18669992d README for Python translation pipeline 2015-04-22 13:14:26 +00:00
prasanth.kolachina
6ad6763a7f Cleaned up Python Translation pipeline 2015-04-22 11:30:26 +00:00
prasanth.kolachina
4c103be4de Examples for using Python bindings
The examples directory contains two modules for using Python bindings in GF.
The gf_utils module provides various Python functions to perform parsing
and linearization using the C runtime. Additionally, the translation_pipeline
module is an replica of the current pipeline used in the Wide-coverage
Web translation pipeline.
2015-04-22 07:04:21 +00:00
aarne
f0f1748360 some translate.probs decreased ; fine-tuning in pgf-hsbind-trans 2015-04-21 14:13:13 +00:00
krasimir
61e37c9e5e drop the dependency to FST 2015-04-20 11:56:13 +00:00
krasimir
79b710a6b7 added getpagesize() definition for Windows 2015-04-20 09:57:28 +00:00
krasimir
bfc2df3d04 fix in the Haskell binding for Windows 2015-04-20 09:55:15 +00:00
aarne
168e6a04d8 pgf-hsbind-trans now with linearizeAll 2015-04-17 14:33:28 +00:00
hallgren
54b69e25ea pgf-shell.hs: remove call to performGC and document the 'i' command 2015-04-17 13:34:41 +00:00
krasimir
a76ea1a99b added linearizeAll in the Haskell bindings 2015-04-17 12:33:22 +00:00
krasimir
5754848626 bugfix in the java binding 2015-04-16 13:53:03 +00:00
aarne
3ddbc44789 simplified the example translator and renamed it to pgf-hsbind-trans 2015-04-16 13:51:18 +00:00
aarne
23992d412d extended pgf-shell functionalities: batch translation with many trees, and intervening context-dependent tree manipulation 2015-04-15 15:53:44 +00:00
hallgren
40c431ec6c PGF Service: add an option to return syntax trees in JSON format
The parse/translate/c-parse/c-translate commands now recognize the option
jsontree=true to augment the returned JSON structure with a field called
"jsontree" next to the field "tree", or "jsontrees" next to "trees",
containing the the returned syntax tree in JSON format (the same format
returned by the abstrjson command, similar to the format returned in the
"brackets" field).
2015-03-24 17:37:43 +00:00
hallgren
fac915e783 haskell-bind: add bindings to graphviz rendering functions for abstract&parse trees 2015-03-19 14:14:30 +00:00
krasimir
7c24ce9758 fix the compilation of gu/mem.c on Windows. For now memory mapped pools on Windows are just not supported. 2015-03-19 09:28:31 +00:00
krasimir
35c4b5f3eb remove the meta_item variable from the parse state 2015-03-06 15:18:50 +00:00
krasimir
0764d518c7 fix some out-of-date code for the PGF_RESULT_DEBUG mode in the parser 2015-02-26 13:31:26 +00:00
krasimir
42908bd95f use the same trick for comparison of doubles in cmp_expr_state 2015-02-26 13:10:01 +00:00
krasimir
dfd69d5d4b bugfix in the parser which caused some items to be poped in the wrong order if their probability differ with less that 0.5 2015-02-26 12:17:59 +00:00
krasimir
79a7ae6553 remove three more uses of meta productions that were left in debugging mode 2015-02-24 10:59:18 +00:00
krasimir
8664dd80ed implemented escape characters when reading/printing an abstract expression with string literals 2015-02-24 09:35:12 +00:00
krasimir
87c0368281 silence some warnings in GNU Lightning for i386_64 2015-02-19 12:53:52 +00:00
krasimir
2f35aadc6f parsing with meta rules is now removed since we don't use them anymore and I would gladly remove some code. 2015-02-19 11:59:51 +00:00
krasimir
4ff6728993 fix the missmatch between Int and CInt in the Haskell binding to the word alignment API. This was causing problems on 64-bit machines 2015-02-18 17:05:35 +00:00
krasimir
f3f47c7761 fix the callback for unknown words as well 2015-02-18 16:47:33 +00:00
krasimir
4ed41214e5 fix in the callback for names in the Haskell binding 2015-02-18 16:41:13 +00:00
krasimir
27a12ca9fb fix in the parser for callbacks in the middle of a word 2015-02-18 16:14:29 +00:00
hallgren
1dbe588497 Restore compatibility with ghc-7.4
With ghc-7.4 'import M hiding (x)' causes an error if M does not export x...
2015-02-16 15:41:38 +00:00
hallgren
2ce3e954fd Changes for compatibility with ghc-7.10-rc2
2 modules: Name clashes caused by Applicative-Monad change in Prelude
2 modules: Ambiguities caused by Foldable/Traversable in Prelude
2 modules: Backwards incompatible changes in time-1.5 for defaultTimeLocale
9 modules: {-# LANGUAGE FlexibleContexts #-} (because GHC checks inferred types
           now, in addition to explicitly given type signatures)

Also silenced warnings about tab characters in source files.
2015-02-16 15:05:06 +00:00
hallgren
0058a79a8f PGF.Haskell: adding operators for selections from tables 2015-02-12 16:09:33 +00:00
kr.angelov
e6f51d7ec6 fix in the JIT compiler that would hopefully make it work on iOS 2015-02-11 13:07:06 +00:00
hallgren
ad8b6429ec Translating linearization functions to Haskell: support for variants
By adding the flag -haskell=variants to the command line, GF will now generate
linearization functions in Haskell that support variants. Variants are
represented as lists in Haskell.

Variants inside pre { ... } expressions are still ignored.

TODO: apply some monad laws to generate more compact code (using an
intermediate representation of the generated Haskell code, instead of
pretty printing directly from the GF code).
2015-02-09 16:24:33 +00:00
kr.angelov
1baba82fe5 added hasLinearization in the Haskell binding 2015-01-30 13:05:57 +00:00
hallgren
ed502c490c PGF2: fixes for named entity callback function 2015-01-21 13:54:48 +00:00
hallgren
ec8b4fec93 PGF2 & PGFService: enable callbacks for named entities and chunks in the c-parse & c-translate web requests 2015-01-21 10:41:12 +00:00
kr.angelov
60cb95258b fix conflicts 2015-01-21 08:35:20 +00:00
kr.angelov
07eb8fec26 added functionType in the Haskell API to the C runtime 2015-01-20 14:45:02 +00:00
hallgren
7577de236f PGF2 & PGFService: work in progress on callbacks for nerc & chunks 2015-01-20 14:57:52 +00:00
hallgren
4372b47d2a PGF2: introduced some type synonyms to make type signature more readable 2015-01-20 12:57:33 +00:00
hallgren
240ba80209 Translating linearization functions to Haskell: move a common record type to PGF.Haskell
Move the Haskell representation of the common linearization type {s:T} to the
shared module PGF.Haskell, so that the same overloaded projection function
proj_s can be used for all concrete syntaxes.
2015-01-19 12:43:32 +00:00
hallgren
0b114195aa Translating linearization functions to Haskell: better treatment of special tokens
Common code has been lifted out from the generated Haskell modules to
an auxiliary module PGF.Haskell, which is currently included in the
regular PGF library, although it is independent of it and probably belongs
in a separate library.

The type Str used by linearization functions is now based on a token
type Tok, which is defined in PGF.Haskell.

PGF.Haskell.Tok is similar to the type GF.Data.Str.Tok, but it has
constructors for the special tokens BIND, SOFT_BIND and CAPIT, and there is
a function

	fromStr :: Str -> String

that computes the effects of these special tokens.
2015-01-14 14:35:39 +00:00
kr.angelov
6acf100ab1 fix the reference counting for callbacks in Python 2015-01-05 11:24:00 +00:00