GitHub/gf-core
1
0
Fork 1
mirror of https://github.com/GrammaticalFramework/gf-core.git synced 2026-04-12 14:29:31 -06:00
Code Issues Packages Projects Releases Wiki Activity
7,581 Commits 21 Branches 11 Tags
938d97fad55800d16d69fbbff884309bbbf31fa1
Commit Graph

7581 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
kr.angelov
938d97fad5 cleanup in LangBul 2013-11-29 13:55:46 +00:00
kr.angelov
4ae1a16a1e added caching to be able to quickly generate the inflection table for Finnish 2013-11-28 22:06:55 +00:00
hallgren
134f6a200f examples/foods: remove all -path flags 
All languages n the Foods grammar compile fine with alltenses.
 2013-11-29 13:03:19 +00:00
aarne
3d5f1afde6 added forms to Finnish xml table 2013-11-29 08:21:00 +00:00
aarne
e903f85a90 some missing forms in Fin (agent participle, Inf3 instructives); now also in stemmed version. 2013-11-29 08:05:55 +00:00
aarne
86937017cd html templates for Finnish noun and verb inflection started 2013-11-28 22:04:30 +00:00
aarne
ece03aca51 added some esoteric verb forms to Fin (not used in resource API but nice to show): potential, passive imperatives, infinitives 2,4,5. Remains to carry out in stemmed/StemFin. 2013-11-28 22:01:38 +00:00
kr.angelov
945650f653 bugfix in the android app 2013-11-28 20:00:17 +00:00
kr.angelov
1c75721871 now the TTS is used only if there is actually a language model. this is better than using English for speaking Swedish 2013-11-28 19:59:03 +00:00
kr.angelov
442b5fb305 a bit of cleanup in the Android app 2013-11-28 19:57:45 +00:00
kr.angelov
953ae7e76d extension in the template format for inflection tables. This makes it possible to use the templates with Finish 2013-11-28 19:52:31 +00:00
hallgren
dcf07aaad6 GFI: adapt to character encoding changes 
GF.Compile.Coding is not used any more.
 2013-11-28 13:55:08 +00:00
hallgren
4ef30ca450 SimpleEditor.Convert: adapt to recent character encoding changes 
Things got simpler!
 2013-11-28 13:27:45 +00:00
aarne
6c0498c479 changed annotations in DictEngFin: --UNCHK for unchecked entries, ---ARB for arbitrary choices that should be treated by separating senses; many other old annotations suppressed, but most informative ones preserved 2013-11-28 13:27:12 +00:00
kr.angelov
99ac055997 fixes in the dictionaries 2013-11-28 13:16:03 +00:00
kr.angelov
35580255c3 the Android App now show the valency patterns for verbs in English, Bulgarian and Swedish 2013-11-28 12:48:55 +00:00
aarne
ab90b3c7ef added linref's to Ger Hin Romance 2013-11-28 08:05:58 +00:00
aarne
6401a37e21 Translate grammar for Ger and Hin added. Some functions in Ger phrasebook need to be commented out to compile. Now a system for 7 languages can be built, but including Fre as well is too heavy on my laptop although it can be compiled separately. 2013-11-28 08:03:50 +00:00
kr.angelov
f49a8df60c changes in the parallel dictionaries 2013-11-27 22:18:22 +00:00
kr.angelov
9de4812482 better dictionary visualization in the Android App 2013-11-27 22:16:05 +00:00
aarne
848573afdc 555 new words checked in DictEngFin; latin1 flags in some esoteric files 2013-11-27 19:22:37 +00:00
hallgren
7215991e9b Adding an alternate style for the GF home page 2013-11-27 15:32:25 +00:00
kr.angelov
38b4a88c2b minor tweaks in the Android UI 2013-11-27 12:37:55 +00:00
kr.angelov
105071d11e fix the character encoding problem in the web view in the Android UI 2013-11-27 12:37:15 +00:00
kr.angelov
3509a8d4cc added API in the C runtime and the Java binding for checking whether a given function is linearizable in a given language. This is used in the Android UI for better vizualizations 2013-11-27 12:35:11 +00:00
kr.angelov
e68067a83c update the project files for the Java binding 2013-11-27 12:34:33 +00:00
kr.angelov
085808513d space leak in the Java binding 2013-11-27 12:34:06 +00:00
hallgren
a617e50d95 Represent identifiers as UTF-8-encoded ByteStrings 
This was a fairly simple change thanks to previous work on making the Ident
type abstract and the fact that PGF.CId already uses UTF-8-encoded
ByteStrings.

One potential pitfall is that Data.ByteString.UTF8 uses the same type for
ByteStrings as Data.ByteString. I renamed ident2bs to ident2utf8 and
bsCId to utf8CId, to make it clearer that they work with UTF-8-encoded
ByteStrings.

Since both the compiler input and identifiers are now UTF-8-encoded
ByteStrings, the lexer now creates identifiers without copying any characters.
**END OF DESCRIPTION***

Place the long patch description above the ***END OF DESCRIPTION*** marker.
The first line of this file will be the patch name.


This patch contains the following changes:

M ./src/compiler/GF/Compile/CheckGrammar.hs -3 +3
M ./src/compiler/GF/Compile/GrammarToPGF.hs -2 +2
M ./src/compiler/GF/Grammar/Binary.hs -5 +1
M ./src/compiler/GF/Grammar/Lexer.x -11 +13
M ./src/compiler/GF/Infra/Ident.hs -19 +36
M ./src/runtime/haskell/PGF.hs -1 +1
M ./src/runtime/haskell/PGF/CId.hs -2 +3
 2013-11-26 16:12:03 +00:00
hallgren
30fc46e934 Change how GF deals with character encodings in grammar files 
1. The default encoding is changed from Latin-1 to UTF-8.

2. Alternate encodings should be specified as "--# -coding=enc", the old
   "flags coding=enc" declarations have no effect but are still checked for
   consistency.

3. A transitional warning is generated for files that contain non-ASCII
   characters without specifying a character encoding:

	"Warning: default encoding has changed from Latin-1 to UTF-8"

4. Conversion to Unicode is now done *before* lexing. This makes it possible
   to allow arbitrary Unicode characters in identifiers. But identifiers are
   still stored as ByteStrings, so they are limited to Latin-1 characters
   for now.

5. Lexer.hs is no longer part of the repository. We now generate the lexer
   from Lexer.x with alex>=3. Some workarounds for bugs in alex-3.0 were
   needed. These bugs might already be fixed in newer versions of alex, but
   we should be compatible with what is shipped in the Haskell Platform.
 2013-11-25 21:12:11 +00:00
hallgren
1ae58146cd examples/phrasebook: add Makefile2 for parallel grammar compilation 
Makefile2 specificies the dependencies accurately enough that you can use
make's support for parallel compilation. Run

	make -f Makefile2 -j

to utilize all the cores in your computer to significantly speed up the
creation of Phrasebook.pgf.
 2013-11-26 16:32:38 +00:00
hallgren
d55a3f9d6e examples/letter: convert grammar files to UTF-8 2013-11-26 12:52:05 +00:00
kr.angelov
c247aa6791 added translations of outside in DictEngBul 2013-11-26 10:24:32 +00:00
hallgren
1735dcf055 GF home page: mention upcoming default character encoding change 2013-11-25 20:11:11 +00:00
hallgren
06ed4cc263 Setup.hs: avoid a problem with Cabal-1.18 
In Cabal-1.18, the build command takes some new arguments. The Setup.hs script
should not die if these are present.
 2013-11-25 20:03:57 +00:00
hallgren
7d54466310 Document the upcoming default character encoding change in the release notes 2013-11-25 19:47:05 +00:00
hallgren
fc2f5b0a1a Add explicit character encoding specifications in 39 more RGL modules 
To silence warnings and avoid potential problems after changing the default
encoding to UTF-8.
 2013-11-25 18:17:12 +00:00
kr.angelov
1c34005ffc a few words in DictEngBul.gf 2013-11-25 10:40:23 +00:00
hallgren
b237996eb3 examples/phrasebook: adding --# -coding=latin1 to 18 modules 
Adding coding pragmas
  
	--# -coding=latin1
    
so that grammars will continue to work when we change the default character
encoding to UTF-8.
 2013-11-22 17:47:50 +00:00
hallgren
a24d8a9506 lib/src: adding --# -coding=latin1 to 119 RGL modules 
Adding coding pragmas
  
	--# -coding=latin1
  
so that grammars will continue to work when we change the default character
encoding to UTF-8.
 2013-11-22 17:26:00 +00:00
hallgren
1272015873 examples/foods: add --# -coding=latin1 
Adding coding pragmas

	--# -coding=latin1

so that grammars will continue to work when we change the default character
encoding to UTF-8.
 2013-11-22 17:21:36 +00:00
kr.angelov
210a813d1c fix in the GF keyboard for Android 2013-11-22 13:37:12 +00:00
kr.angelov
c119627dfc fix the export for CFG grammars with BIND, SOFT_BIND and nonExist 2013-11-22 13:36:14 +00:00
kr.angelov
4254b101f4 the GF syntax for identifiers is exteded with quoted forms, i.e. you could write for instance 'ab.c' and then everything between the quites is identifier. This includes Unicode characters and non-ASCII symbols. This is useful for automatically generated GF grammars. 2013-11-22 13:30:18 +00:00
kr.angelov
cddc19a5ad bugfix in the debug mode for the parser 2013-11-22 12:26:49 +00:00
hallgren
14bbbf1f27 Some refactoring in GF.Compile and GF.Compile.GetGrammar 
Move source transcoding function GF.Compile to GF.Compile.GetGrammar, in
preparation for doing transcoding before lexing.
 2013-11-21 16:27:26 +00:00
hallgren
c8d2ed96fd Some more monadic lifting changes 2013-11-21 15:01:04 +00:00
kr.angelov
e77c19c783 bugfix in the C runtime 2013-11-21 14:31:28 +00:00
kr.angelov
85e238f824 the Java binding for lookupMorpho should release the local references created in a loop 2013-11-21 14:29:47 +00:00
gregoire.detrez
2f877b760b Add a small readme to the rgl test suite 2013-11-21 10:32:26 +00:00
gregoire.detrez
e63e8d9765 Add a test runner and a test suite fore the rgl 
The test suite tests the French Bescherelle paradigms.
 2013-11-21 09:55:30 +00:00