mirror of
https://github.com/GrammaticalFramework/gf-core.git
synced 2026-05-24 10:22:50 -06:00
started next version of tutorial
This commit is contained in:
506
doc/intro-resource.txt
Normal file
506
doc/intro-resource.txt
Normal file
@@ -0,0 +1,506 @@
|
|||||||
|
==Coverage==
|
||||||
|
|
||||||
|
The GF Resource Grammar Library contains grammar rules for
|
||||||
|
10 languages (in addition, 2 languages are available as incomplete
|
||||||
|
implementations, and a few more are under construction). Its purpose
|
||||||
|
is to make these rules available for application programmers,
|
||||||
|
who can thereby concentrate on the semantic and stylistic
|
||||||
|
aspects of their grammars, without having to think about
|
||||||
|
grammaticality. The targeted level of application grammarians
|
||||||
|
is that of a skilled programmer with
|
||||||
|
a practical knowledge of the target languages, but without
|
||||||
|
theoretical knowledge about their grammars.
|
||||||
|
Such a combination of
|
||||||
|
skills is typical of programmers who, for instance, want to localize
|
||||||
|
software to new languages.
|
||||||
|
|
||||||
|
The current resource languages are
|
||||||
|
- ``Ara``bic (incomplete)
|
||||||
|
- ``Cat``alan (incomplete)
|
||||||
|
- ``Dan``ish
|
||||||
|
- ``Eng``lish
|
||||||
|
- ``Fin``nish
|
||||||
|
- ``Fre``nch
|
||||||
|
- ``Ger``man
|
||||||
|
- ``Ita``lian
|
||||||
|
- ``Nor``wegian
|
||||||
|
- ``Rus``sian
|
||||||
|
- ``Spa``nish
|
||||||
|
- ``Swe``dish
|
||||||
|
|
||||||
|
|
||||||
|
The first three letters (``Eng`` etc) are used in grammar module names.
|
||||||
|
The incomplete Arabic and Catalan implementations are
|
||||||
|
enough to be used in many applications; they both contain, amoung other
|
||||||
|
things, complete inflectional morphology.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
==A first example==
|
||||||
|
|
||||||
|
To give an example application, consider a system for steering
|
||||||
|
music playing devices by voice commands. In the application,
|
||||||
|
we may have a semantical category ``Kind``, examples
|
||||||
|
of ``Kind``s being ``Song`` and ``Artist``. In German, for instance, ``Song``
|
||||||
|
is linearized into the noun "Lied", but knowing this is not
|
||||||
|
enough to make the application work, because the noun must be
|
||||||
|
produced in both singular and plural, and in four different
|
||||||
|
cases. By using the resource grammar library, it is enough to
|
||||||
|
write
|
||||||
|
```
|
||||||
|
lin Song = mkN "Lied" "Lieder" neuter
|
||||||
|
```
|
||||||
|
and the eight forms are correctly generated. The resource grammar
|
||||||
|
library contains a complete set of inflectional paradigms (such as
|
||||||
|
``mkN`` here), enabling the definition of any lexical items.
|
||||||
|
|
||||||
|
The resource grammar library is not only about inflectional paradigms - it
|
||||||
|
also has syntax rules. The music player application
|
||||||
|
might also want to modify songs with properties, such as "American",
|
||||||
|
"old", "good". The German grammar for adjectival modifications is
|
||||||
|
particularly complex, because adjectives have to agree in gender,
|
||||||
|
number, and case, and also depend on what determiner is used
|
||||||
|
("ein amerikanisches Lied" vs. "das amerikanische Lied"). All this
|
||||||
|
variation is taken care of by the resource grammar function
|
||||||
|
```
|
||||||
|
mkCN : AP -> CN -> CN
|
||||||
|
```
|
||||||
|
(see the table in the end of this document for the list of all resource grammar
|
||||||
|
functions). The resource grammar implementation of the rule adding properties
|
||||||
|
to kinds is
|
||||||
|
```
|
||||||
|
lin PropKind kind prop = mkCN prop kind
|
||||||
|
```
|
||||||
|
given that
|
||||||
|
```
|
||||||
|
lincat Prop = AP
|
||||||
|
lincat Kind = CN
|
||||||
|
```
|
||||||
|
The resource library API is devided into language-specific
|
||||||
|
and language-independent parts. To put it roughly,
|
||||||
|
- the lexicon API is language-specific
|
||||||
|
- the syntax API is language-independent
|
||||||
|
|
||||||
|
|
||||||
|
Thus, to render the above example in French instead of German, we need to
|
||||||
|
pick a different linearization of ``Song``,
|
||||||
|
```
|
||||||
|
lin Song = mkN "chanson" feminine
|
||||||
|
```
|
||||||
|
But to linearize ``PropKind``, we can use the very same rule as in German.
|
||||||
|
The resource function ``mkCN`` has different implementations in the two
|
||||||
|
languages (e.g. a different word order in French),
|
||||||
|
but the application programmer need not care about the difference.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
==Note on APIs==
|
||||||
|
|
||||||
|
From version 1.1 onwards, the resource library is available via two
|
||||||
|
APIs:
|
||||||
|
- original ``fun`` and ``oper`` definitions
|
||||||
|
- overloaded ``oper`` definitions
|
||||||
|
|
||||||
|
|
||||||
|
Introducing overloading in GF version 2.7 has been a success in improving
|
||||||
|
the accessibility of libraries. It has also created a layer of abstraction
|
||||||
|
between the writers and users of libraries, and thereby makes the library
|
||||||
|
easier to modify. We shall therefore use the overloaded API
|
||||||
|
in this document. The original function names are mainly interesting
|
||||||
|
for those who want to write or modify libraries.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
==A complete example==
|
||||||
|
|
||||||
|
To summarize the example, and also give a template for a programmer to work on,
|
||||||
|
here is the complete implementation of a small system with songs and properties.
|
||||||
|
The abstract syntax defines a "domain ontology":
|
||||||
|
```
|
||||||
|
abstract Music = {
|
||||||
|
|
||||||
|
cat
|
||||||
|
Kind,
|
||||||
|
Property ;
|
||||||
|
fun
|
||||||
|
PropKind : Kind -> Property -> Kind ;
|
||||||
|
Song : Kind ;
|
||||||
|
American : Property ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
The concrete syntax is defined by a functor (parametrized module),
|
||||||
|
independently of language, by opening
|
||||||
|
two interfaces: the resource ``Syntax`` and an application lexicon.
|
||||||
|
```
|
||||||
|
incomplete concrete MusicI of Music =
|
||||||
|
open Syntax, MusicLex in {
|
||||||
|
lincat
|
||||||
|
Kind = CN ;
|
||||||
|
Property = AP ;
|
||||||
|
lin
|
||||||
|
PropKind k p = mkCN p k ;
|
||||||
|
Song = mkCN song_N ;
|
||||||
|
American = mkAP american_A ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
The application lexicon ``MusicLex`` has an abstract syntax that extends
|
||||||
|
the resource category system ``Cat``.
|
||||||
|
```
|
||||||
|
abstract MusicLex = Cat ** {
|
||||||
|
|
||||||
|
fun
|
||||||
|
song_N : N ;
|
||||||
|
american_A : A ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
Each language has its own concrete syntax, which opens the
|
||||||
|
inflectional paradigms module for that language:
|
||||||
|
```
|
||||||
|
concrete MusicLexGer of MusicLex =
|
||||||
|
CatGer ** open ParadigmsGer in {
|
||||||
|
lin
|
||||||
|
song_N = mkN "Lied" "Lieder" neuter ;
|
||||||
|
american_A = mkA "amerikanisch" ;
|
||||||
|
}
|
||||||
|
|
||||||
|
concrete MusicLexFre of MusicLex =
|
||||||
|
CatFre ** open ParadigmsFre in {
|
||||||
|
lin
|
||||||
|
song_N = mkN "chanson" feminine ;
|
||||||
|
american_A = mkA "américain" ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
The top-level ``Music`` grammars are obtained by
|
||||||
|
instantiating the two interfaces of ``MusicI``:
|
||||||
|
```
|
||||||
|
concrete MusicGer of Music = MusicI with
|
||||||
|
(Syntax = SyntaxGer),
|
||||||
|
(MusicLex = MusicLexGer) ;
|
||||||
|
|
||||||
|
concrete MusicFre of Music = MusicI with
|
||||||
|
(Syntax = SyntaxFre),
|
||||||
|
(MusicLex = MusicLexFre) ;
|
||||||
|
```
|
||||||
|
Both of these files can use the same ``path``, defined as
|
||||||
|
```
|
||||||
|
--# -path=.:present:prelude
|
||||||
|
```
|
||||||
|
The ``present`` category contains the compiled resources, restricted to
|
||||||
|
present tense; ``alltenses`` has the full resources.
|
||||||
|
|
||||||
|
To localize the music player system to a new language,
|
||||||
|
all that is needed is two modules,
|
||||||
|
one implementing ``MusicLex`` and the other
|
||||||
|
instantiating ``Music``. The latter is
|
||||||
|
completely trivial, whereas the former one involves the choice of correct
|
||||||
|
vocabulary and inflectional paradigms. For instance, Finnish is added as follows:
|
||||||
|
```
|
||||||
|
concrete MusicLexFin of MusicLex =
|
||||||
|
CatFin ** open ParadigmsFin in {
|
||||||
|
lin
|
||||||
|
song_N = mkN "kappale" ;
|
||||||
|
american_A = mkA "amerikkalainen" ;
|
||||||
|
}
|
||||||
|
|
||||||
|
concrete MusicFin of Music = MusicI with
|
||||||
|
(Syntax = SyntaxFin),
|
||||||
|
(MusicLex = MusicLexFin) ;
|
||||||
|
```
|
||||||
|
More work is of course needed if the language-independent linearizations in
|
||||||
|
MusicI are not satisfactory for some language. The resource grammar guarantees
|
||||||
|
that the linearizations are possible in all languages, in the sense of grammatical,
|
||||||
|
but they might of course be inadequate for stylistic reasons. Assume,
|
||||||
|
for the sake of argument, that adjectival modification does not sound good in
|
||||||
|
English, but that a relative clause would be preferrable. One can then use
|
||||||
|
restricted inheritance of the functor:
|
||||||
|
```
|
||||||
|
concrete MusicEng of Music =
|
||||||
|
MusicI - [PropKind]
|
||||||
|
with
|
||||||
|
(Syntax = SyntaxEng),
|
||||||
|
(MusicLex = MusicLexEng) **
|
||||||
|
open SyntaxEng in {
|
||||||
|
lin
|
||||||
|
PropKind k p = mkCN k (mkRS (mkRCl which_RP (mkVP p))) ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
The lexicon is as expected:
|
||||||
|
```
|
||||||
|
concrete MusicLexEng of MusicLex =
|
||||||
|
CatEng ** open ParadigmsEng in {
|
||||||
|
lin
|
||||||
|
song_N = mkN "song" ;
|
||||||
|
american_A = mkA "American" ;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
==Lock fields==
|
||||||
|
|
||||||
|
//This section is only relevant as a guide to error messages that have to do with lock fields, and can be skipped otherwise.//
|
||||||
|
|
||||||
|
FIXME: this section may become obsolete.
|
||||||
|
|
||||||
|
When the categories of the resource grammar are used
|
||||||
|
in applications, a **lock field** is added to their linearization types.
|
||||||
|
The lock field for a category ``C`` is a record field
|
||||||
|
```
|
||||||
|
lock_C : {}
|
||||||
|
```
|
||||||
|
with the only possible value
|
||||||
|
```
|
||||||
|
lock_C = <>
|
||||||
|
```
|
||||||
|
The lock field carries no information, but its presence
|
||||||
|
makes the linearization type of ``C``
|
||||||
|
unique, so that categories
|
||||||
|
with the same implementation are not confused with each other.
|
||||||
|
(This is inspired by the ``newtype`` discipline in Haskell.)
|
||||||
|
|
||||||
|
For example, the lincats of adverbs and conjunctions are the same
|
||||||
|
in ``CatEng`` (and therefore in ``GrammarEng``, which inherits it):
|
||||||
|
```
|
||||||
|
lincat Adv = {s : Str} ;
|
||||||
|
lincat Conj = {s : Str} ;
|
||||||
|
```
|
||||||
|
But when these category symbols are used to denote their linearization
|
||||||
|
types in an application, these definitions are translated to
|
||||||
|
```
|
||||||
|
oper Adv : Type = {s : Str ; lock_Adv : {}} ;
|
||||||
|
oper Conj : Type = {s : Str} ; lock_Conj : {}} ;
|
||||||
|
```
|
||||||
|
In this way, the user of a resource grammar cannot confuse adverbs with
|
||||||
|
conjunctions. In other words, the lock fields force the type checker
|
||||||
|
to function as grammaticality checker.
|
||||||
|
|
||||||
|
When the resource grammar is ``open``ed in an application grammar,
|
||||||
|
and only functions from the resource are used in type-correct way, the
|
||||||
|
lock fields are never seen (except possibly in type error messages).
|
||||||
|
If an application grammarian has to write lock fields herself,
|
||||||
|
it is a sign that the guarantees given by the resource grammar
|
||||||
|
no longer hold. But since the resource may be incomplete, the
|
||||||
|
application grammarian may occasionally have to provide the dummy
|
||||||
|
values of lock fields (always ``<>``, the empty record).
|
||||||
|
Here is an example:
|
||||||
|
```
|
||||||
|
mkUtt : Str -> Utt ;
|
||||||
|
mkUtt s = {s = s ; lock_Utt = <>} ;
|
||||||
|
```
|
||||||
|
Currently, missing lock field produce warnings rather than errors,
|
||||||
|
but this behaviour of GF may change in future.
|
||||||
|
|
||||||
|
|
||||||
|
==Parsing with resource grammars?==
|
||||||
|
|
||||||
|
The intended use of the resource grammar is as a library for writing
|
||||||
|
application grammars. It is not designed for parsing e.g. newspaper text. There
|
||||||
|
are several reasons why this is not practical:
|
||||||
|
- Efficiency: the resource grammar uses complex data structures, in
|
||||||
|
particular, discontinuous constituents, which make parsing slow and the
|
||||||
|
parser size huge.
|
||||||
|
- Completeness: the resource grammar does not necessarily cover all rules
|
||||||
|
of the language - only enough many to be able to express everything
|
||||||
|
in one way or another.
|
||||||
|
- Lexicon: the resource grammar has a very small lexicon, only meant for test
|
||||||
|
purposes.
|
||||||
|
- Semantics: the resource grammar has very little semantic control, and may
|
||||||
|
accept strange input or deliver strange interpretations.
|
||||||
|
- Ambiguity: parsing in the resource grammar may return lots of results many
|
||||||
|
of which are implausible.
|
||||||
|
|
||||||
|
|
||||||
|
All of these problems should be solved in application grammars.
|
||||||
|
The task of resource grammars is just to take care of low-level linguistic
|
||||||
|
details such as inflection, agreement, and word order.
|
||||||
|
|
||||||
|
It is for the same reasons that resource grammars are not adequate for translation.
|
||||||
|
That the syntax API is implemented for different languages of course makes
|
||||||
|
it possible to translate via it - but there is no guarantee of translation
|
||||||
|
equivalence. Of course, the use of functor implementations such as ``MusicI``
|
||||||
|
above only extends to those cases where the syntax API does give translation
|
||||||
|
equivalence - but this must be seen as a limiting case, and bigger applications
|
||||||
|
will often use only restricted inheritance of ``MusicI``.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
=To find rules in the resource grammar library=
|
||||||
|
|
||||||
|
==Inflection paradigms==
|
||||||
|
|
||||||
|
Inflection paradigms are defined separately for each language //L//
|
||||||
|
in the module ``Paradigms``//L//. To test them, the command
|
||||||
|
``cc`` (= ``compute_concrete``)
|
||||||
|
can be used:
|
||||||
|
```
|
||||||
|
> i -retain german/ParadigmsGer.gf
|
||||||
|
|
||||||
|
> cc mkN "Schlange"
|
||||||
|
{
|
||||||
|
s : Number => Case => Str = table Number {
|
||||||
|
Sg => table Case {
|
||||||
|
Nom => "Schlange" ;
|
||||||
|
Acc => "Schlange" ;
|
||||||
|
Dat => "Schlange" ;
|
||||||
|
Gen => "Schlange"
|
||||||
|
} ;
|
||||||
|
Pl => table Case {
|
||||||
|
Nom => "Schlangen" ;
|
||||||
|
Acc => "Schlangen" ;
|
||||||
|
Dat => "Schlangen" ;
|
||||||
|
Gen => "Schlangen"
|
||||||
|
}
|
||||||
|
} ;
|
||||||
|
g : Gender = Fem
|
||||||
|
}
|
||||||
|
```
|
||||||
|
For the sake of convenience, every language implements these five paradigms:
|
||||||
|
```
|
||||||
|
oper
|
||||||
|
mkN : Str -> N ; -- regular nouns
|
||||||
|
mkA : Str -> A : -- regular adjectives
|
||||||
|
mkV : Str -> V ; -- regular verbs
|
||||||
|
mkPN : Str -> PN ; -- regular proper names
|
||||||
|
mkV2 : V -> V2 ; -- direct transitive verbs
|
||||||
|
```
|
||||||
|
It is often possible to initialize a lexicon by just using these functions,
|
||||||
|
and later revise it by using the more involved paradigms. For instance, in
|
||||||
|
German we cannot use ``mkN "Lied"`` for ``Song``, because the result would be a
|
||||||
|
Masculine noun with the plural form ``"Liede"``.
|
||||||
|
The individual ``Paradigms`` modules
|
||||||
|
tell what cases are covered by the regular heuristics.
|
||||||
|
|
||||||
|
As a limiting case, one could even initialize the lexicon for a new language
|
||||||
|
by copying the English (or some other already existing) lexicon. This would
|
||||||
|
produce language with correct grammar but with content words directly borrowed from
|
||||||
|
English - maybe not so strange in certain technical domains.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
==Syntax rules==
|
||||||
|
|
||||||
|
Syntax rules should be looked for in the module ``Constructors``.
|
||||||
|
Below this top-level module exposing overloaded constructors,
|
||||||
|
there are around 10 abstract modules, each defining constructors for
|
||||||
|
a group of one or more related categories. For instance, the module
|
||||||
|
``Noun`` defines how to construct common nouns, noun phrases, and determiners.
|
||||||
|
But these special modules are seldom or never needed by the users of the library.
|
||||||
|
|
||||||
|
TODO: when are they needed?
|
||||||
|
|
||||||
|
Browsing the libraries is helped by the gfdoc-generated HTML pages,
|
||||||
|
whose LaTeX versions are included in the present document.
|
||||||
|
|
||||||
|
|
||||||
|
==Special-purpose APIs==
|
||||||
|
|
||||||
|
To give an analogy with the well-known type setting software, GF can be compared
|
||||||
|
with TeX and the resource grammar library with LaTeX.
|
||||||
|
Just like TeX frees the author
|
||||||
|
from thinking about low-level problems of page layout, so GF frees the grammarian
|
||||||
|
from writing parsing and generation algorithms. But quite a lot of knowledge of
|
||||||
|
//how// to write grammars is still needed, and the resource grammar library helps
|
||||||
|
GF grammarians in a way similar to how the LaTeX macro package helps TeX authors.
|
||||||
|
|
||||||
|
But even LaTeX is often too detailed and low-level, and users are encouraged to
|
||||||
|
develop their own macro packages. The same applies to GF resource grammars:
|
||||||
|
the application grammarian might not need all the choices that the resource
|
||||||
|
provides, but would prefer less writing and higher-level programming.
|
||||||
|
To this end, application grammarians may want to write their own views on the
|
||||||
|
resource grammar.
|
||||||
|
|
||||||
|
|
||||||
|
==Browsing by the parser==
|
||||||
|
|
||||||
|
A method alternative to browsing library documentation is
|
||||||
|
to use the parser.
|
||||||
|
Even though parsing is not an intended end-user application
|
||||||
|
of resource grammars, it is a useful technique for application grammarians
|
||||||
|
to browse the library. To find out which resource function implements
|
||||||
|
a particular structure, one can just parse a string that exemplifies this
|
||||||
|
structure. For instance, to find out how sentences are built using
|
||||||
|
transitive verbs, write
|
||||||
|
```
|
||||||
|
> i english/LangEng.gf
|
||||||
|
|
||||||
|
> p -cat=Cl "she loves him"
|
||||||
|
PredVP (UsePron she_Pron) (ComplV2 love_V2 (UsePron he_Pron))
|
||||||
|
```
|
||||||
|
The parser returns original constructors, not overloaded ones. Overloaded
|
||||||
|
constructors can be returned, so far with experimental heuristics, by using
|
||||||
|
the grammar ``api/toplevel/OverLangEng.gf`` and a special flag:
|
||||||
|
```
|
||||||
|
> i api/toplevel/OverLangEng.gf
|
||||||
|
|
||||||
|
> p -cat=Cl -overload "she loves him"
|
||||||
|
mkCl (mkNP she_Pron) love_V2 (mkNP he_Pron)
|
||||||
|
```
|
||||||
|
Parsing with the English resource grammar has an acceptable speed, but
|
||||||
|
with most languages it takes just too much resources even to build the
|
||||||
|
parser. However, examples parsed in one language can always be linearized into
|
||||||
|
other languages:
|
||||||
|
```
|
||||||
|
> i italian/LangIta.gf
|
||||||
|
|
||||||
|
> l PredVP (UsePron she_Pron) (ComplV2 love_V2 (UsePron he_Pron))
|
||||||
|
lo ama
|
||||||
|
```
|
||||||
|
Therefore, one can use the English parser to write an Italian grammar, and also
|
||||||
|
to write a language-independent (incomplete) grammar. One can also parse strings
|
||||||
|
that are bizarre in English but the intended way of expression in another language.
|
||||||
|
For instance, the phrase for "I am hungry" in Italian is literally "I have hunger".
|
||||||
|
This can be built by parsing "I have beer" in ``OverLangEng`` and then writing
|
||||||
|
```
|
||||||
|
lin IamHungry =
|
||||||
|
let beer_N = mkN "fame" feminine
|
||||||
|
in
|
||||||
|
mkCl (mkNP i_Pron) have_V2 (mkNP massQuant beer_N)
|
||||||
|
```
|
||||||
|
which uses ``ParadigmsIta.mkN``.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
==Example-based grammar writing==
|
||||||
|
|
||||||
|
The technique of parsing with the resource grammar can be used in GF source files,
|
||||||
|
endowed with the suffix ``.gfe`` ("GF examples"). The suffix tells GF to preprocess
|
||||||
|
the file by replacing all expressions of the form
|
||||||
|
```
|
||||||
|
in Module.Cat "example string"
|
||||||
|
```
|
||||||
|
by the syntax trees obtained by parsing "example string" in ``Cat`` in ``Module``.
|
||||||
|
For instance,
|
||||||
|
```
|
||||||
|
lin IamHungry =
|
||||||
|
let beer_N = mkN "fame" feminine
|
||||||
|
in
|
||||||
|
(in LangEng.Cl "I have beer") ;
|
||||||
|
```
|
||||||
|
will result in the rule displayed in the previous section. The normal binding rules
|
||||||
|
of functional programming (and GF) guarantee that local bindings of identifiers
|
||||||
|
take precedence over constants of the same forms. Thus it is also possible to
|
||||||
|
linearize functions taking arguments in this way:
|
||||||
|
```
|
||||||
|
lin
|
||||||
|
PropKind car_N old_A = in LangEng.CN "old car" ;
|
||||||
|
```
|
||||||
|
However, the technique of example-based grammar writing has some limitations:
|
||||||
|
- Ambiguity. If a string has several parses, the first one is returned, and
|
||||||
|
it may not be the intended one. The other parses are shown in a comment, from
|
||||||
|
where they must/can be picked manually.
|
||||||
|
- Lexicality. The arguments of a function must be atomic identifiers, and are thus
|
||||||
|
not available for categories that have no lexical items.
|
||||||
|
For instance, the ``PropKind`` rule above gives the result
|
||||||
|
```
|
||||||
|
lin
|
||||||
|
PropKind car_N old_A = AdjCN (UseN car_N) (PositA old_A) ;
|
||||||
|
```
|
||||||
|
However, it is possible to write a special lexicon that gives atomic rules for
|
||||||
|
all those categories that can be used as arguments, for instance,
|
||||||
|
```
|
||||||
|
fun
|
||||||
|
cat_CN : CN ;
|
||||||
|
old_AP : AP ;
|
||||||
|
```
|
||||||
|
and then use this lexicon instead of the standard one included in ``Lang``.
|
||||||
|
|
||||||
|
|
||||||
300
doc/overview-resource.txt
Normal file
300
doc/overview-resource.txt
Normal file
@@ -0,0 +1,300 @@
|
|||||||
|
==Texts. phrases, and utterances==
|
||||||
|
|
||||||
|
The outermost linguistic structure is ``Text``. ``Text``s are composed
|
||||||
|
from Phrases (``Phr``) followed by punctuation marks - either of ".", "?" or
|
||||||
|
"!" (with their proper variants in Spanish and Arabic). Here is an
|
||||||
|
example of a ``Text`` string.
|
||||||
|
```
|
||||||
|
John walks. Why? He doesn't want to sleep!
|
||||||
|
```
|
||||||
|
Phrases are mostly built from Utterances (``Utt``), which in turn are
|
||||||
|
declarative sentences, questions, or imperatives - but there
|
||||||
|
are also "one-word utterances" consisting of noun phrases
|
||||||
|
or other subsentential phrases. Some Phrases are atomic,
|
||||||
|
for instance "yes" and "no". Here are some examples of Phrases.
|
||||||
|
```
|
||||||
|
yes
|
||||||
|
come on, John
|
||||||
|
but John walks
|
||||||
|
give me the stick please
|
||||||
|
don't you know that he is sleeping
|
||||||
|
a glass of wine
|
||||||
|
a glass of wine please
|
||||||
|
```
|
||||||
|
There is no connection between the punctuation marks and the
|
||||||
|
types of utterances. This reflects the fact that the punctuation
|
||||||
|
mark in a real text is selected as a function of the speech act
|
||||||
|
rather than the grammatical form of an utterance. The following
|
||||||
|
text is thus well-formed.
|
||||||
|
```
|
||||||
|
John walks. John walks? John walks!
|
||||||
|
```
|
||||||
|
What is the difference between Phrase and Utterance? Just technical:
|
||||||
|
a Phrase is an Utterance with an optional leading conjunction ("but")
|
||||||
|
and an optional tailing vocative ("John", "please").
|
||||||
|
|
||||||
|
|
||||||
|
==Sentences and clauses==
|
||||||
|
|
||||||
|
TODO: use overloaded operations in the examples.
|
||||||
|
|
||||||
|
The richest of the categories below Utterance is ``S``, Sentence. A Sentence
|
||||||
|
is formed from a Clause (``Cl``), by fixing its Tense, Anteriority, and Polarity.
|
||||||
|
For example, each of the following strings has a distinct syntax tree
|
||||||
|
in the category Sentence:
|
||||||
|
```
|
||||||
|
John walks
|
||||||
|
John doesn't walk
|
||||||
|
John walked
|
||||||
|
John didn't walk
|
||||||
|
John has walked
|
||||||
|
John hasn't walked
|
||||||
|
John will walk
|
||||||
|
John won't walk
|
||||||
|
...
|
||||||
|
```
|
||||||
|
whereas in the category Clause all of them are just different forms of
|
||||||
|
the same tree.
|
||||||
|
The difference between Sentence and Clause is thus also rather technical.
|
||||||
|
It may not correspond exactly to any standard usage of the terms
|
||||||
|
"clause" and "sentence".
|
||||||
|
|
||||||
|
Figure 1 shows a type-annotated syntax tree of the Text "John walks."
|
||||||
|
and gives an overview of the structural levels.
|
||||||
|
|
||||||
|
#BFIG
|
||||||
|
|
||||||
|
```
|
||||||
|
Node Constructor Value type Other constructors
|
||||||
|
-----------------------------------------------------------
|
||||||
|
1. TFullStop Text TQuestMark
|
||||||
|
2. (PhrUtt Phr
|
||||||
|
3. NoPConj PConj but_PConj
|
||||||
|
4. (UttS Utt UttQS
|
||||||
|
5. (UseCl S UseQCl
|
||||||
|
6. TPres Tense TPast
|
||||||
|
7. ASimul Anter AAnter
|
||||||
|
8. PPos Pol PNeg
|
||||||
|
9. (PredVP Cl
|
||||||
|
10. (UsePN NP UsePron, DetCN
|
||||||
|
11. john_PN) PN mary_PN
|
||||||
|
12. (UseV VP ComplV2, ComplV3
|
||||||
|
13. walk_V)))) V sleep_V
|
||||||
|
14. NoVoc) Voc please_Voc
|
||||||
|
15. TEmpty Text
|
||||||
|
```
|
||||||
|
|
||||||
|
#BCENTER
|
||||||
|
Figure 1. Type-annotated syntax tree of the Text "John walks."
|
||||||
|
#ECENTER
|
||||||
|
|
||||||
|
#EFIG
|
||||||
|
|
||||||
|
Here are some examples of the results of changing constructors.
|
||||||
|
```
|
||||||
|
1. TFullStop -> TQuestMark John walks?
|
||||||
|
3. NoPConj -> but_PConj But John walks.
|
||||||
|
6. TPres -> TPast John walked.
|
||||||
|
7. ASimul -> AAnter John has walked.
|
||||||
|
8. PPos -> PNeg John doesn't walk.
|
||||||
|
11. john_PN -> mary_PN Mary walks.
|
||||||
|
13. walk_V -> sleep_V John sleeps.
|
||||||
|
14. NoVoc -> please_Voc John sleeps please.
|
||||||
|
```
|
||||||
|
All constructors cannot of course be changed so freely, because the
|
||||||
|
resulting tree would not remain well-typed. Here are some changes involving
|
||||||
|
many constructors:
|
||||||
|
```
|
||||||
|
4- 5. UttS (UseCl ...) ->
|
||||||
|
UttQS (UseQCl (... QuestCl ...)) Does John walk?
|
||||||
|
10-11. UsePN john_PN ->
|
||||||
|
UsePron we_Pron We walk.
|
||||||
|
12-13. UseV walk_V ->
|
||||||
|
ComplV2 love_V2 this_NP John loves this.
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
==Parts of sentences==
|
||||||
|
|
||||||
|
The linguistic phenomena mostly discussed in both traditional grammars and modern
|
||||||
|
syntax belong to the level of Clauses, that is, lines 9-13, and occasionally
|
||||||
|
to Sentences, lines 5-13. At this level, the major categories are
|
||||||
|
``NP`` (Noun Phrase) and ``VP`` (Verb Phrase). A Clause typically
|
||||||
|
consists of just an ``NP`` and a ``VP``.
|
||||||
|
The internal structure of both ``NP`` and ``VP`` can be very complex,
|
||||||
|
and these categories are mutually recursive: not only can a ``VP``
|
||||||
|
contain an ``NP``,
|
||||||
|
```
|
||||||
|
[VP loves [NP Mary]]
|
||||||
|
```
|
||||||
|
but also an ``NP`` can contain a ``VP``
|
||||||
|
```
|
||||||
|
[NP every man [RS who [VP walks]]]
|
||||||
|
```
|
||||||
|
(a labelled bracketing like this is of course just a rough approximation of
|
||||||
|
a GF syntax tree, but still a useful device of exposition).
|
||||||
|
|
||||||
|
Most of the resource modules thus define functions that are used inside
|
||||||
|
NPs and VPs. Here is a brief overview:
|
||||||
|
|
||||||
|
**Noun**. How to construct NPs. The main three mechanisms
|
||||||
|
for constructing NPs are
|
||||||
|
- from proper names: "John"
|
||||||
|
- from pronouns: "we"
|
||||||
|
- from common nouns by determiners: "this man"
|
||||||
|
|
||||||
|
|
||||||
|
The ``Noun`` module also defines the construction of common nouns.
|
||||||
|
The most frequent ways are
|
||||||
|
- lexical noun items: "man"
|
||||||
|
- adjectival modification: "old man"
|
||||||
|
- relative clause modification: "man who sleeps"
|
||||||
|
- application of relational nouns: "successor of the number"
|
||||||
|
|
||||||
|
|
||||||
|
**Verb**.
|
||||||
|
How to construct VPs. The main mechanism is verbs with their arguments,
|
||||||
|
for instance,
|
||||||
|
- one-place verbs: "walks"
|
||||||
|
- two-place verbs: "loves Mary"
|
||||||
|
- three-place verbs: "gives her a kiss"
|
||||||
|
- sentence-complement verbs: "says that it is cold"
|
||||||
|
- VP-complement verbs: "wants to give her a kiss"
|
||||||
|
|
||||||
|
|
||||||
|
A special verb is the copula, "be" in English but not even realized
|
||||||
|
by a verb in all languages.
|
||||||
|
A copula can take different kinds of complement:
|
||||||
|
- an adjectival phrase: "(John is) old"
|
||||||
|
- an adverb: "(John is) here"
|
||||||
|
- a noun phrase: "(John is) a man"
|
||||||
|
|
||||||
|
|
||||||
|
**Adjective**.
|
||||||
|
How to constuct ``AP``s. The main ways are
|
||||||
|
- positive forms of adjectives: "old"
|
||||||
|
- comparative forms with object of comparison: "older than John"
|
||||||
|
|
||||||
|
|
||||||
|
**Adverb**.
|
||||||
|
How to construct ``Adv``s. The main ways are
|
||||||
|
- from adjectives: "slowly"
|
||||||
|
- as prepositional phrases: "in the car"
|
||||||
|
|
||||||
|
|
||||||
|
==Modules and their names==
|
||||||
|
|
||||||
|
This section is not necessary for users of the library.
|
||||||
|
|
||||||
|
TODO: explain the overloaded API.
|
||||||
|
|
||||||
|
The resource modules are named after the kind of
|
||||||
|
phrases that are constructed in them,
|
||||||
|
and they can be roughly classified by the "level" or "size" of expressions that are
|
||||||
|
formed in them:
|
||||||
|
- Larger than sentence: ``Text``, ``Phrase``
|
||||||
|
- Same level as sentence: ``Sentence``, ``Question``, ``Relative``
|
||||||
|
- Parts of sentence: ``Adjective``, ``Adverb``, ``Noun``, ``Verb``
|
||||||
|
- Cross-cut (coordination): ``Conjunction``
|
||||||
|
|
||||||
|
|
||||||
|
Because of mutual recursion such as in embedded sentences, this classification is
|
||||||
|
not a complete order. However, no mutual dependence is needed between the
|
||||||
|
modules themselves - they can all be compiled separately. This is due
|
||||||
|
to the module ``Cat``, which defines the type system common to the other modules.
|
||||||
|
For instance, the types ``NP`` and ``VP`` are defined in ``Cat``,
|
||||||
|
and the module ``Verb`` only
|
||||||
|
needs to know what is given in ``Cat``, not what is given in ``Noun``. To implement
|
||||||
|
a rule such as
|
||||||
|
```
|
||||||
|
Verb.ComplV2 : V2 -> NP -> VP
|
||||||
|
```
|
||||||
|
it is enough to know the linearization type of ``NP``
|
||||||
|
(as well as those of ``V2`` and ``VP``, all
|
||||||
|
given in ``Cat``). It is not necessary to know what
|
||||||
|
ways there are to build ``NP``s (given in ``Noun``), since all these ways must
|
||||||
|
conform to the linearization type defined in ``Cat``. Thus the format of
|
||||||
|
category-specific modules is as follows:
|
||||||
|
```
|
||||||
|
abstract Adjective = Cat ** {...}
|
||||||
|
abstract Noun = Cat ** {...}
|
||||||
|
abstract Verb = Cat ** {...}
|
||||||
|
```
|
||||||
|
|
||||||
|
|
||||||
|
==Top-level grammar and lexicon==
|
||||||
|
|
||||||
|
The module ``Grammar`` collects all the category-specific modules into
|
||||||
|
a complete grammar:
|
||||||
|
```
|
||||||
|
abstract Grammar =
|
||||||
|
Adjective, Noun, Verb, ..., Structural, Idiom
|
||||||
|
```
|
||||||
|
The module ``Structural`` is a lexicon of structural words (function words),
|
||||||
|
such as determiners.
|
||||||
|
|
||||||
|
The module ``Idiom`` is a collection of idiomatic structures whose
|
||||||
|
implementation is very language-dependent. An example is existential
|
||||||
|
structures ("there is", "es gibt", "il y a", etc).
|
||||||
|
|
||||||
|
The module ``Lang`` combines ``Grammar`` with a ``Lexicon`` of
|
||||||
|
ca. 350 content words:
|
||||||
|
```
|
||||||
|
abstract Lang = Grammar, Lexicon
|
||||||
|
```
|
||||||
|
Using ``Lang`` instead of ``Grammar`` as a library may give
|
||||||
|
for free some words needed in an application. But its main purpose is to
|
||||||
|
help testing the resource library, rather than as a resource itself.
|
||||||
|
It does not even seem realistic to develop
|
||||||
|
a general-purpose multilingual resource lexicon.
|
||||||
|
|
||||||
|
The diagram in Figure 2 shows the structure of the API.
|
||||||
|
|
||||||
|
#BFIG
|
||||||
|
|
||||||
|
#GRAMMAR
|
||||||
|
|
||||||
|
#BCENTER
|
||||||
|
Figure 2. The resource syntax API.
|
||||||
|
#ECENTER
|
||||||
|
|
||||||
|
#EFIG
|
||||||
|
|
||||||
|
==Language-specific syntactic structures==
|
||||||
|
|
||||||
|
The API collected in ``Grammar`` has been designed to be implementable for
|
||||||
|
all languages in the resource package. It does contain some rules that
|
||||||
|
are strange or superfluous in some languages; for instance, the distinction
|
||||||
|
between definite and indefinite articles does not apply to Finnish and Russian.
|
||||||
|
But such rules are still easy to implement: they only create some superfluous
|
||||||
|
ambiguity in the languages in question.
|
||||||
|
|
||||||
|
But the library makes no claim that all languages should have exactly the same
|
||||||
|
abstract syntax. The common API is therefore extended by language-dependent
|
||||||
|
rules. The top level of each languages looks as follows (with English as example):
|
||||||
|
```
|
||||||
|
abstract English = Grammar, ExtraEngAbs, DictEngAbs
|
||||||
|
```
|
||||||
|
where ``ExtraEngAbs`` is a collection of syntactic structures specific to English,
|
||||||
|
and ``DictEngAbs`` is an English dictionary
|
||||||
|
(at the moment, it consists of ``IrregEngAbs``,
|
||||||
|
the irregular verbs of English). Each of these language-specific grammars has
|
||||||
|
the potential to grow into a full-scale grammar of the language. These grammars
|
||||||
|
can also be used as libraries, but the possibility of using functors is lost.
|
||||||
|
|
||||||
|
To give a better overview of language-specific structures,
|
||||||
|
modules like ``ExtraEngAbs``
|
||||||
|
are built from a language-independent module ``ExtraAbs``
|
||||||
|
by restricted inheritance:
|
||||||
|
```
|
||||||
|
abstract ExtraEngAbs = Extra [f,g,...]
|
||||||
|
```
|
||||||
|
Thus any category and function in ``Extra`` may be shared by a subset of all
|
||||||
|
languages. One can see this set-up as a matrix, which tells
|
||||||
|
what ``Extra`` structures
|
||||||
|
are implemented in what languages. For the common API in ``Grammar``, the matrix
|
||||||
|
is filled with 1's (everything is implemented in every language).
|
||||||
|
|
||||||
|
Language-specific extensions and the use of restricted
|
||||||
|
inheritance is a recent addition to the resource grammar library, and
|
||||||
|
has only been exploited in a very small scale so far.
|
||||||
Reference in New Issue
Block a user