John J. Camilleri
99abb9b2a5
Add Phrasebook benchmark snippet to LPGF README
2021-03-08 13:37:02 +01:00
John J. Camilleri
3e9d12854a
Switch to 10000-tree Phrasebook treebank. All errors to do with missing functions, plus variants in German.
2021-03-08 11:19:06 +01:00
John J. Camilleri
fd07946a50
Remove commented line
2021-03-08 10:42:16 +01:00
John J. Camilleri
c76efcf916
Use C runtime in mkTreebank script
2021-03-08 10:17:03 +01:00
John J. Camilleri
785d6069e2
Fix lin2string and pass all unittests and Phrasebook
2021-03-08 09:53:10 +01:00
John J. Camilleri
0f4b349b0b
Remove old commented code
2021-03-05 16:51:59 +01:00
John J. Camilleri
dbf369aae5
Make removal of record fields recursive. Latest results with Phrasebook:
...
Bul ✓
Cat ✗
Chi ✓
Dan ✓
Dut ✓
Eng ✓
Est ✓
Fin ✓
Fre ✗
Ger ✓
Hin ✓
Ita ✗
Jpn ✓
Lav ✓
Nor ✓
Pol ✓
Ron ✓
Snd ✗
Spa ✓
Swe ✓
Tha ✓
Urd ✓
Passed 18 | Failed 4 | Total 22
2021-03-05 16:48:05 +01:00
John J. Camilleri
0d4659fe8c
Add workaround for missing param defs. Add links to gf-core issues in workaround comments.
2021-03-05 13:23:00 +01:00
John J. Camilleri
575a746a3e
Add LPGF function for catching errors. Manual fixes to Phrasebook treebank.
2021-03-05 12:05:25 +01:00
John J. Camilleri
70581c2d8c
Improve base case in table handling, cleanup. Add run-phrasebook script, current output:
...
Bul ✗
Cat ✗
Chi ✓
Dan ✓
Dut ✓
Eng ✓
Est ✓
Fin ✗
Fre ✗
Ger ✓
Hin ✓
Ita ✗
Jpn ✓
Lav ✓
Nor ✓
Pol ✓
Ron ✓
Snd ✗
Spa ✗
Swe ✓
Tha ✓
Urd ✓
Passed 15 | Failed 7 | Total 22
2021-03-04 17:09:35 +01:00
John J. Camilleri
bca1e2286d
New handling of tables, works for all tests but Phrasebook still fails
2021-03-04 16:42:56 +01:00
John J. Camilleri
94f76b9e36
Add more tests to Params5 which cause it to fail again
...
Originally found in PhrasebookFre
2021-03-04 13:38:55 +01:00
John J. Camilleri
f5886bf447
Add more complex param/table unit tests and pass them. Still fails on Phrasebook though.
2021-03-04 12:37:12 +01:00
John J. Camilleri
0ba0438dc7
Add a little colour to benchmark output
2021-03-04 10:20:57 +01:00
John J. Camilleri
30b016032d
Also store Pre prefixes in token map. Introduce IntMapBuilder data structure.
...
Storing of prefixes uses show/read, which isn't a great solution but avoids having yet another token map.
2021-03-04 09:58:17 +01:00
John J. Camilleri
4082c006c3
Extract token strings and put them in map which linfuns refer to by index, to reduce LPGF sizes.
2021-03-04 00:16:12 +01:00
John J. Camilleri
adc162b374
Pass all unit tests and Foods again, with new strategy. Cleanup.
2021-03-03 15:21:32 +01:00
John J. Camilleri
3beed2c49e
Replace list comprehension lookups with maps. Halfway through transitioning to new strategy for tables/params, see testsuite/lpgf/README.md.
2021-03-03 13:26:03 +01:00
John J. Camilleri
a8e3dc8855
Improve mkTreebank script. Add 100-tree Phrasebook treebank. Improve output in testsuite.
2021-03-03 11:01:31 +01:00
John J. Camilleri
997d7c1694
Use ErrorMonad instead of IOE
...
It probably ends up being the same thing, but the code is a little cleaner for it.
2021-03-03 09:36:48 +01:00
John J. Camilleri
4c09e4a340
Remove LF prefix from constructors. Pass all unit tests and Foods again, but improvements/cleanup still necessary.
2021-03-03 09:19:52 +01:00
John J. Camilleri
33e0e98aec
Add 1-tree treebank for Phrasebook in a few languages
2021-02-28 00:34:46 +01:00
John J. Camilleri
83bc3c9c6e
More work on params: pass all tests except params1 (!)
2021-02-27 23:13:02 +01:00
John J. Camilleri
f42b5ec9ef
More work on params, but Foods fails now
2021-02-26 20:25:05 +01:00
John J. Camilleri
4771d9c356
WIP params
2021-02-26 17:18:21 +01:00
John J. Camilleri
9785f8351d
Reduce Params2 further
2021-02-26 11:52:12 +01:00
John J. Camilleri
6a5d735904
Reduce Params2 unittest (still fails)
2021-02-26 10:26:11 +01:00
John J. Camilleri
8324ad8801
Add pretty-printing of LPGF grammars, to help debugging
2021-02-26 10:13:33 +01:00
John J. Camilleri
20290be616
Add Params2 unit test, from problem uncovered in PhrasebookGer
2021-02-22 10:52:37 +01:00
John J. Camilleri
b4a393ac09
Pass missing unit test
2021-02-21 14:22:46 +01:00
John J. Camilleri
9942908df9
Add unit test for missing lins
2021-02-21 14:05:31 +01:00
John J. Camilleri
dca2ebaf72
Add Phrasebook to testsuite. Move grammars into subfolders. Add run-bench script.
2021-02-20 13:22:29 +01:00
John J. Camilleri
5ad5789b31
Filter out record fields which don't exist in lintype
...
This is to work around an inconsistency in the canonical representation
2021-02-19 15:19:40 +01:00
John J. Camilleri
9f3f4139b1
Grammar and languages to run in testsuite can be specified by command line options, see README
2021-02-19 11:14:55 +01:00
John J. Camilleri
505c12c528
Rename run.hs to test.hs
2021-02-19 09:33:35 +01:00
John J. Camilleri
023b50557e
Write LPGF dump to file when DEBUG is set, rather than console
2021-02-19 09:31:26 +01:00
John J. Camilleri
2b0493eece
Tweak memory reporting and strictness in benchmark
2021-02-19 09:18:01 +01:00
John J. Camilleri
51e543878b
Add support for wildcards when specifying modules names in benchmark compilation
2021-02-18 21:34:23 +01:00
John J. Camilleri
625386a14f
Force evaluation in benchmark linearisation
...
BangPatterns only does WHNF which is not sufficient, previous benchmark results are thus wrong
2021-02-18 21:01:30 +01:00
John J. Camilleri
5240749fad
Make grammar and trees files command line arguments into benchmark script
2021-02-18 15:27:25 +01:00
John J. Camilleri
e6079523f1
Remove ParamAliasDefs by inlining their definitions
2021-02-18 14:45:10 +01:00
John J. Camilleri
866a2101e1
When projecting a non-existent field, return Prelude.False
...
This seems to be GF's own behaviour, as exhibited by the canonical version of PhrasebookTha:
NNumeral Numeral_0 = {s = Numeral_0.s; hasC = <>.hasC};
2021-02-18 14:42:39 +01:00
John J. Camilleri
d8557e8433
Enable debug output to files with envvar DEBUG=1
2021-02-18 14:40:03 +01:00
John J. Camilleri
7a5bc2dab3
Separate compile/run in benchmark
2021-02-17 16:57:06 +01:00
John J. Camilleri
9a263450f5
Add PFG2 linearisation to benchmark
2021-02-17 15:30:11 +01:00
John J. Camilleri
8e1fa4981f
Add memory stats to benchmark
2021-02-17 15:02:39 +01:00
John J. Camilleri
b4fce5db59
Use envvars in benchmark for controlling PGF/LPGF. Add readme.
2021-02-17 11:44:00 +01:00
John J. Camilleri
6a7ead0f84
Add benchmark for comparing PGF and LPGF
2021-02-17 10:04:36 +01:00
John J. Camilleri
d3988f93d5
writePGF et al. functions return path[s] of written files
2021-02-17 10:03:52 +01:00
John J. Camilleri
236dbdbba3
Minor tidying
2021-02-17 00:15:44 +01:00