# Word Squares Data Sources and License

The English and Icelandic Word Squares files in this directory are generated
adaptations of external word data.

## FrequencyWords

The frequency-ranked inputs are from the 2018 English and Icelandic lists in
[FrequencyWords](https://github.com/hermitdave/FrequencyWords) by Hermit Dave.
The project identifies its content as licensed under the
[Creative Commons Attribution-ShareAlike 4.0 International license](https://creativecommons.org/licenses/by-sa/4.0/).
The lists were generated from tokenized OpenSubtitles data.

BergPuzzles made the following changes:

- selected fixed frequency thresholds;
- normalized and filtered entries;
- intersected the English list with ENABLE;
- corrected known Icelandic thorn and eth encoding substitutions;
- generated acceptance dictionaries and symmetric word-square puzzles; and
- serialized the derived outputs as JSON for the game.

The adapted Word Squares data files in this directory are distributed under
CC BY-SA 4.0. No endorsement by the source authors or OpenSubtitles is implied.

Source files:

- English: `content/2018/en/en_50k.txt`
- Icelandic: `content/2018/is/is_50k.txt`

Pinned local input SHA-256 values:

- English FrequencyWords input: `5351ff405b1126ef555791dd4d9798a48e3e9a501a9fc481a9da957752cfb458`
- Icelandic FrequencyWords input: `8c47a7795970edb55178a84d16a568422186c2299024b12a2fc4a0df85ef4e27`

## ENABLE

The English validity filter also uses the Enhanced North American Benchmark
Lexicon, or ENABLE, by M. Cooper and Alan Beale. ENABLE was released to the
public domain. BergPuzzles used the `enable1.txt` mirror at
https://github.com/dolph/dictionary.

Pinned local ENABLE input SHA-256:

`3f16130220645692ed49c7134e24a18504c2ca55b3c012f7290e3e77c63b1a89`

## Shipped output checksums

- `words-4.json`: `782e6d0a5702d56d34e97c38c251a64f643151d8333e2bc1ddd5acf1cfa35234`
- `words-5.json`: `89f990a9612c62b685f4e9c18b8101cc72c1fdf09840efdf3205225be660c73d`
- `daily/puzzles.json`: `26e0486a0f1cff2966c62b1c5d8dbb726b06f3b7da2cfd9139c96113707a76c9`
- `is/words-4.json`: `4b6058be7f564941db58c205177dd48d9bb5433115ac381d519fac5d6128ab30`
- `is/words-5.json`: `97e37935ca63604ba8864806d2fc5ae43e2c02ad769f76b3f7a3a2b6ab6da900`
- `is/daily/puzzles.json`: `8de2e045ed8823ab7d30d7b1ec3e5277cbd966e673a7a5eecfd88766262488ea`