1.4.0
A new operator table, operators.yml was added to contain operator information. This information is based on information from Robert Jacobson.
See https://github.com/WLTools/LanguageSpec/blob/master/docs/Specification/Syntax/Operator%20Table.csv
From operators.yml, operators.json is created, and this holds operator information that the Mathics3 Kernel uses.
Things like operator precedence, operator arity, associativity, and AMSLaTeX equivalent notation are some of the information we store.
All of the 100 or so Unicode operators without an initial built-in meaning, .e.g., [Cup], [Cap], ... have been added.
The tokenizer and parser in the Mathics3 Kernel use more YAML table information via JSON extraction. However, more will be done in the future.
A new utility program, mathics3-tokens can be used to show tokenization of an input stream, with the -C or --CodeTokenize option, the program shows the tokens more closely in the form that the WMA CodeTokens package uses. Over time, we expect that our tokenizer will be more compliant with CodeTokens.
named-characters.yml was gone over, mostly to fill out information, such as URL links to Unicode pages.
Operator precedence values have been gone over.