Add frameworks

[SecretSheppy]

A list of frameworks that I'm fairly certain output enough data in reports to be supported by Marv.

Framework	Language
Dextool Mutate	C/C++
LittleDarwin	Java
mutaml	OCaml
mutalk ❓	Smalltalk
gambit	Solidity

When one of the above begins active development it will be removed from this table and added to the main support table on the main page.

[SecretSheppy]

Major (Java)

I finally got major 3.0.1 (download at mutation-testing.org) to work (despite docs claiming it need java 8, it actually needs java 11). I can now work on adding support for this. I have immediately noticed that they improved the output from the example in the docs. The 3.0.1 mutants.log file contains the mutations start character (very useful!) but older versions do not.

1:ROR:<=(int,int):<(int,int):triangle.Triangle@classify(int,int,int):14:235:a <= 0 |==> a < 0

Caption: Major 3.0.1 mutants.log format, showing an ROR mutation of line 14, starting at char 235 (from start of file) which replaces a <= 0 with a < 0.

The major documentation contains an example output that does not contain the start char value, otherwise the remaining format is very similar.

11:ROR:<=(int,int):<(int,int):Triangle@classify:18:a <= 0 |==> a < 0

Caption: Major ??? mutants.log format, showing an ROR mutation of line 18 where a <= 0 is replaced with a < 0.

This will require investigation into evolution of major, how many changes to the output were made and when it happened. If it is just the one change, it would be feasible to support both versions; however, if it has changed extensively it would make sense for Marv to only support the most recent version.

[SecretSheppy]

Major (Java)

Continuing from the last comment, I realized that the standalone example included in the major zip distribution doesn't actually report the mutation statuses. When running the ant example, many more files are generated: details.csv, summary.csv, testMap.csv, covMap.csv all of which add data which is valuable to Marv. These files are not detailed in the documentation and I can therefore only assume that they are very new, and I think that means it is best to only support the most recent version of major in Marv.

I have listed the Major status to Marv status conversions below:

Major Status	Marv Status
FAIL	KILLED
LIVE	SURVIVED
TIME	TIMEOUT
EXC	CRASHED
UNCOV	NO_COVERAGE

[SecretSheppy]

Major Support Added

Major support has been officially merged into Marv and will be available in releases 1.2.6+

[SecretSheppy]

Cosmic Ray (Python)

I have some data from this, I am currently waiting for some more (it is very slow). The only thing I can foresee being an issue is that it doesn't report the raw replacement string, the best I have to work with is a text diff.

[SecretSheppy]

Cosmic Ray Support Added

Cosmic Ray support has been officially merged into Marv and will be available in releases 1.2.7+

[SecretSheppy]

Muter (Swift) Removed From Future Support List

As far as I can tell this framework doesn't actually output enough data for Marv. It certainly outputs JSON reports, but only with summary data for each file, not individual mutation data, see: https://github.com/muter-mutation-testing/muter/blob/master/Sources/muterCore/TestReporting/MuterTestReport.swift