Intrinsic Verification - AI Code Detection #17
Description
This standalone application is intended to be used in running automated static code scans on wp packages submitted for federation on the FAIR network to assess whether a significant percentage of the code appears to be AI-generated. While AI-generated code is not inherently bad and is not considered grounds to refuse federating the package, we anticipate that if a package is largely AI-generated and does not have multiple contributors, there may be a lower likelihood that the package will be actively maintained and updated. Examples of prior art are shown here along with other resources, but are not intended as an exhaustive or approved list of libraries to be used, and this may be used as a factor in calculating trust scores.
As described in AI Code Detection:
- AI Code Detector by Span App
- Botsniffer
- Append results to fair-forge-meta per spec
(Relates to repo health: AI-generated code is less likely to be maintained unless it represents only a small percentage of the codebase.)
Resulting output to STDOUT is fine, can be piped where we need it later. Output format should be along these lines: