Integrating OpenAI Code Analysis for identifying harmful code#4
Draft
ZanattaMichael wants to merge 23 commits into
Draft
Integrating OpenAI Code Analysis for identifying harmful code#4ZanattaMichael wants to merge 23 commits into
ZanattaMichael wants to merge 23 commits into
Conversation
added 13 commits
May 8, 2023 16:52
Added AI Conditions
Updated Dependency Versions
Fixing Errors in Code
Updating Dependecies
This comment was marked as resolved.
This comment was marked as resolved.
added 10 commits
May 10, 2023 21:17
Debugging AI Endpoint.
Updating Configuration Fixing Bugs
Refactoring AI logic to be include PSP non-ai conditions Added New-AIConfiguration
Member
|
@ZanattaMichael - I realize this PR is literally years old but I'm curious if you would care if I resurrected it. I reviewed it and it looks really cool and I could do some work to update for changes that have come around recently. |
Author
|
@adamdriscoll No issues. Go for it! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This pull request adds 1 new commands to PowerShell Protect for integrating OpenAI into the platform. The new commands
New-PNPAIConditionwith 2 conditions added. These are:AIisBestPracticeConditionandAIisSuspiciousCondition.New Commands Added
New Conditions Added
AIisBestPracticeCondition: This condition checks whether an AI model adheres to best practices for training and deployment. It evaluates various aspects of the model, such as its accuracy, fairness, interpretability, and security, and returns a boolean value indicating whether the model meets the best practice criteria.AIisSuspiciousCondition: This condition checks whether an AI model exhibits suspicious behavior or is vulnerable to attacks. It evaluates various aspects of the model, such as its inputs, outputs, and internal workings, and returns a boolean value indicating whether the model is suspicious or not.Usage Example
Testing
Initial Testing, however AI Testing (with mocking) is not functional.
Documentation
None so far.
Contributors