Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Shapley in LLMAttriution #1175

Closed
wants to merge 2 commits into from

Conversation

aobo-y
Copy link
Contributor

@aobo-y aobo-y commented Aug 25, 2023

Summary: As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Differential Revision: D48697749

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 24, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 24, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 24, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 25, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 30, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

Summary:

Support multi-task attribution in `ShapleyValues` and `ShapleyValueSampling`.

Assuming the return of `forward_fun` is in (*output_shape), the attribution result will be in (*output_shape, *input_shape[1:]). Existing use cases becomes just special cases where output_shape is (1,) or (batch_size,)

Reviewed By: vivekmig

Differential Revision: D48696578
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48697749

aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 30, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 31, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
aobo-y added a commit to aobo-y/captum that referenced this pull request Oct 31, 2023
Summary:

As ShapleyValues and SHapleyValueSampling have supported multi-task output, they can be used with LLMAttribution

Reviewed By: vivekmig

Differential Revision: D48697749
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 1b3225f.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants