Skip to content

Support guardRailConfig for AI Conversation #3073

@thiennguyen-rs

Description

@thiennguyen-rs

Environment information

System:
  OS: macOS 15.6.1
  CPU: (8) arm64 Apple M1
  Memory: 258.70 MB / 16.00 GB
  Shell: /bin/zsh
Binaries:
  Node: 24.9.0 - /Users/tnguyen/.nvm/versions/node/v24.9.0/bin/node
  Yarn: 1.22.22 - /Users/tnguyen/.nvm/versions/node/v24.9.0/bin/yarn
  npm: 11.6.0 - /Users/tnguyen/.nvm/versions/node/v24.9.0/bin/npm
  pnpm: 9.6.0 - /Users/tnguyen/.nvm/versions/node/v24.9.0/bin/pnpm
NPM Packages:
  @aws-amplify/ai-constructs: 1.5.5
  @aws-amplify/auth-construct: 1.10.0
  @aws-amplify/backend: 1.19.0
  @aws-amplify/backend-ai: 1.5.2
  @aws-amplify/backend-auth: 1.9.0
  @aws-amplify/backend-cli: 1.8.1
  @aws-amplify/backend-data: 1.6.2
  @aws-amplify/backend-deployer: 2.1.4
  @aws-amplify/backend-function: 1.15.2
  @aws-amplify/backend-output-schemas: 1.7.1
  @aws-amplify/backend-output-storage: 1.3.2
  @aws-amplify/backend-secret: 1.4.2
  @aws-amplify/backend-storage: 1.4.2
  @aws-amplify/cli-core: 2.2.3
  @aws-amplify/client-config: 1.9.1
  @aws-amplify/data-construct: 1.16.3
  @aws-amplify/data-schema: 1.22.0
  @aws-amplify/deployed-backend-client: 1.8.1
  @aws-amplify/form-generator: 1.2.6
  @aws-amplify/model-generator: 1.2.2
  @aws-amplify/platform-core: 1.10.3
  @aws-amplify/plugin-types: 1.11.1
  @aws-amplify/sandbox: 2.1.4
  @aws-amplify/schema-generator: 1.4.1
  @aws-cdk/toolkit-lib: 1.6.1
  aws-amplify: 6.15.9
  aws-cdk-lib: 2.232.2
  typescript: 5.9.3

Describe the feature

I want to integrate with GuardRail for the AI Conversation. Allow adding guardRailConfig to the ConverseStreamCommandInput

const converseCommandInput: ConverseStreamCommandInput = {
modelId,
messages: [...messages],
system: [{ text: systemPrompt }],
inferenceConfig: inferenceConfiguration,
toolConfig,
};

Use case

A chatbot application can use guardrails to help filter harmful user inputs and toxic model responses.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions