Issues with VPC configuration for Main Appsync resolver Lambda

[shantanusvam]

We are experiencing errors with the Main Appsync resolver Lambda where the application in resulting in task timed out after 3 seconds.

Have others experienced this issue in the past?

I can help share the CloudWatch log if that's helpful.

[shantanusvam]

One of the error in our CloudWatch logs we see is:

2025-04-20 15:41:03.030 "{""level"":""ERROR"",""location"":""list_bedrock_models:188"",""message"":""Error listing Bedrock models: Connect timeout on endpoint URL: ""https://bedrock.us-west-2.amazonaws.com/foundation-models?byInferenceType=ON_DEMAND\"""",""timestamp"":""2025-04-20 15:41:03,030+0000"",""service"":""chatbot"",""cold_start"":false,""function_name"":""svamGenAIChatBotStack-ChatBotApiRestApiGraphQLApiH-5qtiSsmxrRVa"",""function_memory_size"":""512"",""function_arn"":""arn:aws:lambda:us-west-2:707829745981:function:svamGenAIChatBotStack-ChatBotApiRestApiGraphQLApiH-5qtiSsmxrRVa"",""function_request_id"":""60c14ab7-6703-465c-9a92-558da82ded7e"",""correlation_id"":""Root=1-68051456-3ca57a2473f87f994d3fac4a"",""xray_trace_id"":""1-68051456-2dd7545a0e5e0e7a738ac517""}
" 2025/04/20/svamGenAIChatBotStack-ChatBotApiRestApiGraphQLApiH-5qtiSsmxrRVa[$LATEST]69bf341bac1b4fd985da1139b9ee4399 707829745981:/aws/lambda/svamGenAIChatBotStack-ChatBotApiRestApiGraphQLApiH-5qtiSsmxrRVa

Sample code for testing model access seem to be working

cat testmodels.py

import boto3
import json

def list_foundation_models():
    # Create a Bedrock client
    bedrock_client = boto3.client('bedrock', region_name='us-west-2')

    try:
        # Call the ListFoundationModels API
        response = bedrock_client.list_foundation_models()
        
        # Extract the model summaries from the response
        models = response.get("modelSummaries", [])
        
        print(f"Found {len(models)} foundation models:")
        for model in models:
            print(f"- Model Name: {model['modelName']}")
            print(f"  Model ID: {model['modelId']}")
            print(f"  Provider Name: {model['providerName']}")
            print("  Inference Types:")
            for inference_type in model.get('inferenceTypesSupported', []):
                print(f"    - {inference_type}")
            print("---")
        
        return models
    
    except Exception as e:
        print(f"An error occurred: {str(e)}")
        return None

if __name__ == "__main__":
    list_foundation_models()

python3 testmodels.py
Found 88 foundation models:

• Model Name: Titan Text Large
  Model ID: amazon.titan-tg1-large
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Text Embeddings v2
  Model ID: amazon.titan-embed-g1-text-02
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Text G1 - Lite
  Model ID: amazon.titan-text-lite-v1:0:4k
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED

---

• Model Name: Titan Text G1 - Lite
  Model ID: amazon.titan-text-lite-v1
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Text G1 - Express
  Model ID: amazon.titan-text-express-v1:0:8k
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED

---

• Model Name: Titan Text G1 - Express
  Model ID: amazon.titan-text-express-v1
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Nova Pro
  Model ID: amazon.nova-pro-v1:0
  Provider Name: Amazon
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Nova Lite
  Model ID: amazon.nova-lite-v1:0
  Provider Name: Amazon
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Nova Micro
  Model ID: amazon.nova-micro-v1:0
  Provider Name: Amazon
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Titan Embeddings G1 - Text
  Model ID: amazon.titan-embed-text-v1:2:8k
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED

---

• Model Name: Titan Embeddings G1 - Text
  Model ID: amazon.titan-embed-text-v1
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Text Embeddings V2
  Model ID: amazon.titan-embed-text-v2:0
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Multimodal Embeddings G1
  Model ID: amazon.titan-embed-image-v1:0
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED

---

• Model Name: Titan Multimodal Embeddings G1
  Model ID: amazon.titan-embed-image-v1
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Image Generator G1
  Model ID: amazon.titan-image-generator-v1:0
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED

---

• Model Name: Titan Image Generator G1
  Model ID: amazon.titan-image-generator-v1
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: Titan Image Generator G1 v2
  Model ID: amazon.titan-image-generator-v2:0
  Provider Name: Amazon
  Inference Types:
  • PROVISIONED
  • ON_DEMAND

---

• Model Name: Rerank 1.0
  Model ID: amazon.rerank-v1:0
  Provider Name: Amazon
  Inference Types:
  • ON_DEMAND

---

• Model Name: SDXL 1.0
  Model ID: stability.stable-diffusion-xl-v1:0
  Provider Name: Stability AI
  Inference Types:
  • PROVISIONED

---

• Model Name: SDXL 1.0
  Model ID: stability.stable-diffusion-xl-v1
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: SD3 Large 1.0
  Model ID: stability.sd3-large-v1:0
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Stable Diffusion 3.5 Large
  Model ID: stability.sd3-5-large-v1:0
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Stable Image Core 1.0
  Model ID: stability.stable-image-core-v1:0
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Stable Image Core 1.0
  Model ID: stability.stable-image-core-v1:1
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Stable Image Ultra 1.0
  Model ID: stability.stable-image-ultra-v1:0
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Stable Image Ultra 1.0
  Model ID: stability.stable-image-ultra-v1:1
  Provider Name: Stability AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3.5 Sonnet v2
  Model ID: anthropic.claude-3-5-sonnet-20241022-v2:0:18k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet v2
  Model ID: anthropic.claude-3-5-sonnet-20241022-v2:0:51k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet v2
  Model ID: anthropic.claude-3-5-sonnet-20241022-v2:0:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet v2
  Model ID: anthropic.claude-3-5-sonnet-20241022-v2:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3.7 Sonnet
  Model ID: anthropic.claude-3-7-sonnet-20250219-v1:0
  Provider Name: Anthropic
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Claude 3.5 Haiku
  Model ID: anthropic.claude-3-5-haiku-20241022-v1:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude Instant
  Model ID: anthropic.claude-instant-v1:2:100k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude Instant
  Model ID: anthropic.claude-instant-v1
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude
  Model ID: anthropic.claude-v2:0:18k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude
  Model ID: anthropic.claude-v2:0:100k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude
  Model ID: anthropic.claude-v2:1:18k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude
  Model ID: anthropic.claude-v2:1:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude
  Model ID: anthropic.claude-v2:1
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude
  Model ID: anthropic.claude-v2
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3 Sonnet
  Model ID: anthropic.claude-3-sonnet-20240229-v1:0:28k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Sonnet
  Model ID: anthropic.claude-3-sonnet-20240229-v1:0:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Sonnet
  Model ID: anthropic.claude-3-sonnet-20240229-v1:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3 Haiku
  Model ID: anthropic.claude-3-haiku-20240307-v1:0:48k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Haiku
  Model ID: anthropic.claude-3-haiku-20240307-v1:0:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Haiku
  Model ID: anthropic.claude-3-haiku-20240307-v1:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3 Opus
  Model ID: anthropic.claude-3-opus-20240229-v1:0:12k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Opus
  Model ID: anthropic.claude-3-opus-20240229-v1:0:28k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Opus
  Model ID: anthropic.claude-3-opus-20240229-v1:0:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3 Opus
  Model ID: anthropic.claude-3-opus-20240229-v1:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND

---

• Model Name: Claude 3.5 Sonnet
  Model ID: anthropic.claude-3-5-sonnet-20240620-v1:0:18k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet
  Model ID: anthropic.claude-3-5-sonnet-20240620-v1:0:51k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet
  Model ID: anthropic.claude-3-5-sonnet-20240620-v1:0:200k
  Provider Name: Anthropic
  Inference Types:
  • PROVISIONED

---

• Model Name: Claude 3.5 Sonnet
  Model ID: anthropic.claude-3-5-sonnet-20240620-v1:0
  Provider Name: Anthropic
  Inference Types:
  • ON_DEMAND
  • INFERENCE_PROFILE

---

• Model Name: Command
  Model ID: cohere.command-text-v14:7:4k
  Provider Name: Cohere
  Inference Types:
  • PROVISIONED

---

• Model Name: Command
  Model ID: cohere.command-text-v14
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Command R
  Model ID: cohere.command-r-v1:0
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Command R+
  Model ID: cohere.command-r-plus-v1:0
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Command Light
  Model ID: cohere.command-light-text-v14:7:4k
  Provider Name: Cohere
  Inference Types:
  • PROVISIONED

---

• Model Name: Command Light
  Model ID: cohere.command-light-text-v14
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Embed English
  Model ID: cohere.embed-english-v3:0:512
  Provider Name: Cohere
  Inference Types:
  • PROVISIONED

---

• Model Name: Embed English
  Model ID: cohere.embed-english-v3
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Embed Multilingual
  Model ID: cohere.embed-multilingual-v3:0:512
  Provider Name: Cohere
  Inference Types:
  • PROVISIONED

---

• Model Name: Embed Multilingual
  Model ID: cohere.embed-multilingual-v3
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: Rerank 3.5
  Model ID: cohere.rerank-v3-5:0
  Provider Name: Cohere
  Inference Types:
  • ON_DEMAND

---

• Model Name: DeepSeek-R1
  Model ID: deepseek.r1-v1:0
  Provider Name: DeepSeek
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Llama 3 8B Instruct
  Model ID: meta.llama3-8b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • ON_DEMAND

---

• Model Name: Llama 3 70B Instruct
  Model ID: meta.llama3-70b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • ON_DEMAND

---

• Model Name: Llama 3.1 8B Instruct
  Model ID: meta.llama3-1-8b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.1 8B Instruct
  Model ID: meta.llama3-1-8b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • ON_DEMAND

---

• Model Name: Llama 3.1 70B Instruct
  Model ID: meta.llama3-1-70b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.1 70B Instruct
  Model ID: meta.llama3-1-70b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • ON_DEMAND

---

• Model Name: Llama 3.1 405B Instruct
  Model ID: meta.llama3-1-405b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • ON_DEMAND

---

• Model Name: Llama 3.2 11B Instruct
  Model ID: meta.llama3-2-11b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.2 11B Instruct
  Model ID: meta.llama3-2-11b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Llama 3.2 90B Instruct
  Model ID: meta.llama3-2-90b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.2 90B Instruct
  Model ID: meta.llama3-2-90b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Llama 3.2 1B Instruct
  Model ID: meta.llama3-2-1b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.2 1B Instruct
  Model ID: meta.llama3-2-1b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Llama 3.2 3B Instruct
  Model ID: meta.llama3-2-3b-instruct-v1:0:128k
  Provider Name: Meta
  Inference Types:
  • PROVISIONED

---

• Model Name: Llama 3.2 3B Instruct
  Model ID: meta.llama3-2-3b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Llama 3.3 70B Instruct
  Model ID: meta.llama3-3-70b-instruct-v1:0
  Provider Name: Meta
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Mistral 7B Instruct
  Model ID: mistral.mistral-7b-instruct-v0:2
  Provider Name: Mistral AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Mixtral 8x7B Instruct
  Model ID: mistral.mixtral-8x7b-instruct-v0:1
  Provider Name: Mistral AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Mistral Large (24.02)
  Model ID: mistral.mistral-large-2402-v1:0
  Provider Name: Mistral AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Mistral Large (24.07)
  Model ID: mistral.mistral-large-2407-v1:0
  Provider Name: Mistral AI
  Inference Types:
  • ON_DEMAND

---

• Model Name: Pixtral Large (25.02)
  Model ID: mistral.pixtral-large-2502-v1:0
  Provider Name: Mistral AI
  Inference Types:
  • INFERENCE_PROFILE

---

• Model Name: Ray v2
  Model ID: luma.ray-v2:0
  Provider Name: Luma AI
  Inference Types:
  • ON_DEMAND

---