Open
Description
Hello 👋!
Where can I find documentation how to deploy https://huggingface.co/nvidia/quality-classifier-deberta to sagemaker ?
Previously I was using such cdk definition
const model = new sagemaker.CfnModel(this, "Model", {
executionRoleArn: sagemakerRole.roleArn,
primaryContainer: {
image: "763104351884.dkr.ecr.eu-west-1.amazonaws.com/huggingface-pytorch-inference:2.0.0-transformers4.28.1-gpu-py310-cu118-ubuntu20.04",
environment: {
HF_MODEL_ID: ""
HF_TASK: ""
},
},
});
Also I need structure of input parameters for sagemaker to test ready endpoint.
Is there any way to do so?
Metadata
Metadata
Assignees
Labels
No labels