Skip to content

[Bug Report] p2.xlarge is not supported for "BERT Base Cased" model deployment! #4833

Description

@sevmax7

Link to the notebook
Introduction to SageMaker HuggingFace - Text Classification.

Describe the bug
In "4.6. Deploy & run Inference on the fine-tuned model" section, the instance type is set to "ml.p2.xlarge"; however, it's not supported for the "BERT Base Cased" model. Here is the error message when creating the endpoint with p2.xlarge instance:

Invalid combination: instance p2 and Cuda 12.2. Please provide a supported configuration for this region.

To reproduce
Running the notebook with default settings will replicate the error.

Logs
N/A

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions