Skip to content

New sagemaker sdk release made local_mode none functional #5258

@melanie531

Description

@melanie531

Describe the bug
When running local mode, the cell never finishes and eventually timedout
│ /home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/sagemaker/local/entities.py:9 │
│ 93 in _wait_for_serving_container │
│ │
│ 990 │ while True: │
│ 991 │ │ i += 5 │
│ 992 │ │ if i >= HEALTH_CHECK_TIMEOUT_LIMIT: │
│ ❱ 993 │ │ │ raise RuntimeError("Giving up, endpoint didn't launch correctly") │
│ 994 │ │ │
│ 995 │ │ logger.info("Checking if serving container is up, attempt: %s", i) │
│ 996 │ │ _, code = _perform_request(endpoint_url, http) │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Giving up, endpoint didn't launch correctly

Also not able to get to the internet, getting a message at the beginning when starting local mode
RootlessDocker not detected, falling back to remote host IP or localhost.

To reproduce
A clear, step-by-step set of instructions to reproduce the bug.
The provided code need to be complete and runnable, if additional data is needed, please include them in the issue.
Run any local mode example can reproduce this
Expected behavior
A clear and concise description of what you expected to happen.

Screenshots or logs
If applicable, add screenshots or logs to help explain your problem.

System information
A description of your system. Please provide:

  • SageMaker Python SDK version:
  • Framework name (eg. PyTorch) or algorithm (eg. KMeans):
  • Framework version:
  • Python version:
  • CPU or GPU:
  • Custom Docker image (Y/N):

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions