Skip to content

Releases: aws/deep-learning-containers

v1.3-djl-0.24.0-inf-ds-0.10.0

19 Jan 21:27
@aws-dlinfra-bot aws-dlinfra-bot
v1.3-djl-0.24.0-inf-ds-0.10.0
42a2cd0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.3-djl-0.24.0-inf-ds-0.10.0

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.24.0-deepspeed0.10.0-cu118-v1.3 
sha256:03c6627c7c123551124204e5ff2610d9836f0f1623bd233d37e0f71cca3a1c84

All tags:

0.24.0-deepspeed0.10.0-cu118
0.24.0-deepspeed0.10.0-cu118-v1.3
0.24.0-deepspeed0.10.0-cu118-v1.3-2024-01-19-18-09-52
0.24-deepspeed0.10.0-cu118-v1

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 cuda-command-line-tools-11-8
awscli==1.32.19 libcublas-11-8 & libcublas-dev-11-8
botocore==1.34.19 libcudnn8 & libcudnn8-dev
datasets==2.14.5 libgcc-8-dev:amd64 & libgcc-9-dev:amd64 & libgcc-s1:amd64
filelock==3.13.1 libgcc-8-dev:amd64 & libgcc-9-dev:amd64 & libgcc-s1:amd64
mpi4py==3.1.5 libnccl-dev & libnccl2
ninja==1.11.1.1 libnccl-dev
numpy==1.26.3 libstdc++-9-dev:amd64 & libstdc++6:amd64
packaging==23.2
pandas==2.1.4
pillow==10.2.0
protobuf==3.20.3
py-cpuinfo==9.0.0
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.4
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.14.1
torch==2.0.1+cu118
torchvision==0.15.2+cu118
transformers==4.34.0
Assets 3
Loading

v1.2-djl-0.24.0-inf-ft-5.3.0

19 Jan 02:33
@aws-dlinfra-bot aws-dlinfra-bot
v1.2-djl-0.24.0-inf-ft-5.3.0
1f7ef07
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.2-djl-0.24.0-inf-ft-5.3.0

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.24.0-fastertransformer5.3.0-cu118-v1.2 
sha256:4f4e29af2501a09a84cfe710acc67835663aefa6a65896693e47aecd91aad55b

All tags:

0.24.0-fastertransformer5.3.0-cu118
0.24-fastertransformer5.3.0-cu118-v1
0.24.0-fastertransformer5.3.0-cu118-v1.2-2024-01-19-00-27-26
0.24.0-fastertransformer5.3.0-cu118-v1.2

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 cuda-command-line-tools-11-8
awscli==1.32.19 libcublas-11-8 & libcublas-dev-11-8
botocore==1.34.19 libcudnn8 & libcudnn8-dev
datasets==2.14.7 libgcc-9-dev:amd64 & libgcc-s1:amd64
filelock==3.13.1 libgcc-9-dev:amd64 & libgcc-s1:amd64
ninja==1.11.1.1 libnccl-dev & libnccl2
numpy==1.26.3 libnccl-dev
packaging==23.2 libstdc++-9-dev:amd64 & libstdc++6:amd64
pandas==2.1.4
protobuf==3.20.3
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.4
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.14.1
torch==1.13.1+cu117
transformers==4.34.0
Assets 3
Loading

v1.1-djl-0.26.0-inf-ds-0.12.6

19 Jan 03:17
@aws-dlinfra-bot aws-dlinfra-bot
v1.1-djl-0.26.0-inf-ds-0.12.6
42a2cd0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.1-djl-0.26.0-inf-ds-0.12.6

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.26.0-deepspeed0.12.6-cu121-v1.1 
sha256:fd633bcdce909d8cd3fe7e23e1a4d772052d3f896fd666e45339bead58bb9863

All tags:

0.26-deepspeed0.12.6-cu121-v1
0.26.0-deepspeed0.12.6-cu121-v1.1
0.26.0-deepspeed0.12.6-cu121
0.26.0-deepspeed0.12.6-cu121-v1.1-2024-01-19-01-02-35

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 cuda-command-line-tools-12-1
awscli==1.32.22 libcublas-12-1 & libcublas-dev-12-1
botocore==1.34.22 libcudnn8 & libcudnn8-dev
datasets==2.15.0 libgcc-11-dev:amd64 & libgcc-s1:amd64
filelock==3.13.1 libgcc-11-dev:amd64 & libgcc-s1:amd64
mpi4py==3.1.5 libnccl-dev & libnccl2
ninja==1.11.1.1 libnccl-dev
numpy==1.26.3 libstdc++-11-dev:amd64 & libstdc++6:amd64
packaging==23.2
pandas==2.1.4
pillow==10.2.0
protobuf==3.20.3
py-cpuinfo==9.0.0
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.4
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.15.0
torch==2.1.2+cu121
torchvision==0.16.2+cu121
transformers==4.36.2
Assets 3
Loading

v1.0-hf-tgi-0.0.16-pt-1.13.1-inf-neuronx-py310

19 Jan 18:30
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-hf-tgi-0.0.16-pt-1.13.1-inf-neuronx-py310
42a2cd0
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-hf-tgi-0.0.16-pt-1.13.1-inf-neuronx-py310

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

These images are built to be used only on AWS SageMaker

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:1.13.1-optimum0.0.16-neuronx-py310-ubuntu22.04-v1.0 
sha256:52c7da19aa9ff11bb53212a23fb16b66b140c13837b2f919ff7c833ef22d2dbf

All tags:

1.13.1-optimum0.0.16-neuronx-py310-ubuntu22.04-v1.0-2024-01-19-16-21-27
1.13-optimum0.0-neuronx-py310-ubuntu22.04-v1
1.13.1-optimum0.0.16-neuronx-py310-ubuntu22.04
1.13-neuronx-py310-ubuntu22.04-v1
1.13.1-neuronx-py310-ubuntu22.04
1.13-optimum0.0-neuronx-py310-ubuntu22.04
1.13.1-optimum0.0.16-neuronx-py310-ubuntu22.04-v1.0

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 libgcc-11-dev:amd64 & libgcc-12-dev:amd64 & libgcc-s1:amd64
absl-py==2.1.0 libgcc-11-dev:amd64 & libgcc-12-dev:amd64 & libgcc-s1:amd64
boto3==1.34.22 libstdc++6:amd64
botocore==1.34.22
datasets==2.14.7
filelock==3.13.1
numpy==1.25.2
packaging==23.2
pandas==2.1.4
protobuf==3.20.3
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.2
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.14.1
torch==1.13.1
transformers==4.35.0
Assets 3
Loading

v1.0-djl-0.26.0-inf-trt-0.7.1

18 Jan 03:53
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-djl-0.26.0-inf-trt-0.7.1
1db006d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-djl-0.26.0-inf-trt-0.7.1

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.26.0-tensorrtllm0.7.1-cu122-v1.0 
sha256:b38eb2b4ff0b49f65cefb2507c34b2669db86c5e427615c61136642710eda8ad

All tags:

0.26.0-tensorrtllm0.7.1-cu122
0.26.0-tensorrtllm0.7.1-cu122-v1.0-2024-01-18-01-16-23
0.26-tensorrtllm0.7.1-cu122-v1
0.26.0-tensorrtllm0.7.1-cu122-v1.0

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 cuda-command-line-tools-12-2
awscli==1.32.19 libcublas-12-2 & libcublas-dev-12-2
botocore==1.34.19 libcudnn8 & libcudnn8-dev
Cython==3.0.8 libgcc-11-dev:amd64 & libgcc-s1:amd64
datasets==2.16.1 libgcc-11-dev:amd64 & libgcc-s1:amd64
filelock==3.13.1 libnccl-dev & libnccl2
mpi4py==3.1.5 libnccl-dev
ninja==1.11.1.1 libstdc++-11-dev:amd64 & libstdc++6:amd64
numpy==1.26.3
packaging==23.2
pandas==2.1.4
pillow==10.2.0
protobuf==4.25.2
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.4
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.15.0
torch==2.1.0
torchvision==0.16.0
transformers==4.36.2
Assets 3
Loading

v1.0-djl-0.26.0-inf-cpu-full

18 Jan 02:16
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-djl-0.26.0-inf-cpu-full
abb6184
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-djl-0.26.0-inf-cpu-full

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.26.0-cpu-full-v1.0 
sha256:8f8cdeba82a3f00372d31b9d2e9de970836cf877ae74ed987315e9d8a2266d9e

All tags:

0.26-cpu-full-v1
0.26.0-cpu-full-v1.0-2024-01-18-01-31-45
0.26.0-cpu-full-v1.0
0.26.0-cpu-full

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 libgcc-11-dev:amd64 & libgcc-s1:amd64
awscli==1.32.19 libgcc-11-dev:amd64 & libgcc-s1:amd64
botocore==1.34.19 libstdc++-11-dev:amd64 & libstdc++6:amd64
numpy==1.26.3
requests==2.31.0
s3transfer==0.10.0
setuptools==59.6.0
Assets 3
Loading

v1.0-triton-23.12-py3

17 Jan 22:19
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-triton-23.12-py3
e9cd7ba
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-triton-23.12-py3

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/sagemaker-tritonserver:23.12-py3-cpu-v1.0 
sha256:17f55e53c780293b01572ecbbcf47f601ccbf74db16e3b6dbd101bf3165c9617

All tags:

23.12-py3-cpu-v1.0
23.12-py3-cpu
23.12-py3-cpu-v1.0-2024-01-16-20-16-09

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 libgcc-11-dev:amd64 & libgcc-s1:amd64
awscli==1.32.12 libgcc-11-dev:amd64 & libgcc-s1:amd64
botocore==1.34.12 libstdc++-11-dev:amd64 & libstdc++6:amd64
numpy==1.26.3
s3transfer==0.10.0
setuptools==69.0.3
  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/sagemaker-tritonserver:23.12-py3-v1.0 
sha256:b6fa1095e81b9e67e62931455d1e0d39014bfb2d9a62d6b5e6e1feed93f64956

All tags:

23.12-py3-v1.0
23.12-py3
23.12-py3-v1.0-2024-01-16-20-16-58

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 libcublas-12-3 & libcublas-dev-12-3
awscli==1.32.11 libcudnn8 & libcudnn8-dev
botocore==1.34.11 libgcc-11-dev:amd64 & libgcc-s1:amd64
numpy==1.26.2 libgcc-11-dev:amd64 & libgcc-s1:amd64
s3transfer==0.10.0 libnccl-dev & libnccl2
setuptools==69.0.3 libnccl-dev
libstdc++-11-dev:amd64 & libstdc++6:amd64
Assets 4
Loading

v1.0-djl-0.26.0-inf-neuronx-sdk2.16.0

17 Jan 22:13
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-djl-0.26.0-inf-neuronx-sdk2.16.0
2370633
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-djl-0.26.0-inf-neuronx-sdk2.16.0

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.26.0-neuronx-sdk2.16.0-v1.0 
sha256:5fb0cb418f37363633907270e3f28bf19f5bb3f44a30290d09edf66629bdf4d4

All tags:

0.26.0-neuronx-sdk2.16.0-v1.0-2024-01-17-20-32-45
0.26.0-neuronx-sdk2.16.0-v1.0
0.26.0-neuronx-sdk2.16.0
0.26-neuronx-sdk2.16.0-v1

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 libgcc-9-dev:amd64 & libgcc-s1:amd64
absl-py==2.0.0 libgcc-9-dev:amd64 & libgcc-s1:amd64
awscli==1.32.19 libstdc++-9-dev:amd64 & libstdc++6:amd64
boto3==1.34.19
botocore==1.34.19
datasets==2.14.7
filelock==3.13.1
numpy==1.25.2
packaging==23.2
pandas==2.1.4
pillow==10.2.0
protobuf==3.19.6
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.2
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.14.1
torch==1.13.1
transformers==4.35.0
Assets 3
Loading

v1.0-djl-0.26.0-inf-ds-0.12.6

18 Jan 02:24
@aws-dlinfra-bot aws-dlinfra-bot
v1.0-djl-0.26.0-inf-ds-0.12.6
394b96f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.0-djl-0.26.0-inf-ds-0.12.6

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.26.0-deepspeed0.12.6-cu121-v1.0 
sha256:aead9e5dc6e6ad4d222fdc7ab555f845b94d0d035b7e6dd627d28cb484bf4b1b

All tags:

0.26-deepspeed0.12.6-cu121-v1
0.26.0-deepspeed0.12.6-cu121
0.26.0-deepspeed0.12.6-cu121-v1.0
0.26.0-deepspeed0.12.6-cu121-v1.0-2024-01-17-23-47-06

Important Packages:

pip packages apt|deb packages
PyYAML==6.0.1 cuda-command-line-tools-12-1
awscli==1.32.19 libcublas-12-1 & libcublas-dev-12-1
botocore==1.34.19 libcudnn8 & libcudnn8-dev
datasets==2.15.0 libgcc-11-dev:amd64 & libgcc-s1:amd64
filelock==3.13.1 libgcc-11-dev:amd64 & libgcc-s1:amd64
mpi4py==3.1.5 libnccl-dev & libnccl2
ninja==1.11.1.1 libnccl-dev
numpy==1.26.3 libstdc++-11-dev:amd64 & libstdc++6:amd64
packaging==23.2
pandas==2.1.4
pillow==10.2.0
protobuf==3.20.3
py-cpuinfo==9.0.0
regex==2023.12.25
requests==2.31.0
s3transfer==0.10.0
scipy==1.11.4
sentencepiece==0.1.99
setuptools==69.0.3
tokenizers==0.15.0
torch==2.1.2+cu121
torchvision==0.16.2+cu121
transformers==4.36.2
Assets 3
Loading

v1.8-pt-sagemaker-1.13.1-inf-cpu-py39

09 Jan 09:59
@aws-dlinfra-bot aws-dlinfra-bot
v1.8-pt-sagemaker-1.13.1-inf-cpu-py39
125f792
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v1.8-pt-sagemaker-1.13.1-inf-cpu-py39

For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

Images Published:

  1. 763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference:1.13.1-cpu-py39-ubuntu20.04-sagemaker-v1.8 
sha256:4e2bd083e10da23c246995551ae9f5f419ef3244c12f9883a7c207aa1d346f0e

All tags:

1.13.1-cpu-py39
1.13-cpu-py39
1.13.1-cpu-py39-ubuntu20.04-sagemaker-v1.8
1.13.1-cpu-py39-ubuntu20.04-sagemaker-v1.8-2024-01-09-07-49-08
1.13.1-cpu-py39-ubuntu20.04-sagemaker
1.13-cpu-py39-ubuntu20.04-sagemaker-v1

Important Packages:

pip packages apt|deb packages
PyYAML==6.0 emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common
awscli==1.32.8 emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common
boto3==1.34.8 libgcc-9-dev:amd64 & libgcc-s1:amd64
botocore==1.34.8 libgcc-9-dev:amd64 & libgcc-s1:amd64
cffi==1.16.0 libstdc++-9-dev:amd64 & libstdc++6:amd64
Cython==3.0.7
h5py==3.8.0
mpi4py==3.1.5
numpy==1.22.4
opencv-python==4.9.0.80
packaging==23.1
pandas==2.1.4
pillow==10.2.0
requests==2.31.0
s3transfer==0.10.0
scikit-learn==1.3.2
SciPy==1.11.4
setuptools==69.0.3
torch==1.13.1+cpu
torch-model-archiver==0.8.2
torchaudio==0.13.1+cpu
torchserve==0.8.2
torchvision==0.14.1+cpu
Assets 3
Loading