Merge branch 'master' into add-nf-wave-topics-to-docs

.codespellignore

@@ -0,0 +1,2 @@
+carrer
+ser

.github/workflows/codespell.yml

@@ -0,0 +1,26 @@
+---
+name: Codespell
+
+on:
+  push:
+    branches: [master]
+  pull_request:
+    branches: [master]
+
+permissions:
+  contents: read
+
+jobs:
+  codespell:
+    name: Check for spelling errors
+    runs-on: ubuntu-latest
+
+    steps:
+      - name: Checkout
+        uses: actions/checkout@v4
+      - name: Codespell
+        uses: codespell-project/actions-codespell@v2
+        with:
+          only_warn: 1
+          ignore_words_file: .codespellignore
+          exclude_file: src/main/resources/application-reserved-words.yml

.github/workflows/typespec.yml

@@ -0,0 +1,40 @@
+---
+name: Typespec_Validation
+
+on:
+  push:
+    branches:
+      - '**'
+    paths :
+      - 'typespec/**'
+  pull_request:
+    types: [opened, reopened, synchronize]
+    paths:
+      - 'typespec/**'
+
+permissions:
+  contents: read
+
+jobs:
+  typespec_validation:
+    name: validate typespec files
+    runs-on: ubuntu-latest
+
+    steps:
+      - name : Checkout
+        uses : actions/checkout@v4
+
+      - name : Setup Node.js environment
+        uses : actions/setup-node@v4
+        with :
+          node-version : '20.9.0'
+
+      - name : Install tsp
+        run : npm install -g @typespec/compiler
+
+      - name : Validate tsp files
+        run : |
+          cd typespec
+          tsp install
+          tsp compile .
+

.gitignore

@@ -32,3 +32,8 @@ scan-workspace/
 .cache
 site/
 deployment-url.txt
+
+#typespec
+tsp-output/
+node_modules/
+package-lock.json

README.md

@@ -14,7 +14,7 @@ images.
 * Augment container images i.e. dynamically add one or more container layers to existing images;
 * Build container images on-demand for a given container file (aka Dockerfile);
 * Build container images on-demand based on one or more Conda packages;
-* Build container images on-demand based on one or more Spack packages;
+* Build container images on-demand based on one or more Spack packages, Spack support will be removed in future releases;
 * Build container images for a specified target platform (currently linux/amd64 and linux/arm64);
 * Push and cache built containers to a user-provided container repository;
 * Build Singularity native containers both using a Singularity spec file, Conda package(s) and Spack package(s);
@@ -108,6 +108,17 @@ container registry where the image is stored, while the instrumented layers are
     '-Djdk.httpclient.HttpClient.log=requests,headers'
     ```
 
+## TypeSpec API Specifications
+
+- You can find the API specifications using (typespec)[https://github.com/microsoft/typespec] in typespec directory. Use following command to generate the API specifications.
+
+    ```bash
+    'cd typespec'
+    'tsp install'
+    'tsp compile .'
+    ```
+
+- Check `typespec/tsp-output` directory for the generated API specifications.
 
 ## Related links
 * [Wave command line tool](https://github.com/seqeralabs/wave-cli)

VERSION

@@ -1,2 +1 @@
-1.7.9
-
+1.9.0

changelog.txt

@@ -1,7 +1,50 @@
 # Wave changelog
+1.9.0 - 11 Jul 2024
+- Add Typespec API definitions (#537) [32f7dd16]
+- Add cache record-stats (#534) [229926e2]
+- Add http 429 error to auth service retry condition [8282a492]
+- Check and delete corrupted blobs cache uploads (#533) [b0c775a3]
+- Deprecate the support for Spack and remove the support for it in the codebase (#550) [85a05196]
+- Enable ECR authentication via AWS compute env credentials (#303) [ec895222]
+- Fix Blob cache config for local dev [0d5413bf]
+- Fix client cache deadlock (#547) [cc6012ff]
+- Fix multiple s3clients in wave (#554) [45689500]
+- Minor change in mail notification [0aba6997]
+- Refactored metrics service (#549) [5e0d32ac]
+- Remove buildlogs aws config to not initialize AwsS3Operations (#558) [d50e5b7a]
+- Update metrics response (#536) [b6b36a97]
+- Bump buildkit 0.14.0 (#528) [c54172d1]
+- Bump buildkit 0.14.1 (#548) [37afb782]
+- Bump trivy 0.53.0 [f27ff527]
+- Bump version 1.8.3 [55b473e1]
+
+1.8.3 - 29 Jun 2024
+- Fix client cache deadlock (#547) [cc6012ff]
+- Fix failing test [263b44d3]
+- Add cache record-stats (#534) [229926e2]
+
+1.8.2 - 14 Jun 2024
+- Fix get image auth digest (#530) [df8ec041]
+
+1.8.1 - 13 Jun 2024
+- Fix digest warning (#526) [6e34ff0a]
+- Fix image name strategy (#513) [3bd8ffb5]
+
+1.8.0 - 10 Jun 2024
+- Add breakdown per org on stats metrics when a date is specified (#517) [b24894a4]
+- Replace Kaniko with Buildkit (#503) [a26f5dfe]
+- Implement cache store for build records (#505) [dd195deb]
+- Fix do not show null in build view [763ffe03]
+- Fix type in Const [b1bdb948]
+- Fix handling blob response headers (#504) [de97575e]
+- Fix missing endpoint on patched JWT token [46bbcd77]
+- Improve digest retrivial logs [5976967a]
+- Excludes JWT records with no endpoint [c98db8fb]
+- Bump Gradle 8.8 [2e4568da]
+
 1.7.9 - 29 May 2024
 - Improve JWT refresh handling  (#512) [751edb03]
-- Mark release as draft when ending with -Ax -Bx -RCx [ci skip] [66ba7ea7]
+- Mark release as draft when ending with -Ax -Bx -RCx [66ba7ea7]
 - Removed unused imports (#510) [182e3f0d]
 - Fix Use atomic strategy for Cacheable ops [923ae67c]
 - Fix failing build [8adb52ab]
@@ -69,7 +112,7 @@
 - Fix Containerfile encoding (#441) [d742aa67]
 - Improve error reporting for AWS ECR auth failure [06141219]
 - Remove unused exception [bc5570b3]
-- Fix syntax error repored by Intellij [343887a4]
+- Fix syntax error reported by Intellij [343887a4]
 - Fix Build pod name (#438) [4e54ce1a]
 - Fix RedisTestContainer flaky test (#436) [a90b44e5]
 - Update platform api endpoint to api.cloud.seqera.io (#434) [1e43e8b1]
@@ -87,7 +130,7 @@
 - Add fixed executor to future store [9f61abe9]
 - Add timeout retry limiter [0a98aa96]
 - Fix failing tests [eeb9ddfe]
-- Add thred pool monitor cron [a1cdcc13]
+- Add thread pool monitor cron [a1cdcc13]
 - Bump corretto-17.0.10-al2023-jemalloc as base image [7238a86d]
 - Evict status redesigned (#419) [9cf07b56]
 - Add API and UI to evict a wave request from token cache  (#410) [5833c18d]
@@ -143,7 +186,7 @@ v1.1.7 - 19 Dec 2023
 - Implements streaming client for large binary downloads (#358) [592ce522]
 - Update failing tests [31edb5e7]
 - Fix typo in comment [c10cc472]
-- Remove unsused consts [24315f03]
+- Remove unused consts [24315f03]
 - Refactor build settings via BuildConfig class (#324) [f6924f4a]
 - Bump trivy 0.47.0 [3ff4a89f]
 
@@ -463,7 +506,7 @@ v0.29.0 - 5 Apr 2023
 
 v0.28.6 - 5 Apr 2023 
 - Add consumers list [7d561f6d]
-- Use singleton websocket instace [c0390502]
+- Use singleton websocket instance [c0390502]
 - Add custom MN worker pool [be3cbe78]
 - Remove redis session [b23c7225]
 - Improve logs [0f29cef7]
@@ -482,7 +525,7 @@ v0.28.2 - 4 Apr 2023
 - Improve future poll + refactor [53c6a335]
 
 v0.28.1 - 4 Apr 2023 
-- Fix missing timeout exeception on redis future [a9d640a0]
+- Fix missing timeout exception on redis future [a9d640a0]
 - Minor logging changes [c81e78bf] [4943ba6f] [6768b7eb]
 - Update application dev [db4ae108]
 
@@ -684,7 +727,7 @@ v0.21.6 - 17 Oct 2022 [BROKEN BASE IMAGE]
 - Improve registry auth lookup error [0f696146] 
 
 v0.21.5 - 4 Oct 2022
-- Rollback timestamp and fingerpint fields [466b3a46] <Paolo Di Tommaso>
+- Rollback timestamp and fingerprint fields [466b3a46] <Paolo Di Tommaso>
 
 v0.21.4 - 3 Oct 2022
 - Count all manifest digest requests [02435bff] <Paolo Di Tommaso>
@@ -795,7 +838,7 @@ v0.14.2 - 7 Sep 2022
 
 v0.14.1 - 5 Sep 2022
 - Fix registry auth invalid cache key [15bd1a57]
-- Fix retry policy for temportary IO exeception [15e2723f]
+- Fix retry policy for temporary IO exception [15e2723f]
 - Add support for Azure CR [cac5b661]
 - Improve logging [7af3109f]
 

configuration.md

@@ -81,11 +81,11 @@ Below are the standard format for known registries, but you can change registry
 
 - **`wave.build.timeout`**: the timeout for the build process. Its default value is `5m` (5 minutes), providing a reasonable time frame for the build operation. *Optional*.
 
-- **`wave.build.workspace`**: defines the path to the directory used by Wave to store artifacts such as Dockerfiles, Trivy cache for scan, Kaniko context, authentication configuration files, etc. For example, `/efs/wave/build`. *Mandatory*.
+- **`wave.build.workspace`**: defines the path to the directory used by Wave to store artifacts such as Dockerfiles, Trivy cache for scan, Buildkit context, authentication configuration files, etc. For example, `/efs/wave/build`. *Mandatory*.
 
 - **`wave.build.cleanup`**: determines the cleanup strategy after the build process. Options include `OnSuccess`, meaning cleanup occurs only if the build is successful. *Optional*.
 
-- **`wave.build.kaniko-image`**: specifies the [Kaniko](https://github.com/GoogleContainerTools/kaniko) Docker image used in the Wave build process. The default is `gcr.io/kaniko-project/executor:v1.19.2`. *Optional*.
+- **`wave.build.buildkit-image`**: specifies the [Buildkit](https://github.com/moby/buildkit) Docker image used in the Wave build process. The default is `moby/buildkit:v0.13.2-rootless`. *Optional*.
 
 - **`wave.build.singularity-image`**: sets the [Singularity](https://quay.io/repository/singularity/singularity?tab=tags) image used in the build process. The default is `quay.io/singularity/singularity:v3.11.4-slim`. *Optional*.
 
@@ -101,11 +101,16 @@ Below are the standard format for known registries, but you can change registry
 
 - **`wave.build.public`**: indicates whether the Docker container repository is public. If set to true, Wave freeze will prefer this public repository over `wave.build.repo`. *Optional*.
 
-- **`wave.build.compress-caching`**: determines whether to compress cache layers produced by the build process. The default is `true`, enabling compression for more efficient storage. *Optional*.
+- **`wave.build.oci-mediatypes`**: defines whether to use OCI mediatypes in exported manifests. its default value is `true`. *Optional*.
 
+- **`wave.build.compression`**: defines which type of compression will be applied to cache layers. its default value is `gzip` and other options are `uncompressed|estargz|zstd`. *Optional*.
+
+- **`wave.build.force-compression`**: determines whether to force the compression for each cache layers produced by the build process. The default is `false`, enabling compression for more efficient storage. *Optional*.
 
 ### Spack configuration for wave build process
 
+**Note**: Spack support will be removed in future releases.
+
 Spack configuration consists of the path of its secret file, the mount path for the secret file in the spack container, and the optional S3 bucket name for the spack binary cache.
 
 **Note**: these configuration are mandatory to support Spack in a wave installation.