Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use IQuOD data in place of WOD data #17

Open
BecCowley opened this issue Sep 19, 2023 · 1 comment
Open

Use IQuOD data in place of WOD data #17

BecCowley opened this issue Sep 19, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@BecCowley
Copy link
Contributor

Currently all our build is done on the WOD dataset. Eventually, we aim to use IQuOD in place of WOD.

IQuOD is the WOD but with uncertainties, QC flags output from a community agreed QC toolkit and intelligent metadata that improves guesses of XBT probe types where this metadata is missing.

For CARS, the biggest benefit is the QC flags and potentially uncertainties.
As of September, 2023, the IQuOD files with AQC flags are not available publicly, but some files have been produced for testing by myself. They are available on an S3 bucket and for download.

Issues:

  • Reading from the s3 bucket is slow (operating out of the Bowen storage area)
  • Downloading the files is possible - where best to do that to?
  • Would it be quicker to download and operate from local files, perhaps to Bowen storage, perhaps the NCI virtual desktop?
@BecCowley BecCowley self-assigned this Sep 19, 2023
@BecCowley BecCowley added the enhancement New feature or request label Sep 19, 2023
@BecCowley
Copy link
Contributor Author

BecCowley commented Sep 27, 2023

Have downloaded the IQuOD files to /oa-decadal-climate/work/observations/CARSv2_ancillary/IQuOD
Installed aws cli to my local directory
command to copy:
aws s3 cp s3://wod-collaboration/iquod/netcdf . --recursive --no-sign-request

Have also copied to gadi scratch/er50 to practice using the NCI interactive session tools.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant