(Translated by https://www.hiragana.jp/)
Error fetch_fcst task when no data found for a model, as it usually indicates a typo in the data path by jfrost-mo · Pull Request #842 · MetOffice/CSET · GitHub
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error fetch_fcst task when no data found for a model, as it usually indicates a typo in the data path #842

Open
wants to merge 95 commits into
base: 750_data_time_cycling
Choose a base branch
from

Conversation

jfrost-mo
Copy link
Member

@jfrost-mo jfrost-mo commented Sep 25, 2024

Fixes #824

Contribution checklist

Aim to have all relevant checks ticked off before merging. See the developer's guide for more detail.

  • Documentation has been updated to reflect change.
  • New code has tests, and affected old tests have been updated.
  • All tests and CI checks pass.
  • Ensured the pull request title is descriptive.
  • Conda lock files have been updated if dependencies have changed.
  • Attributed any Generative AI, such as GitHub Copilot, used in this PR.
  • Marked the PR as ready to review.

Also gone through and removed some unneeded things, added titles, etc.

Still need to go through the diagnostics.

Split diagnostics into sections, add input variable table

Also link in more models, so 10 are now supported.

Improvements to rose edit metadata

Fix a bunch of validation issues
Also now use subclasses for getting individual files from the various
data sources.
Grab rose template variables directly, rather than via jinja context

Add workflow exported functions to __all__

Add licence header to jinja_utils

Require success for processing tasks in workflow

Housekeep only on success, but finish workflow regardless
…them

I've updated one recipe for now, but they will all have to be converted.
The final cycle point task are skipped if doing a continuous trial
without a defined end date.
They have all been replaced my the more generic version that work for
both the UM and LFRic.
Use cycle point for deterministic resolving.
It was also invalid due to referencing non-existent variables.
Also rearrange pressure level metadata.
Q-Q plot recipe is partially converted, pending Issue #808.
The operator now requires all arguments to either be numbers, or all be None
if you don't want to constrain the area.

The test has been mildly improved, so at least it checks for both of the
named functions on the coordinates, though it still doesn't test that they
do anything.
@jfrost-mo jfrost-mo added bug Something isn't working small Small issue that should be quick to resolve labels Sep 25, 2024
@jfrost-mo jfrost-mo self-assigned this Sep 25, 2024
@jfrost-mo
Copy link
Member Author

I probably need to add a test before merging.

@jfrost-mo jfrost-mo removed the request for review from JorgeBornemann September 25, 2024 04:23
@jfrost-mo jfrost-mo force-pushed the 824_error_when_no_data_found branch 2 times, most recently from ebefa09 to 19b6a62 Compare September 25, 2024 09:27
Copy link
Contributor

github-actions bot commented Sep 25, 2024

Coverage

@jfrost-mo jfrost-mo changed the title Error when no data found Error fetch_fcst task when no data found for a model Sep 25, 2024
@jfrost-mo jfrost-mo changed the title Error fetch_fcst task when no data found for a model Error fetch_fcst task when no data found for a model, as it usually indicates a typo in the data path Sep 25, 2024
@jfrost-mo jfrost-mo marked this pull request as ready for review September 25, 2024 10:30
@Fraetor
Copy link

Fraetor commented Sep 25, 2024

Tests could do with actually checking the return value if the FileRetrievers.

@jfrost-mo jfrost-mo marked this pull request as draft September 26, 2024 07:05
@jfrost-mo
Copy link
Member Author

Marking as draft after it didn't work when tested during the NIWA tutorial.

It is invalid rose syntax. Also use !! to disable showing the option
in the GUI.
This should catch the case where the underlying implementation is
not correctly reporting when files are missing.
@jfrost-mo jfrost-mo marked this pull request as ready for review September 27, 2024 02:51
@jfrost-mo
Copy link
Member Author

I've added some more tests, and manually tested. It seems to work... Maybe we just forgot to merge properly into the NIWA branch?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working small Small issue that should be quick to resolve
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants