fix: add scda to ecmwf matches, add backfill dataset definition

[gadomski]

Description

We're fixing two issues:

• Updating YAML to account for -opendata in ECMWF directories #241 added a matches expression that didn't include scda. This corresponds with the most recent scda item, which is 2023-07-01 12:00:00+00:00
• Sometime in mid-February 2024, ECMWF added a ifs to its data path, to differentiate from its AI-generated aifs product¹.

The fix is two-part:

• We've added scda back to our matches, so any ingests for paths after mid-February 2024 should now pick up scda assets
• We've added a dataset-scda-backfill.yaml dataset definition that has the old path structure

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested?

I haven't tested the ingest workflows yet, I'll wait for an initial review before firing them off. We'll want to run the backfill one starting from 30 June 2023, and the main one from 01 February 2024.

Script to get the latest dates for each stream:

from pystac_client import Client

client = Client.open("https://planetarycomputer.microsoft.com/api/stac/v1")

for stream in ["oper", "wave", "enfo", "waef", "scda"]:
    search = client.search(
        collections=["ecmwf-forecast"],
        sortby="-datetime",
        filter={"op": "=", "args": [{"property": "ecmwf:stream"}, stream]},
        max_items=1,
    )
    item = next(search.items())
    print(stream, item.datetime)

Checklist:

Please delete options that are not relevant.

• I have performed a self-review
• Changelog has been updated
• Documentation has been updated
• Unit tests pass locally (./scripts/test)
• Code is linted and styled (./scripts/format

Footnotes

1. https://confluence.ecmwf.int/display/DAC/ECMWF+open+data:+real-time+forecasts+from+IFS+and+AIFS ↩

[gadomski]

We need the hours (00z, etc) to avoid matching ifs/aifs paths

[gadomski]

I added this test to make sure we weren't broken b/c of stactools-packages reasons, and we're not.