|
The Data Pipeline: Once the RCMs have finished running,
there is still a considerable amount of work that must be done to make
the data ready for end users. First, the model output must be
post-processed into CF-compliant netCDF. Then it must be transferred
from the modeling team's home institution to NCAR. (This may involves
shipping terabyte hard-drives overseas.) Once the data arrive, a
backup copy is made to the NERSC HPSS for disaster-recovery purposes.
Then the data must be checked for correct formatting and data
integrity and any errors corrected, which could involve the entire
file being regenerated. Finally, an archival copy is made to the NCAR
MSS, the data is transferred to its final resting place on disk, and
the files are published through the ESG data portal. All of this
takes time, so there can be a considerable delay between when the
modeling run is finished and when the data is available for download
from ESG.
Modeling Run Status
The following table shows the status of the NARCCAP modeling runs.
No firm ETAs are currently available for the completion of runs in
progress.
| Phase I | | Phase II |
| | NCEP | | GFDL | CGCM3 | HADCM3 | CCSM |
| CRCM | finished | | -- | finished | -- | finished |
| ECP2 | finished | | finished | -- | planned | -- |
| HRM3 | finished | | finished | -- | finished | -- |
| MM5I | finished | | -- | -- | running | finished |
| RCM3 | finished | | finished | finished | -- | -- |
| WRFG | finished | | -- | finished | -- | finished |
| | |
| Timeslices | | finished | -- | -- | finished |
Data Availability
The following tables show which datafiles from completed runs have been checked, archived, and published, and are avilable for download through the ESG dataportal. Table 4 files are available here. 3-D Table 5 data has been separated into primary (250, 300, 500, 600, 700, 850, and 950 mb) and other levels, with the primary levels piroritized.
KEY
| complete | All files in this group have been published |
| partial | Some files have been published; see note |
| no data | Nothing has been published yet |
| | No data because run is not finished yet |
CRCM
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | complete | complete | complete | complete | complete |
| cgcm3-current | complete | complete | complete | complete | complete |
| cgcm3-future | complete | complete | complete | complete | complete |
| ccsm-current | complete | complete | complete | complete | complete |
| ccsm-future | complete | complete | complete | complete | complete |
Notes
ECP2
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | no data | complete | no data | no data | no data |
| gfdl-current | complete | complete | complete | no data | no data |
| gfdl-future | no data | note 1 | no data | no data | no data |
| hadcm3-current | | | | | |
| hadcm3-future | | | | | |
Notes
| General | spdmax not available for this model clt not available for this model mrfso not available for this model snd not available for this model; snw provided instead HadCM3-current: simulation not finished yet HadCM3-future: simulation not finished yet |
| Note 1 | All missing except: pr, tas |
HRM3
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | note 1 | complete | complete | note 2 | note 3 |
| hadcm3-current | complete | complete | note 4 | note 5 | note 6 |
| hadcm3-future | complete | complete | note 7 | note 8 | note 9 |
| gfdl-current | complete | complete | note 10 | no data | no data |
| gfdl-future | complete | complete | note 11 | no data | no data |
Notes
| General | snd not available for this model; snw provided instead tauu not available for this model tauv not available for this model |
| Note 1 | Exception: sic not available for NCEP-driven run |
| Note 2 | Missing: cli, clw, wa |
| Note 3 | Missing: cli, clw, wa |
| Note 4 | Missing: prw, snm |
| Note 5 | Partial: hus 42/49, ta 42/49, ua 42/49, va 42/49 All missing except: |
| Note 6 | Partial: ua 146/147 Missing: cli, clw, wa |
| Note 7 | Missing: prw, snm |
| Note 8 | Missing: cli, clw, wa |
| Note 9 | Missing: cli, clw, wa |
| Note 10 | Partial: tauu 7/0, tauv 7/0 |
| Note 11 | Partial: tauu 7/0, tauv 7/0 |
MM5I
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | no data | note 1 | note 2 | complete | note 3 |
| ccsm-current | no data | note 4 | note 5 | no data | no data |
| ccsm-future | no data | note 6 | note 7 | no data | no data |
| hadcm3-current | no data | no data | no data | no data | no data |
| hadcm3-future | no data | no data | no data | no data | no data |
Notes
| General | |
| Note 1 | Missing: ps, rsds |
| Note 2 | All missing except: snd, ts, zg500, zmla |
| Note 3 | Partial: cli 108/126, clw 108/126, hus 108/126, ta 108/126, ua 108/126, va 108/126, wa 108/126 |
| Note 4 | Missing: rsds |
| Note 5 | Missing: mrfso, mrro, mrros, mrso, prw, rsus, snm, tauu, tauv |
| Note 6 | Missing: rsds |
| Note 7 | Missing: mrfso, mrro, mrros, mrso, prw, rsus, snd, snm, tauu, tauv |
RCM3
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | complete | complete | note 1 | note 2 | note 3 |
| gfdl-current | complete | complete | note 4 | note 5 | note 6 |
| gfdl-future | complete | complete | note 7 | note 8 | note 9 |
| cgcm3-current | complete | complete | note 10 | note 11 | note 12 |
| cgcm3-future | complete | complete | note 13 | note 14 | note 15 |
Notes
| General | sic results are not valid for this model mrfso does not exist for this model |
| Note 1 | Missing: evps, mrros, prw |
| Note 2 | Missing: cli, clw, wa |
| Note 3 | Missing: cli, clw, wa |
| Note 4 | Missing: clt, prw, tauu, tauv |
| Note 5 | Missing: cli, clw, wa |
| Note 6 | Missing: cli, clw, wa |
| Note 7 | Missing: clt, prw, tauu, tauv |
| Note 8 | Missing: cli, clw, wa |
| Note 9 | Missing: cli, clw, wa |
| Note 10 | Missing: clt, prw, tauu, tauv |
| Note 11 | Missing: cli, clw, wa |
| Note 12 | Missing: cli, clw, wa |
| Note 13 | Missing: clt, prw, tauu, tauv |
| Note 14 | Missing: cli, clw, wa |
| Note 15 | Missing: cli, clw, wa |
WRFG
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | complete | complete | note 1 | complete | complete |
| ccsm-current | complete | complete | note 2 | complete | complete |
| ccsm-future | complete | complete | note 3 | complete | complete |
| cgcm3-current | complete | complete | complete | complete | complete |
| cgcm3-future | complete | complete | complete | complete | complete |
Notes
| General | tauu is not available for this model tauv is not available for this model |
| Note 1 | Missing: rlds, rlus, rlut, rsdt, rsus |
| Note 2 | Partial: rlds 4/7, rlus 4/7, rlut 4/7, rsdt 4/7 |
| Note 3 | Missing: rlds, rlus, rlut, rsdt, zg500 |
ECPC
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | complete | complete | note 1 | no data | no data |
Notes
| General | |
| Note 1 | All missing except: zg500 |
WRFP
| Table 1 | Table 2 | Table 3 | Table 5 primary | Table 5 other |
| ncep | no data | complete | note 1 | no data | no data |
Notes
| General | tauu is not available for this model tauv is not available for this model |
| Note 1 | All missing except: tauu, tauv, zg500 |
Other Exceptions
Missing Timesteps: Some files are missing timesteps. This
happens for various reasons; it may be impossible for the RCM to run
the final day before the GCM data cuts off, for example, or there may
have been problems with storage space during the run that caused the
data from some timesteps to fail to write to disk. We have done our
best to ensure that any known gaps in the data during the official coverage periods have
been filled with missing_data. If you find a file with a gap in the
time coordinate, let us know and we will fix it. We have tabulated the known timesteps where all values are missing here.
CCSM-driven runs end in 1999: The driving data from the CCSM
historical run ends one year short of the NARCCAP coverage period, at
the end of 1999 instead of on 2000/12/31. All CCSM-current runs have
only 29 years of valid data instead of 30.
ECPC & WRFP are ncep-only: They have been superseded by ECP2
and WRFG, respectively. See the model changes page for more
information.
Missing data in HRM3-hadcm3: There are occasional, isolated
missing_values (typically no more than 1 per file) scattered
throughout these files. They replace 'glitch' values we found during
QC that we believe were due to hardware errors associated with data
transfer.
HRM3 times: Many, but not all, HRM3 files start at 00:00
UTC, rather than the standard 03:00 UTC. This may cause the number of
timesteps per file to be different than expected. Note: it is
likely there is a systematic off-by-one error in the time coordinate
related to this issue. We are investigating; in the meantime, use
caution with analyses that depend on time of day
HRM3 winds: Wind variables (spdmax, uas, vas, ua, va) from
HRM3 have been output on a staggered grid, which is offset by half a
gridcell relative to the grid used for all the other variables. We
plan to interpolate the results to the standard grid for surface
variables, but not for the 3-D (Table 5) data.
HRM3-hadcm3 mrro 2056: Data is not properly masked over the
oceans in this file; use caution.
WRF-ncep starts late: The NCEP-driven WRF runs (both WRFG
and WRFP) begin 1979-09-01, not 1979-01-01. This is an error that
results in a shortened spin-up period, but is expected to have minimal
effect on variables except those closely tied to soil moisture.
Missing WRFG-ccsm longwave radiation: Some of the longwave
radiation variables for the CCSM-driven WRFG runs have extensive gaps
or are missing entirely. This is a data problem, not a model problem:
the outputs were not saved correctly, but the values were correct
within the model while it was running.
GFDL timeslice mrro, mrros: No data is available for
these variables because runoff values were not correctly computed in
the 50km model.
GFDL timeslice mrfso, rootd: No data is available for
these variables, because there are no variables in the model that
correspond directly.
GFDL timeslice cli, clw: No data is available for
these variables. They were not saved because the storage requirements
proved prohibitive.
GFDL timeslice wa: No data is available for this
variable because there is no vertical wind component diagnostic
variable in this model. Instead, the vertical velocity in pressure
coordinates (variable wap, units Pa/sec) is provided.
GFDL timeslice all 3-D variables: 3-D data from the
GFDL timeslice is on native pressure levels, not interpolated to 25-mb
heights.
GFDL timeslice landtyp, lat, lon: These variables are
not yet available due to unresolved questions regarding format and
representation.
|