[Met_help] [rt.rap.ucar.edu #95824] History for valid time
Howard Soh via RT
met_help at ucar.edu
Tue Oct 13 16:22:41 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
This is Binyu from NOAA/EMC. I was using the script below for
ensemble verification (on Hera):
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
and here is the full log file:
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.log
>From the log file, the warning is
WARNING: get_data_plane() -> The valid time has changed, 20190622_010000 !=
19700101_000000 in
"/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/
regrid_Himawari_ash_20190622-01.mean.nc
<http://regrid_himawari_ash_20190622-01.mean.nc/>"
But I can not find any 19700101 string from the nc file. Those nc files
were created by myself using point2grid. Just in case, here is my scripts
for the conversion:
/scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/asc2grid.sh
After the conversion, I used "cdo ensmean" to get the hourly mean because
the original files are every 15 minutes.
Let me know if anything not clear, thank you very much.
Binyu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: valid time
From: George McCabe
Time: Mon Jul 06 08:35:02 2020
Hi Binyu,
I see you are having issues with the valid time used by the MET tools.
I
have assigned this ticket to Howard.
Thanks,
George
On Mon, Jul 6, 2020 at 8:03 AM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> Mon Jul 06 08:03:07 2020: Request 95824 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
> Queue: met_help
> Subject: valid time
> Owner: Nobody
> Requestors: binyu.wang at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95824 >
>
>
> Hello,
>
> This is Binyu from NOAA/EMC. I was using the script below for
> ensemble verification (on Hera):
>
>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> and here is the full log file:
>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.log
>
> From the log file, the warning is
> WARNING: get_data_plane() -> The valid time has changed,
20190622_010000 !=
> 19700101_000000 in
>
"/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/
> regrid_Himawari_ash_20190622-01.mean.nc
> <http://regrid_himawari_ash_20190622-01.mean.nc/>"
> But I can not find any 19700101 string from the nc file. Those nc
files
> were created by myself using point2grid. Just in case, here is my
scripts
> for the conversion:
>
> /scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/asc2grid.sh
> After the conversion, I used "cdo ensmean" to get the hourly mean
because
> the original files are every 15 minutes.
>
> Let me know if anything not clear, thank you very much.
>
> Binyu
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Mon Jul 06 08:40:47 2020
Internal only.
Can anybody get the file
"/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
01.mean.nc" on Hara?
Otherwise, I will ask Binyu the file.
Cheers,
Howard
On Mon Jul 06 08:35:02 2020, mccabe wrote:
> Hi Binyu,
>
> I see you are having issues with the valid time used by the MET
tools.
> I
> have assigned this ticket to Howard.
>
> Thanks,
> George
>
> On Mon, Jul 6, 2020 at 8:03 AM binyu.wang at noaa.gov via RT
> <met_help at ucar.edu>
> wrote:
>
> >
> > Mon Jul 06 08:03:07 2020: Request 95824 was acted upon.
> > Transaction: Ticket created by binyu.wang at noaa.gov
> > Queue: met_help
> > Subject: valid time
> > Owner: Nobody
> > Requestors: binyu.wang at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95824
> > >
> >
> >
> > Hello,
> >
> > This is Binyu from NOAA/EMC. I was using the script below for
> > ensemble verification (on Hera):
> >
> >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > and here is the full log file:
> >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.log
> >
> > From the log file, the warning is
> > WARNING: get_data_plane() -> The valid time has changed,
> > 20190622_010000 !=
> > 19700101_000000 in
> >
"/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/
> > regrid_Himawari_ash_20190622-01.mean.nc
> > <http://regrid_himawari_ash_20190622-01.mean.nc/>"
> > But I can not find any 19700101 string from the nc file. Those nc
> > files
> > were created by myself using point2grid. Just in case, here is my
> > scripts
> > for the conversion:
> >
> > /scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/asc2grid.sh
> > After the conversion, I used "cdo ensmean" to get the hourly mean
> > because
> > the original files are every 15 minutes.
> >
> > Let me know if anything not clear, thank you very much.
> >
> > Binyu
> >
> >
------------------------------------------------
Subject: valid time
From: George McCabe
Time: Mon Jul 06 08:58:29 2020
Hi Howard,
I have access to hera but have not retrieved files from there before.
A normal scp doesn't seem to work. I asked Julie for help, but in the
meantime, I can paste the ncdump headers results for that file:
netcdf regrid_Himawari_ash_20190622-01.mean {
dimensions:
lon = 721 ;
lat = 361 ;
variables:
float lon(lon) ;
lon:standard_name = "longitude" ;
lon:long_name = "longitude" ;
lon:units = "degrees_east" ;
lon:axis = "X" ;
float lat(lat) ;
lat:standard_name = "latitude" ;
lat:long_name = "latitude" ;
lat:units = "degrees_north" ;
lat:axis = "Y" ;
float ash(lat, lon) ;
ash:long_name = "ash(*,*)" ;
ash:units = "NA" ;
ash:_FillValue = -9999.f ;
ash:missing_value = -9999.f ;
ash:name = "ash" ;
ash:level = "*,*" ;
ash:init_time = "20190622_010000" ;
ash:init_time_ut = "1561165200" ;
ash:valid_time = "20190622_010000" ;
ash:valid_time_ut = "1561165200" ;
int ash_cnt(lat, lon) ;
ash_cnt:long_name = "ash_cnt(*,*)" ;
ash_cnt:units = "NA" ;
ash_cnt:_FillValue = -9999 ;
ash_cnt:missing_value = -9999 ;
ash_cnt:name = "ash_cnt" ;
ash_cnt:level = "*,*" ;
ash_cnt:init_time = "20190622_010000" ;
ash_cnt:init_time_ut = "1561165200" ;
ash_cnt:valid_time = "20190622_010000" ;
ash_cnt:valid_time_ut = "1561165200" ;
int ash_mask(lat, lon) ;
ash_mask:long_name = "ash_mask(*,*)" ;
ash_mask:units = "NA" ;
ash_mask:_FillValue = -9999 ;
ash_mask:missing_value = -9999 ;
ash_mask:name = "ash_mask" ;
ash_mask:level = "*,*" ;
ash_mask:init_time = "20190622_010000" ;
ash_mask:init_time_ut = "1561165200" ;
ash_mask:valid_time = "20190622_010000" ;
ash_mask:valid_time_ut = "1561165200" ;
// global attributes:
:CDI = "Climate Data Interface version 1.9.5
(http://mpimet.mpg.de/cdi)" ;
:Conventions = "CF-1.6" ;
:history = "Mon Jun 29 22:06:09 2020: cdo ensmean
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
010000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
011000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
012000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
013000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
014000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
015000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
01.mean.nc" ;
:FileOrigins = "File
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
010000.nc generated 20200629_194609 UTC on host hfe10 by the MET
point2grid tool" ;
:MET_version = "V9.0" ;
:MET_tool = "point2grid" ;
:RunCommand = "Point obs () to Projection: Lat/Lon Nx:
721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250 delta_lon:
0.250" ;
:Projection = "LatLon" ;
:lat_ll = "3.292000 degrees_north" ;
:lon_ll = "63.250000 degrees_east" ;
:delta_lat = "0.250000 degrees" ;
:delta_lon = "0.250000 degrees" ;
:Nlat = "361 grid_points" ;
:Nlon = "721 grid_points" ;
:CDO = "Climate Data Operators version 1.9.5
(http://mpimet.mpg.de/cdo)" ;
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Mon Jul 06 09:04:54 2020
Thanks.
The time information comes from "valid_time_ut" attribute for MET
generated NETCDF. Please download the config files and log files, too.
Cheers,
Howard
On Mon Jul 06 08:58:29 2020, mccabe wrote:
> Hi Howard,
>
> I have access to hera but have not retrieved files from there
before.
> A normal scp doesn't seem to work. I asked Julie for help, but in
the
> meantime, I can paste the ncdump headers results for that file:
>
> netcdf regrid_Himawari_ash_20190622-01.mean {
> dimensions:
> lon = 721 ;
> lat = 361 ;
> variables:
> float lon(lon) ;
> lon:standard_name = "longitude" ;
> lon:long_name = "longitude" ;
> lon:units = "degrees_east" ;
> lon:axis = "X" ;
> float lat(lat) ;
> lat:standard_name = "latitude" ;
> lat:long_name = "latitude" ;
> lat:units = "degrees_north" ;
> lat:axis = "Y" ;
> float ash(lat, lon) ;
> ash:long_name = "ash(*,*)" ;
> ash:units = "NA" ;
> ash:_FillValue = -9999.f ;
> ash:missing_value = -9999.f ;
> ash:name = "ash" ;
> ash:level = "*,*" ;
> ash:init_time = "20190622_010000" ;
> ash:init_time_ut = "1561165200" ;
> ash:valid_time = "20190622_010000" ;
> ash:valid_time_ut = "1561165200" ;
> int ash_cnt(lat, lon) ;
> ash_cnt:long_name = "ash_cnt(*,*)" ;
> ash_cnt:units = "NA" ;
> ash_cnt:_FillValue = -9999 ;
> ash_cnt:missing_value = -9999 ;
> ash_cnt:name = "ash_cnt" ;
> ash_cnt:level = "*,*" ;
> ash_cnt:init_time = "20190622_010000" ;
> ash_cnt:init_time_ut = "1561165200" ;
> ash_cnt:valid_time = "20190622_010000" ;
> ash_cnt:valid_time_ut = "1561165200" ;
> int ash_mask(lat, lon) ;
> ash_mask:long_name = "ash_mask(*,*)" ;
> ash_mask:units = "NA" ;
> ash_mask:_FillValue = -9999 ;
> ash_mask:missing_value = -9999 ;
> ash_mask:name = "ash_mask" ;
> ash_mask:level = "*,*" ;
> ash_mask:init_time = "20190622_010000" ;
> ash_mask:init_time_ut = "1561165200" ;
> ash_mask:valid_time = "20190622_010000" ;
> ash_mask:valid_time_ut = "1561165200" ;
>
> // global attributes:
> :CDI = "Climate Data Interface version 1.9.5
> (http://mpimet.mpg.de/cdi)" ;
> :Conventions = "CF-1.6" ;
> :history = "Mon Jun 29 22:06:09 2020: cdo ensmean
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 010000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 011000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 012000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 013000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 014000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 015000.nc
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> 01.mean.nc" ;
> :FileOrigins = "File
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> 010000.nc generated 20200629_194609 UTC on host hfe10 by the MET
> point2grid tool" ;
> :MET_version = "V9.0" ;
> :MET_tool = "point2grid" ;
> :RunCommand = "Point obs () to Projection: Lat/Lon
Nx:
> 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
delta_lon:
> 0.250" ;
> :Projection = "LatLon" ;
> :lat_ll = "3.292000 degrees_north" ;
> :lon_ll = "63.250000 degrees_east" ;
> :delta_lat = "0.250000 degrees" ;
> :delta_lon = "0.250000 degrees" ;
> :Nlat = "361 grid_points" ;
> :Nlon = "721 grid_points" ;
> :CDO = "Climate Data Operators version 1.9.5
> (http://mpimet.mpg.de/cdo)" ;
------------------------------------------------
Subject: valid time
From: George McCabe
Time: Mon Jul 06 09:47:42 2020
The files are on dakota in /d3/personal/mccabe/Binyu_Data. The script
used to convert the data and those logs are not transferring for me,
but the contents are below. Let me know if you need anything else.
/scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/asc2grid.sh
#!/bin/sh
INDIR=/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Hysplit/Raikoke/Raikoke.21.0p5
LGDIR=/scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/Logs
OBSFILES=/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_temp/*
OUTDIR=/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met
cd $OUTDIR
for f in $OBSFILES
do
echo "Processing $f file..."
# ymd=`echo ${f} | cut -c 89-103`
fname=`echo ${f} | cut -c 65-92`
echo ${fname}
ascii2nc $f $OUTDIR/${fname}.nc -log $LGDIR/asc2nc.log
point2grid $OUTDIR/${fname}.nc $INDIR/T_cdump1.001.grib2
$OUTDIR/regrid_${fname}.nc -field 'name="ash"; level="(*,*)";' -log
$LGDIR/point2grid.log
done
/scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/Logs/point2grid.log
DEBUG 2: Output grid: Projection: Lat/Lon Nx: 721 Ny: 361 lat_ll:
3.292 lon_ll: -63.250 delta_lat: 0.250 delta_lon: 0.250
DEBUG 2: Interpolation options: method = UW_MEAN, vld_thresh = 0.5
DEBUG 1: Reading data file:
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/Himawari_ash_20190624-
235000.nc
DEBUG 2: process_point_file() -> var_count=14771, grid: 2684 out of
260281
DEBUG 1: Writing output file:
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190624-
235000.nc
/scratch2/NCEPDEV/naqfc/Binyu.Wang/Scripts/MET/Logs/asc2nc.log
DEBUG 1: Config File:
/contrib/met/9.0_anacondal/share/met/config/Ascii2NcConfig_default
DEBUG 2: Rejected 0 observations off the masking grid.
DEBUG 2: Rejected 0 observations outside the masking polyline.
DEBUG 2: Rejected 0 observations not matched with station ID's.
DEBUG 2: Processing observations for 14771 headers.
DEBUG 1: Creating NetCDF Observation file:
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/Himawari_ash_20190624-
235000.nc
DEBUG 2: Finished processing 14771 observations for 14771 headers.
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Mon Jul 06 10:28:05 2020
MET recognizes the input NetCDF as the CF-complaint NetCDF file, but
it does not have the time variable.
WARNING:
WARNING: NcCfFile::open() -> could not determine the valid time, using
0.
WARNING:
The input NetCDF has the time information at the variable attribute,
"valid_time_ut", which is for the MET generated NetCDF file.
Three possible slutions:
1. Remove the global attribute "Conventions" at the input netcdf
2. Add "time" variable into the input NetCDF.
3. Add the file type "file_type=NETCDF_MET;" into the config file,
verf_g2g_ens_stat_regn_config_Raikoke
ens = {
wind_thresh = [ NA ];
field = [
{
name = "VAFTD";
convert(x) = 3.91*10^16*(10^(x));
level = [ "L0-18000" ];
lead_time = "${LEAD_HR}";
cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10 ];
}
];
};
==>
ens = {
wind_thresh = [ NA ];
file_type = NETCDF_MET;
field = [
{
name = "VAFTD";
convert(x) = 3.91*10^16*(10^(x));
level = [ "L0-18000" ];
lead_time = "${LEAD_HR}";
cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10 ];
}
];
};
Cheers,
Howard
On Mon Jul 06 09:04:54 2020, hsoh wrote:
> Thanks.
>
> The time information comes from "valid_time_ut" attribute for MET
> generated NETCDF. Please download the config files and log files,
too.
>
> Cheers,
> Howard
>
> On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > Hi Howard,
> >
> > I have access to hera but have not retrieved files from there
before.
> > A normal scp doesn't seem to work. I asked Julie for help, but in
the
> > meantime, I can paste the ncdump headers results for that file:
> >
> > netcdf regrid_Himawari_ash_20190622-01.mean {
> > dimensions:
> > lon = 721 ;
> > lat = 361 ;
> > variables:
> > float lon(lon) ;
> > lon:standard_name = "longitude" ;
> > lon:long_name = "longitude" ;
> > lon:units = "degrees_east" ;
> > lon:axis = "X" ;
> > float lat(lat) ;
> > lat:standard_name = "latitude" ;
> > lat:long_name = "latitude" ;
> > lat:units = "degrees_north" ;
> > lat:axis = "Y" ;
> > float ash(lat, lon) ;
> > ash:long_name = "ash(*,*)" ;
> > ash:units = "NA" ;
> > ash:_FillValue = -9999.f ;
> > ash:missing_value = -9999.f ;
> > ash:name = "ash" ;
> > ash:level = "*,*" ;
> > ash:init_time = "20190622_010000" ;
> > ash:init_time_ut = "1561165200" ;
> > ash:valid_time = "20190622_010000" ;
> > ash:valid_time_ut = "1561165200" ;
> > int ash_cnt(lat, lon) ;
> > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > ash_cnt:units = "NA" ;
> > ash_cnt:_FillValue = -9999 ;
> > ash_cnt:missing_value = -9999 ;
> > ash_cnt:name = "ash_cnt" ;
> > ash_cnt:level = "*,*" ;
> > ash_cnt:init_time = "20190622_010000" ;
> > ash_cnt:init_time_ut = "1561165200" ;
> > ash_cnt:valid_time = "20190622_010000" ;
> > ash_cnt:valid_time_ut = "1561165200" ;
> > int ash_mask(lat, lon) ;
> > ash_mask:long_name = "ash_mask(*,*)" ;
> > ash_mask:units = "NA" ;
> > ash_mask:_FillValue = -9999 ;
> > ash_mask:missing_value = -9999 ;
> > ash_mask:name = "ash_mask" ;
> > ash_mask:level = "*,*" ;
> > ash_mask:init_time = "20190622_010000" ;
> > ash_mask:init_time_ut = "1561165200" ;
> > ash_mask:valid_time = "20190622_010000" ;
> > ash_mask:valid_time_ut = "1561165200" ;
> >
> > // global attributes:
> > :CDI = "Climate Data Interface version 1.9.5
> > (http://mpimet.mpg.de/cdi)" ;
> > :Conventions = "CF-1.6" ;
> > :history = "Mon Jun 29 22:06:09 2020: cdo ensmean
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 010000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 011000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 012000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 013000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 014000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 015000.nc
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > 01.mean.nc" ;
> > :FileOrigins = "File
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > 010000.nc generated 20200629_194609 UTC on host hfe10 by the MET
> > point2grid tool" ;
> > :MET_version = "V9.0" ;
> > :MET_tool = "point2grid" ;
> > :RunCommand = "Point obs () to Projection: Lat/Lon
> > Nx:
> > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
delta_lon:
> > 0.250" ;
> > :Projection = "LatLon" ;
> > :lat_ll = "3.292000 degrees_north" ;
> > :lon_ll = "63.250000 degrees_east" ;
> > :delta_lat = "0.250000 degrees" ;
> > :delta_lon = "0.250000 degrees" ;
> > :Nlat = "361 grid_points" ;
> > :Nlon = "721 grid_points" ;
> > :CDO = "Climate Data Operators version 1.9.5
> > (http://mpimet.mpg.de/cdo)" ;
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Mon Jul 06 12:50:28 2020
Howard,
Thank you for the immediate help. But there are three things I want to
confirm:
1. you can see in my original *nc file, valid_time_ut =
"1561165200", but
the time shown in the warning message in the log file is
"19700101_000000", where is " 19700101_000000" coming from?
2. Actually the *nc file is my observation (NOT ensemble forecast), so
I
move the new line to obs. section in the config file, see below;
obs = {
wind_thresh = [ NA ];
field = [
{
name = "ash";
level = ["(*,*)"];
cat_thresh = [ >=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
}
];
};
------>
obs = {
wind_thresh = [ NA ];
file_type = NETCDF_MET;
field = [
{
name = "ash";
level = ["(*,*)"];
cat_thresh = [ >=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
}
];
};
After that, " WARNING: NcCfFile::open() -> could not determine the
valid
time, using 0." is gone from the log file, but I still had that "DEBUG
3:
Observation error for point verification is defined by a table lookup
for
each observation" in the log file, is that a problem? Because you can
not
access Hera, so I copied everything to WCOSS and tried again, then the
warning message is gone. Why is it different on WCOSS? My files on
WCOSS is
under
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
3. I used point2grid to convert ascII file to the *nc files I used
above,
and I used default configure files for "ascii2nc" and "point2grid",
will
this be a reason for the "valid time" issue? The script is under :
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
Thank you.
On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> MET recognizes the input NetCDF as the CF-complaint NetCDF file, but
it
> does not have the time variable.
>
> WARNING:
> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
> WARNING:
>
> The input NetCDF has the time information at the variable attribute,
> "valid_time_ut", which is for the MET generated NetCDF file.
>
> Three possible slutions:
>
> 1. Remove the global attribute "Conventions" at the input netcdf
>
> 2. Add "time" variable into the input NetCDF.
>
> 3. Add the file type "file_type=NETCDF_MET;" into the config file,
> verf_g2g_ens_stat_regn_config_Raikoke
>
> ens = {
> wind_thresh = [ NA ];
> field = [
> {
> name = "VAFTD";
> convert(x) = 3.91*10^16*(10^(x));
> level = [ "L0-18000" ];
> lead_time = "${LEAD_HR}";
> cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
>
> }
> ];
> };
>
> ==>
>
> ens = {
> wind_thresh = [ NA ];
> file_type = NETCDF_MET;
> field = [
> {
> name = "VAFTD";
> convert(x) = 3.91*10^16*(10^(x));
> level = [ "L0-18000" ];
> lead_time = "${LEAD_HR}";
> cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
>
> }
> ];
> };
>
> Cheers,
> Howard
>
>
> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > Thanks.
> >
> > The time information comes from "valid_time_ut" attribute for MET
> > generated NETCDF. Please download the config files and log files,
too.
> >
> > Cheers,
> > Howard
> >
> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > Hi Howard,
> > >
> > > I have access to hera but have not retrieved files from there
before.
> > > A normal scp doesn't seem to work. I asked Julie for help, but
in the
> > > meantime, I can paste the ncdump headers results for that file:
> > >
> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > dimensions:
> > > lon = 721 ;
> > > lat = 361 ;
> > > variables:
> > > float lon(lon) ;
> > > lon:standard_name = "longitude" ;
> > > lon:long_name = "longitude" ;
> > > lon:units = "degrees_east" ;
> > > lon:axis = "X" ;
> > > float lat(lat) ;
> > > lat:standard_name = "latitude" ;
> > > lat:long_name = "latitude" ;
> > > lat:units = "degrees_north" ;
> > > lat:axis = "Y" ;
> > > float ash(lat, lon) ;
> > > ash:long_name = "ash(*,*)" ;
> > > ash:units = "NA" ;
> > > ash:_FillValue = -9999.f ;
> > > ash:missing_value = -9999.f ;
> > > ash:name = "ash" ;
> > > ash:level = "*,*" ;
> > > ash:init_time = "20190622_010000" ;
> > > ash:init_time_ut = "1561165200" ;
> > > ash:valid_time = "20190622_010000" ;
> > > ash:valid_time_ut = "1561165200" ;
> > > int ash_cnt(lat, lon) ;
> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > > ash_cnt:units = "NA" ;
> > > ash_cnt:_FillValue = -9999 ;
> > > ash_cnt:missing_value = -9999 ;
> > > ash_cnt:name = "ash_cnt" ;
> > > ash_cnt:level = "*,*" ;
> > > ash_cnt:init_time = "20190622_010000" ;
> > > ash_cnt:init_time_ut = "1561165200" ;
> > > ash_cnt:valid_time = "20190622_010000" ;
> > > ash_cnt:valid_time_ut = "1561165200" ;
> > > int ash_mask(lat, lon) ;
> > > ash_mask:long_name = "ash_mask(*,*)" ;
> > > ash_mask:units = "NA" ;
> > > ash_mask:_FillValue = -9999 ;
> > > ash_mask:missing_value = -9999 ;
> > > ash_mask:name = "ash_mask" ;
> > > ash_mask:level = "*,*" ;
> > > ash_mask:init_time = "20190622_010000" ;
> > > ash_mask:init_time_ut = "1561165200" ;
> > > ash_mask:valid_time = "20190622_010000" ;
> > > ash_mask:valid_time_ut = "1561165200" ;
> > >
> > > // global attributes:
> > > :CDI = "Climate Data Interface version 1.9.5
> > > (http://mpimet.mpg.de/cdi)" ;
> > > :Conventions = "CF-1.6" ;
> > > :history = "Mon Jun 29 22:06:09 2020: cdo
ensmean
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 010000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 011000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 012000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 013000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 014000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 015000.nc
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > 01.mean.nc" ;
> > > :FileOrigins = "File
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > 010000.nc generated 20200629_194609 UTC on host hfe10 by the MET
> > > point2grid tool" ;
> > > :MET_version = "V9.0" ;
> > > :MET_tool = "point2grid" ;
> > > :RunCommand = "Point obs () to Projection:
Lat/Lon
> > > Nx:
> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
delta_lon:
> > > 0.250" ;
> > > :Projection = "LatLon" ;
> > > :lat_ll = "3.292000 degrees_north" ;
> > > :lon_ll = "63.250000 degrees_east" ;
> > > :delta_lat = "0.250000 degrees" ;
> > > :delta_lon = "0.250000 degrees" ;
> > > :Nlat = "361 grid_points" ;
> > > :Nlon = "721 grid_points" ;
> > > :CDO = "Climate Data Operators version 1.9.5
> > > (http://mpimet.mpg.de/cdo)" ;
>
>
>
>
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Mon Jul 06 12:59:13 2020
Hello,
Back to point 2 in my previous email: I just found I also got the same
warning "Observation error for point verification is defined by a
table
lookup for each observation" in the log file on WCOSS as well. In my
first
test, I didn' have this warning because I didn't add "-v 3" at the end
of
ensemble_stat command. So can I just ignore this warning? Sorry for
that.
Binyu
On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
binyu.wang at noaa.gov> wrote:
> Howard,
>
> Thank you for the immediate help. But there are three things I want
to
> confirm:
> 1. you can see in my original *nc file, valid_time_ut =
"1561165200",
> but the time shown in the warning message in the log file is
> "19700101_000000", where is " 19700101_000000" coming from?
>
> 2. Actually the *nc file is my observation (NOT ensemble forecast),
so I
> move the new line to obs. section in the config file, see below;
>
> obs = {
> wind_thresh = [ NA ];
> field = [
> {
> name = "ash";
> level = ["(*,*)"];
> cat_thresh = [ >=0.05, >=0.1,>=0.3,
>=0.5,>=1,>=3,>=5,>=7,>=10 ];
> }
> ];
> };
> ------>
>
> obs = {
> wind_thresh = [ NA ];
> file_type = NETCDF_MET;
> field = [
> {
> name = "ash";
> level = ["(*,*)"];
> cat_thresh = [ >=0.05, >=0.1,>=0.3,
>=0.5,>=1,>=3,>=5,>=7,>=10 ];
> }
> ];
>
> };
>
> After that, " WARNING: NcCfFile::open() -> could not determine the
valid
> time, using 0." is gone from the log file, but I still had that
"DEBUG 3:
> Observation error for point verification is defined by a table
lookup for
> each observation" in the log file, is that a problem? Because you
can not
> access Hera, so I copied everything to WCOSS and tried again, then
the
> warning message is gone. Why is it different on WCOSS? My files on
WCOSS is
> under
>
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
>
> 3. I used point2grid to convert ascII file to the *nc files I used
above,
> and I used default configure files for "ascii2nc" and "point2grid",
will
> this be a reason for the "valid time" issue? The script is under :
> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
>
> Thank you.
>
>
> On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
>> MET recognizes the input NetCDF as the CF-complaint NetCDF file,
but it
>> does not have the time variable.
>>
>> WARNING:
>> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
>> WARNING:
>>
>> The input NetCDF has the time information at the variable
attribute,
>> "valid_time_ut", which is for the MET generated NetCDF file.
>>
>> Three possible slutions:
>>
>> 1. Remove the global attribute "Conventions" at the input netcdf
>>
>> 2. Add "time" variable into the input NetCDF.
>>
>> 3. Add the file type "file_type=NETCDF_MET;" into the config file,
>> verf_g2g_ens_stat_regn_config_Raikoke
>>
>> ens = {
>> wind_thresh = [ NA ];
>> field = [
>> {
>> name = "VAFTD";
>> convert(x) = 3.91*10^16*(10^(x));
>> level = [ "L0-18000" ];
>> lead_time = "${LEAD_HR}";
>> cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
>>
>> }
>> ];
>> };
>>
>> ==>
>>
>> ens = {
>> wind_thresh = [ NA ];
>> file_type = NETCDF_MET;
>> field = [
>> {
>> name = "VAFTD";
>> convert(x) = 3.91*10^16*(10^(x));
>> level = [ "L0-18000" ];
>> lead_time = "${LEAD_HR}";
>> cat_thresh = [>=0.05, >=0.1,>=0.3, >=0.5,>=1,>=3,>=5,>=7,>=10
];
>>
>> }
>> ];
>> };
>>
>> Cheers,
>> Howard
>>
>>
>> On Mon Jul 06 09:04:54 2020, hsoh wrote:
>> > Thanks.
>> >
>> > The time information comes from "valid_time_ut" attribute for MET
>> > generated NETCDF. Please download the config files and log files,
too.
>> >
>> > Cheers,
>> > Howard
>> >
>> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
>> > > Hi Howard,
>> > >
>> > > I have access to hera but have not retrieved files from there
before.
>> > > A normal scp doesn't seem to work. I asked Julie for help, but
in the
>> > > meantime, I can paste the ncdump headers results for that file:
>> > >
>> > > netcdf regrid_Himawari_ash_20190622-01.mean {
>> > > dimensions:
>> > > lon = 721 ;
>> > > lat = 361 ;
>> > > variables:
>> > > float lon(lon) ;
>> > > lon:standard_name = "longitude" ;
>> > > lon:long_name = "longitude" ;
>> > > lon:units = "degrees_east" ;
>> > > lon:axis = "X" ;
>> > > float lat(lat) ;
>> > > lat:standard_name = "latitude" ;
>> > > lat:long_name = "latitude" ;
>> > > lat:units = "degrees_north" ;
>> > > lat:axis = "Y" ;
>> > > float ash(lat, lon) ;
>> > > ash:long_name = "ash(*,*)" ;
>> > > ash:units = "NA" ;
>> > > ash:_FillValue = -9999.f ;
>> > > ash:missing_value = -9999.f ;
>> > > ash:name = "ash" ;
>> > > ash:level = "*,*" ;
>> > > ash:init_time = "20190622_010000" ;
>> > > ash:init_time_ut = "1561165200" ;
>> > > ash:valid_time = "20190622_010000" ;
>> > > ash:valid_time_ut = "1561165200" ;
>> > > int ash_cnt(lat, lon) ;
>> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
>> > > ash_cnt:units = "NA" ;
>> > > ash_cnt:_FillValue = -9999 ;
>> > > ash_cnt:missing_value = -9999 ;
>> > > ash_cnt:name = "ash_cnt" ;
>> > > ash_cnt:level = "*,*" ;
>> > > ash_cnt:init_time = "20190622_010000" ;
>> > > ash_cnt:init_time_ut = "1561165200" ;
>> > > ash_cnt:valid_time = "20190622_010000" ;
>> > > ash_cnt:valid_time_ut = "1561165200" ;
>> > > int ash_mask(lat, lon) ;
>> > > ash_mask:long_name = "ash_mask(*,*)" ;
>> > > ash_mask:units = "NA" ;
>> > > ash_mask:_FillValue = -9999 ;
>> > > ash_mask:missing_value = -9999 ;
>> > > ash_mask:name = "ash_mask" ;
>> > > ash_mask:level = "*,*" ;
>> > > ash_mask:init_time = "20190622_010000" ;
>> > > ash_mask:init_time_ut = "1561165200" ;
>> > > ash_mask:valid_time = "20190622_010000" ;
>> > > ash_mask:valid_time_ut = "1561165200" ;
>> > >
>> > > // global attributes:
>> > > :CDI = "Climate Data Interface version 1.9.5
>> > > (http://mpimet.mpg.de/cdi)" ;
>> > > :Conventions = "CF-1.6" ;
>> > > :history = "Mon Jun 29 22:06:09 2020: cdo
ensmean
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 010000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 011000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 012000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 013000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 014000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 015000.nc
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
>> > > 01.mean.nc" ;
>> > > :FileOrigins = "File
>> > >
>>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
>> > > 010000.nc generated 20200629_194609 UTC on host hfe10 by the
MET
>> > > point2grid tool" ;
>> > > :MET_version = "V9.0" ;
>> > > :MET_tool = "point2grid" ;
>> > > :RunCommand = "Point obs () to Projection:
Lat/Lon
>> > > Nx:
>> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
delta_lon:
>> > > 0.250" ;
>> > > :Projection = "LatLon" ;
>> > > :lat_ll = "3.292000 degrees_north" ;
>> > > :lon_ll = "63.250000 degrees_east" ;
>> > > :delta_lat = "0.250000 degrees" ;
>> > > :delta_lon = "0.250000 degrees" ;
>> > > :Nlat = "361 grid_points" ;
>> > > :Nlon = "721 grid_points" ;
>> > > :CDO = "Climate Data Operators version 1.9.5
>> > > (http://mpimet.mpg.de/cdo)" ;
>>
>>
>>
>>
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Mon Jul 06 13:25:01 2020
Thank you for correcting the config file to override NetCDF file type.
The DEBUG 3 log message:
It is just an information. The observation error was defined 1) in the
config file or 2) by a table lookup for each observation.
Missing "time" variable at the output of point2grid:
The "Convensions" global attribute is added without adding "time"
variable by point2grid. The github issue was created
(https://github.com/NCAR/MET/issues/1407).
Cheers,
Howard
On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> Hello,
>
> Back to point 2 in my previous email: I just found I also got the
same
> warning "Observation error for point verification is defined by a
> table
> lookup for each observation" in the log file on WCOSS as well. In my
> first
> test, I didn' have this warning because I didn't add "-v 3" at the
end
> of
> ensemble_stat command. So can I just ignore this warning? Sorry for
> that.
>
> Binyu
>
> On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> binyu.wang at noaa.gov> wrote:
>
> > Howard,
> >
> > Thank you for the immediate help. But there are three things I
want
> > to
> > confirm:
> > 1. you can see in my original *nc file, valid_time_ut =
> > "1561165200",
> > but the time shown in the warning message in the log file is
> > "19700101_000000", where is " 19700101_000000" coming from?
> >
> > 2. Actually the *nc file is my observation (NOT ensemble
forecast),
> > so I
> > move the new line to obs. section in the config file, see below;
> >
> > obs = {
> > wind_thresh = [ NA ];
> > field = [
> > {
> > name = "ash";
> > level = ["(*,*)"];
> > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > >=0.5,>=1,>=3,>=5,>=7,>=10 ];
> > }
> > ];
> > };
> > ------>
> >
> > obs = {
> > wind_thresh = [ NA ];
> > file_type = NETCDF_MET;
> > field = [
> > {
> > name = "ash";
> > level = ["(*,*)"];
> > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > >=0.5,>=1,>=3,>=5,>=7,>=10 ];
> > }
> > ];
> >
> > };
> >
> > After that, " WARNING: NcCfFile::open() -> could not determine
the
> > valid
> > time, using 0." is gone from the log file, but I still had that
> > "DEBUG 3:
> > Observation error for point verification is defined by a table
lookup
> > for
> > each observation" in the log file, is that a problem? Because you
can
> > not
> > access Hera, so I copied everything to WCOSS and tried again, then
> > the
> > warning message is gone. Why is it different on WCOSS? My files on
> > WCOSS is
> > under
> >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> >
> > 3. I used point2grid to convert ascII file to the *nc files I used
> > above,
> > and I used default configure files for "ascii2nc" and
"point2grid",
> > will
> > this be a reason for the "valid time" issue? The script is under
:
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> >
> > Thank you.
> >
> >
> > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> >> MET recognizes the input NetCDF as the CF-complaint NetCDF file,
but
> >> it
> >> does not have the time variable.
> >>
> >> WARNING:
> >> WARNING: NcCfFile::open() -> could not determine the valid time,
> >> using 0.
> >> WARNING:
> >>
> >> The input NetCDF has the time information at the variable
attribute,
> >> "valid_time_ut", which is for the MET generated NetCDF file.
> >>
> >> Three possible slutions:
> >>
> >> 1. Remove the global attribute "Conventions" at the input netcdf
> >>
> >> 2. Add "time" variable into the input NetCDF.
> >>
> >> 3. Add the file type "file_type=NETCDF_MET;" into the config
file,
> >> verf_g2g_ens_stat_regn_config_Raikoke
> >>
> >> ens = {
> >> wind_thresh = [ NA ];
> >> field = [
> >> {
> >> name = "VAFTD";
> >> convert(x) = 3.91*10^16*(10^(x));
> >> level = [ "L0-18000" ];
> >> lead_time = "${LEAD_HR}";
> >> cat_thresh = [>=0.05, >=0.1,>=0.3,
>=0.5,>=1,>=3,>=5,>=7,>=10
> >> ];
> >>
> >> }
> >> ];
> >> };
> >>
> >> ==>
> >>
> >> ens = {
> >> wind_thresh = [ NA ];
> >> file_type = NETCDF_MET;
> >> field = [
> >> {
> >> name = "VAFTD";
> >> convert(x) = 3.91*10^16*(10^(x));
> >> level = [ "L0-18000" ];
> >> lead_time = "${LEAD_HR}";
> >> cat_thresh = [>=0.05, >=0.1,>=0.3,
>=0.5,>=1,>=3,>=5,>=7,>=10
> >> ];
> >>
> >> }
> >> ];
> >> };
> >>
> >> Cheers,
> >> Howard
> >>
> >>
> >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> >> > Thanks.
> >> >
> >> > The time information comes from "valid_time_ut" attribute for
MET
> >> > generated NETCDF. Please download the config files and log
files,
> >> > too.
> >> >
> >> > Cheers,
> >> > Howard
> >> >
> >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> >> > > Hi Howard,
> >> > >
> >> > > I have access to hera but have not retrieved files from there
> >> > > before.
> >> > > A normal scp doesn't seem to work. I asked Julie for help,
but
> >> > > in the
> >> > > meantime, I can paste the ncdump headers results for that
file:
> >> > >
> >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> >> > > dimensions:
> >> > > lon = 721 ;
> >> > > lat = 361 ;
> >> > > variables:
> >> > > float lon(lon) ;
> >> > > lon:standard_name = "longitude" ;
> >> > > lon:long_name = "longitude" ;
> >> > > lon:units = "degrees_east" ;
> >> > > lon:axis = "X" ;
> >> > > float lat(lat) ;
> >> > > lat:standard_name = "latitude" ;
> >> > > lat:long_name = "latitude" ;
> >> > > lat:units = "degrees_north" ;
> >> > > lat:axis = "Y" ;
> >> > > float ash(lat, lon) ;
> >> > > ash:long_name = "ash(*,*)" ;
> >> > > ash:units = "NA" ;
> >> > > ash:_FillValue = -9999.f ;
> >> > > ash:missing_value = -9999.f ;
> >> > > ash:name = "ash" ;
> >> > > ash:level = "*,*" ;
> >> > > ash:init_time = "20190622_010000" ;
> >> > > ash:init_time_ut = "1561165200" ;
> >> > > ash:valid_time = "20190622_010000" ;
> >> > > ash:valid_time_ut = "1561165200" ;
> >> > > int ash_cnt(lat, lon) ;
> >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> >> > > ash_cnt:units = "NA" ;
> >> > > ash_cnt:_FillValue = -9999 ;
> >> > > ash_cnt:missing_value = -9999 ;
> >> > > ash_cnt:name = "ash_cnt" ;
> >> > > ash_cnt:level = "*,*" ;
> >> > > ash_cnt:init_time = "20190622_010000" ;
> >> > > ash_cnt:init_time_ut = "1561165200" ;
> >> > > ash_cnt:valid_time = "20190622_010000" ;
> >> > > ash_cnt:valid_time_ut = "1561165200" ;
> >> > > int ash_mask(lat, lon) ;
> >> > > ash_mask:long_name = "ash_mask(*,*)" ;
> >> > > ash_mask:units = "NA" ;
> >> > > ash_mask:_FillValue = -9999 ;
> >> > > ash_mask:missing_value = -9999 ;
> >> > > ash_mask:name = "ash_mask" ;
> >> > > ash_mask:level = "*,*" ;
> >> > > ash_mask:init_time = "20190622_010000" ;
> >> > > ash_mask:init_time_ut = "1561165200" ;
> >> > > ash_mask:valid_time = "20190622_010000" ;
> >> > > ash_mask:valid_time_ut = "1561165200" ;
> >> > >
> >> > > // global attributes:
> >> > > :CDI = "Climate Data Interface version 1.9.5
> >> > > (http://mpimet.mpg.de/cdi)" ;
> >> > > :Conventions = "CF-1.6" ;
> >> > > :history = "Mon Jun 29 22:06:09 2020: cdo
> >> > > ensmean
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 010000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 011000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 012000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 013000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 014000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 015000.nc
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> >> > > 01.mean.nc" ;
> >> > > :FileOrigins = "File
> >> > >
> >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> >> > > 010000.nc generated 20200629_194609 UTC on host hfe10 by the
MET
> >> > > point2grid tool" ;
> >> > > :MET_version = "V9.0" ;
> >> > > :MET_tool = "point2grid" ;
> >> > > :RunCommand = "Point obs () to Projection:
> >> > > Lat/Lon
> >> > > Nx:
> >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
> >> > > delta_lon:
> >> > > 0.250" ;
> >> > > :Projection = "LatLon" ;
> >> > > :lat_ll = "3.292000 degrees_north" ;
> >> > > :lon_ll = "63.250000 degrees_east" ;
> >> > > :delta_lat = "0.250000 degrees" ;
> >> > > :delta_lon = "0.250000 degrees" ;
> >> > > :Nlat = "361 grid_points" ;
> >> > > :Nlon = "721 grid_points" ;
> >> > > :CDO = "Climate Data Operators version 1.9.5
> >> > > (http://mpimet.mpg.de/cdo)" ;
> >>
> >>
> >>
> >>
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Mon Jul 06 13:31:04 2020
19700101_000000 comes from the default unix time 0.
> date +"%Y%m%d_%H%M%S" -d at 0
19700101_000000
If the time information is missing, MET assigns the default unix time
(0) which is 19700101_000000.
Cheers,Howard
On Mon Jul 06 13:25:01 2020, hsoh wrote:
> Thank you for correcting the config file to override NetCDF file
type.
>
> The DEBUG 3 log message:
> It is just an information. The observation error was defined 1) in
the
> config file or 2) by a table lookup for each observation.
>
> Missing "time" variable at the output of point2grid:
> The "Convensions" global attribute is added without adding "time"
> variable by point2grid. The github issue was created
> (https://github.com/NCAR/MET/issues/1407).
>
> Cheers,
> Howard
>
> On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > Hello,
> >
> > Back to point 2 in my previous email: I just found I also got the
> > same
> > warning "Observation error for point verification is defined by a
> > table
> > lookup for each observation" in the log file on WCOSS as well. In
my
> > first
> > test, I didn' have this warning because I didn't add "-v 3" at the
> > end
> > of
> > ensemble_stat command. So can I just ignore this warning? Sorry
for
> > that.
> >
> > Binyu
> >
> > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> > binyu.wang at noaa.gov> wrote:
> >
> > > Howard,
> > >
> > > Thank you for the immediate help. But there are three things I
want
> > > to
> > > confirm:
> > > 1. you can see in my original *nc file, valid_time_ut =
> > > "1561165200",
> > > but the time shown in the warning message in the log file is
> > > "19700101_000000", where is " 19700101_000000" coming from?
> > >
> > > 2. Actually the *nc file is my observation (NOT ensemble
forecast),
> > > so I
> > > move the new line to obs. section in the config file, see below;
> > >
> > > obs = {
> > > wind_thresh = [ NA ];
> > > field = [
> > > {
> > > name = "ash";
> > > level = ["(*,*)"];
> > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > }
> > > ];
> > > };
> > > ------>
> > >
> > > obs = {
> > > wind_thresh = [ NA ];
> > > file_type = NETCDF_MET;
> > > field = [
> > > {
> > > name = "ash";
> > > level = ["(*,*)"];
> > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > }
> > > ];
> > >
> > > };
> > >
> > > After that, " WARNING: NcCfFile::open() -> could not determine
the
> > > valid
> > > time, using 0." is gone from the log file, but I still had that
> > > "DEBUG 3:
> > > Observation error for point verification is defined by a table
> > > lookup
> > > for
> > > each observation" in the log file, is that a problem? Because
you
> > > can
> > > not
> > > access Hera, so I copied everything to WCOSS and tried again,
then
> > > the
> > > warning message is gone. Why is it different on WCOSS? My files
on
> > > WCOSS is
> > > under
> > >
> > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > >
> > > 3. I used point2grid to convert ascII file to the *nc files I
used
> > > above,
> > > and I used default configure files for "ascii2nc" and
> > > "point2grid",
> > > will
> > > this be a reason for the "valid time" issue? The script is
under :
> > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > >
> > > Thank you.
> > >
> > >
> > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > >> MET recognizes the input NetCDF as the CF-complaint NetCDF
file,
> > >> but
> > >> it
> > >> does not have the time variable.
> > >>
> > >> WARNING:
> > >> WARNING: NcCfFile::open() -> could not determine the valid
time,
> > >> using 0.
> > >> WARNING:
> > >>
> > >> The input NetCDF has the time information at the variable
> > >> attribute,
> > >> "valid_time_ut", which is for the MET generated NetCDF file.
> > >>
> > >> Three possible slutions:
> > >>
> > >> 1. Remove the global attribute "Conventions" at the input
netcdf
> > >>
> > >> 2. Add "time" variable into the input NetCDF.
> > >>
> > >> 3. Add the file type "file_type=NETCDF_MET;" into the config
file,
> > >> verf_g2g_ens_stat_regn_config_Raikoke
> > >>
> > >> ens = {
> > >> wind_thresh = [ NA ];
> > >> field = [
> > >> {
> > >> name = "VAFTD";
> > >> convert(x) = 3.91*10^16*(10^(x));
> > >> level = [ "L0-18000" ];
> > >> lead_time = "${LEAD_HR}";
> > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > >> >=0.5,>=1,>=3,>=5,>=7,>=10
> > >> ];
> > >>
> > >> }
> > >> ];
> > >> };
> > >>
> > >> ==>
> > >>
> > >> ens = {
> > >> wind_thresh = [ NA ];
> > >> file_type = NETCDF_MET;
> > >> field = [
> > >> {
> > >> name = "VAFTD";
> > >> convert(x) = 3.91*10^16*(10^(x));
> > >> level = [ "L0-18000" ];
> > >> lead_time = "${LEAD_HR}";
> > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > >> >=0.5,>=1,>=3,>=5,>=7,>=10
> > >> ];
> > >>
> > >> }
> > >> ];
> > >> };
> > >>
> > >> Cheers,
> > >> Howard
> > >>
> > >>
> > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > >> > Thanks.
> > >> >
> > >> > The time information comes from "valid_time_ut" attribute for
> > >> > MET
> > >> > generated NETCDF. Please download the config files and log
> > >> > files,
> > >> > too.
> > >> >
> > >> > Cheers,
> > >> > Howard
> > >> >
> > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > >> > > Hi Howard,
> > >> > >
> > >> > > I have access to hera but have not retrieved files from
there
> > >> > > before.
> > >> > > A normal scp doesn't seem to work. I asked Julie for help,
but
> > >> > > in the
> > >> > > meantime, I can paste the ncdump headers results for that
> > >> > > file:
> > >> > >
> > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > >> > > dimensions:
> > >> > > lon = 721 ;
> > >> > > lat = 361 ;
> > >> > > variables:
> > >> > > float lon(lon) ;
> > >> > > lon:standard_name = "longitude" ;
> > >> > > lon:long_name = "longitude" ;
> > >> > > lon:units = "degrees_east" ;
> > >> > > lon:axis = "X" ;
> > >> > > float lat(lat) ;
> > >> > > lat:standard_name = "latitude" ;
> > >> > > lat:long_name = "latitude" ;
> > >> > > lat:units = "degrees_north" ;
> > >> > > lat:axis = "Y" ;
> > >> > > float ash(lat, lon) ;
> > >> > > ash:long_name = "ash(*,*)" ;
> > >> > > ash:units = "NA" ;
> > >> > > ash:_FillValue = -9999.f ;
> > >> > > ash:missing_value = -9999.f ;
> > >> > > ash:name = "ash" ;
> > >> > > ash:level = "*,*" ;
> > >> > > ash:init_time = "20190622_010000" ;
> > >> > > ash:init_time_ut = "1561165200" ;
> > >> > > ash:valid_time = "20190622_010000" ;
> > >> > > ash:valid_time_ut = "1561165200" ;
> > >> > > int ash_cnt(lat, lon) ;
> > >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > >> > > ash_cnt:units = "NA" ;
> > >> > > ash_cnt:_FillValue = -9999 ;
> > >> > > ash_cnt:missing_value = -9999 ;
> > >> > > ash_cnt:name = "ash_cnt" ;
> > >> > > ash_cnt:level = "*,*" ;
> > >> > > ash_cnt:init_time = "20190622_010000" ;
> > >> > > ash_cnt:init_time_ut = "1561165200" ;
> > >> > > ash_cnt:valid_time = "20190622_010000" ;
> > >> > > ash_cnt:valid_time_ut = "1561165200" ;
> > >> > > int ash_mask(lat, lon) ;
> > >> > > ash_mask:long_name = "ash_mask(*,*)" ;
> > >> > > ash_mask:units = "NA" ;
> > >> > > ash_mask:_FillValue = -9999 ;
> > >> > > ash_mask:missing_value = -9999 ;
> > >> > > ash_mask:name = "ash_mask" ;
> > >> > > ash_mask:level = "*,*" ;
> > >> > > ash_mask:init_time = "20190622_010000" ;
> > >> > > ash_mask:init_time_ut = "1561165200" ;
> > >> > > ash_mask:valid_time = "20190622_010000" ;
> > >> > > ash_mask:valid_time_ut = "1561165200" ;
> > >> > >
> > >> > > // global attributes:
> > >> > > :CDI = "Climate Data Interface version
1.9.5
> > >> > > (http://mpimet.mpg.de/cdi)" ;
> > >> > > :Conventions = "CF-1.6" ;
> > >> > > :history = "Mon Jun 29 22:06:09 2020: cdo
> > >> > > ensmean
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 010000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 011000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 012000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 013000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 014000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 015000.nc
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > >> > > 01.mean.nc" ;
> > >> > > :FileOrigins = "File
> > >> > >
> > >>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > >> > > 010000.nc generated 20200629_194609 UTC on host hfe10 by
the
> > >> > > MET
> > >> > > point2grid tool" ;
> > >> > > :MET_version = "V9.0" ;
> > >> > > :MET_tool = "point2grid" ;
> > >> > > :RunCommand = "Point obs () to Projection:
> > >> > > Lat/Lon
> > >> > > Nx:
> > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat: 0.250
> > >> > > delta_lon:
> > >> > > 0.250" ;
> > >> > > :Projection = "LatLon" ;
> > >> > > :lat_ll = "3.292000 degrees_north" ;
> > >> > > :lon_ll = "63.250000 degrees_east" ;
> > >> > > :delta_lat = "0.250000 degrees" ;
> > >> > > :delta_lon = "0.250000 degrees" ;
> > >> > > :Nlat = "361 grid_points" ;
> > >> > > :Nlon = "721 grid_points" ;
> > >> > > :CDO = "Climate Data Operators version
1.9.5
> > >> > > (http://mpimet.mpg.de/cdo)" ;
> > >>
> > >>
> > >>
> > >>
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Mon Jul 06 13:41:48 2020
Got it, thank you very much.
Binyu
On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> 19700101_000000 comes from the default unix time 0.
>
> > date +"%Y%m%d_%H%M%S" -d at 0
> 19700101_000000
>
> If the time information is missing, MET assigns the default unix
time (0)
> which is 19700101_000000.
>
> Cheers,Howard
>
> On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > Thank you for correcting the config file to override NetCDF file
type.
> >
> > The DEBUG 3 log message:
> > It is just an information. The observation error was defined 1) in
the
> > config file or 2) by a table lookup for each observation.
> >
> > Missing "time" variable at the output of point2grid:
> > The "Convensions" global attribute is added without adding "time"
> > variable by point2grid. The github issue was created
> > (https://github.com/NCAR/MET/issues/1407).
> >
> > Cheers,
> > Howard
> >
> > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > Hello,
> > >
> > > Back to point 2 in my previous email: I just found I also got
the
> > > same
> > > warning "Observation error for point verification is defined by
a
> > > table
> > > lookup for each observation" in the log file on WCOSS as well.
In my
> > > first
> > > test, I didn' have this warning because I didn't add "-v 3" at
the
> > > end
> > > of
> > > ensemble_stat command. So can I just ignore this warning? Sorry
for
> > > that.
> > >
> > > Binyu
> > >
> > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> > > binyu.wang at noaa.gov> wrote:
> > >
> > > > Howard,
> > > >
> > > > Thank you for the immediate help. But there are three things I
want
> > > > to
> > > > confirm:
> > > > 1. you can see in my original *nc file, valid_time_ut =
> > > > "1561165200",
> > > > but the time shown in the warning message in the log file is
> > > > "19700101_000000", where is " 19700101_000000" coming from?
> > > >
> > > > 2. Actually the *nc file is my observation (NOT ensemble
forecast),
> > > > so I
> > > > move the new line to obs. section in the config file, see
below;
> > > >
> > > > obs = {
> > > > wind_thresh = [ NA ];
> > > > field = [
> > > > {
> > > > name = "ash";
> > > > level = ["(*,*)"];
> > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > }
> > > > ];
> > > > };
> > > > ------>
> > > >
> > > > obs = {
> > > > wind_thresh = [ NA ];
> > > > file_type = NETCDF_MET;
> > > > field = [
> > > > {
> > > > name = "ash";
> > > > level = ["(*,*)"];
> > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > }
> > > > ];
> > > >
> > > > };
> > > >
> > > > After that, " WARNING: NcCfFile::open() -> could not
determine the
> > > > valid
> > > > time, using 0." is gone from the log file, but I still had
that
> > > > "DEBUG 3:
> > > > Observation error for point verification is defined by a table
> > > > lookup
> > > > for
> > > > each observation" in the log file, is that a problem? Because
you
> > > > can
> > > > not
> > > > access Hera, so I copied everything to WCOSS and tried again,
then
> > > > the
> > > > warning message is gone. Why is it different on WCOSS? My
files on
> > > > WCOSS is
> > > > under
> > > >
> > > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > >
> > > > 3. I used point2grid to convert ascII file to the *nc files I
used
> > > > above,
> > > > and I used default configure files for "ascii2nc" and
> > > > "point2grid",
> > > > will
> > > > this be a reason for the "valid time" issue? The script is
under :
> > > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > >
> > > > Thank you.
> > > >
> > > >
> > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > >> MET recognizes the input NetCDF as the CF-complaint NetCDF
file,
> > > >> but
> > > >> it
> > > >> does not have the time variable.
> > > >>
> > > >> WARNING:
> > > >> WARNING: NcCfFile::open() -> could not determine the valid
time,
> > > >> using 0.
> > > >> WARNING:
> > > >>
> > > >> The input NetCDF has the time information at the variable
> > > >> attribute,
> > > >> "valid_time_ut", which is for the MET generated NetCDF file.
> > > >>
> > > >> Three possible slutions:
> > > >>
> > > >> 1. Remove the global attribute "Conventions" at the input
netcdf
> > > >>
> > > >> 2. Add "time" variable into the input NetCDF.
> > > >>
> > > >> 3. Add the file type "file_type=NETCDF_MET;" into the config
file,
> > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > >>
> > > >> ens = {
> > > >> wind_thresh = [ NA ];
> > > >> field = [
> > > >> {
> > > >> name = "VAFTD";
> > > >> convert(x) = 3.91*10^16*(10^(x));
> > > >> level = [ "L0-18000" ];
> > > >> lead_time = "${LEAD_HR}";
> > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > >> >=0.5,>=1,>=3,>=5,>=7,>=10
> > > >> ];
> > > >>
> > > >> }
> > > >> ];
> > > >> };
> > > >>
> > > >> ==>
> > > >>
> > > >> ens = {
> > > >> wind_thresh = [ NA ];
> > > >> file_type = NETCDF_MET;
> > > >> field = [
> > > >> {
> > > >> name = "VAFTD";
> > > >> convert(x) = 3.91*10^16*(10^(x));
> > > >> level = [ "L0-18000" ];
> > > >> lead_time = "${LEAD_HR}";
> > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > >> >=0.5,>=1,>=3,>=5,>=7,>=10
> > > >> ];
> > > >>
> > > >> }
> > > >> ];
> > > >> };
> > > >>
> > > >> Cheers,
> > > >> Howard
> > > >>
> > > >>
> > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > >> > Thanks.
> > > >> >
> > > >> > The time information comes from "valid_time_ut" attribute
for
> > > >> > MET
> > > >> > generated NETCDF. Please download the config files and log
> > > >> > files,
> > > >> > too.
> > > >> >
> > > >> > Cheers,
> > > >> > Howard
> > > >> >
> > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > >> > > Hi Howard,
> > > >> > >
> > > >> > > I have access to hera but have not retrieved files from
there
> > > >> > > before.
> > > >> > > A normal scp doesn't seem to work. I asked Julie for
help, but
> > > >> > > in the
> > > >> > > meantime, I can paste the ncdump headers results for that
> > > >> > > file:
> > > >> > >
> > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > >> > > dimensions:
> > > >> > > lon = 721 ;
> > > >> > > lat = 361 ;
> > > >> > > variables:
> > > >> > > float lon(lon) ;
> > > >> > > lon:standard_name = "longitude" ;
> > > >> > > lon:long_name = "longitude" ;
> > > >> > > lon:units = "degrees_east" ;
> > > >> > > lon:axis = "X" ;
> > > >> > > float lat(lat) ;
> > > >> > > lat:standard_name = "latitude" ;
> > > >> > > lat:long_name = "latitude" ;
> > > >> > > lat:units = "degrees_north" ;
> > > >> > > lat:axis = "Y" ;
> > > >> > > float ash(lat, lon) ;
> > > >> > > ash:long_name = "ash(*,*)" ;
> > > >> > > ash:units = "NA" ;
> > > >> > > ash:_FillValue = -9999.f ;
> > > >> > > ash:missing_value = -9999.f ;
> > > >> > > ash:name = "ash" ;
> > > >> > > ash:level = "*,*" ;
> > > >> > > ash:init_time = "20190622_010000" ;
> > > >> > > ash:init_time_ut = "1561165200" ;
> > > >> > > ash:valid_time = "20190622_010000" ;
> > > >> > > ash:valid_time_ut = "1561165200" ;
> > > >> > > int ash_cnt(lat, lon) ;
> > > >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > > >> > > ash_cnt:units = "NA" ;
> > > >> > > ash_cnt:_FillValue = -9999 ;
> > > >> > > ash_cnt:missing_value = -9999 ;
> > > >> > > ash_cnt:name = "ash_cnt" ;
> > > >> > > ash_cnt:level = "*,*" ;
> > > >> > > ash_cnt:init_time = "20190622_010000" ;
> > > >> > > ash_cnt:init_time_ut = "1561165200" ;
> > > >> > > ash_cnt:valid_time = "20190622_010000" ;
> > > >> > > ash_cnt:valid_time_ut = "1561165200" ;
> > > >> > > int ash_mask(lat, lon) ;
> > > >> > > ash_mask:long_name = "ash_mask(*,*)" ;
> > > >> > > ash_mask:units = "NA" ;
> > > >> > > ash_mask:_FillValue = -9999 ;
> > > >> > > ash_mask:missing_value = -9999 ;
> > > >> > > ash_mask:name = "ash_mask" ;
> > > >> > > ash_mask:level = "*,*" ;
> > > >> > > ash_mask:init_time = "20190622_010000" ;
> > > >> > > ash_mask:init_time_ut = "1561165200" ;
> > > >> > > ash_mask:valid_time = "20190622_010000" ;
> > > >> > > ash_mask:valid_time_ut = "1561165200" ;
> > > >> > >
> > > >> > > // global attributes:
> > > >> > > :CDI = "Climate Data Interface version
1.9.5
> > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > >> > > :Conventions = "CF-1.6" ;
> > > >> > > :history = "Mon Jun 29 22:06:09 2020: cdo
> > > >> > > ensmean
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 010000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 011000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 012000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 013000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 014000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 015000.nc
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > >> > > 01.mean.nc" ;
> > > >> > > :FileOrigins = "File
> > > >> > >
> > > >>
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > >> > > 010000.nc generated 20200629_194609 UTC on host hfe10 by
the
> > > >> > > MET
> > > >> > > point2grid tool" ;
> > > >> > > :MET_version = "V9.0" ;
> > > >> > > :MET_tool = "point2grid" ;
> > > >> > > :RunCommand = "Point obs () to
Projection:
> > > >> > > Lat/Lon
> > > >> > > Nx:
> > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat:
0.250
> > > >> > > delta_lon:
> > > >> > > 0.250" ;
> > > >> > > :Projection = "LatLon" ;
> > > >> > > :lat_ll = "3.292000 degrees_north" ;
> > > >> > > :lon_ll = "63.250000 degrees_east" ;
> > > >> > > :delta_lat = "0.250000 degrees" ;
> > > >> > > :delta_lon = "0.250000 degrees" ;
> > > >> > > :Nlat = "361 grid_points" ;
> > > >> > > :Nlon = "721 grid_points" ;
> > > >> > > :CDO = "Climate Data Operators version
1.9.5
> > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > >>
> > > >>
> > > >>
> > > >>
>
>
>
>
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Tue Jul 07 00:29:23 2020
Missing "time" variable at the output of point2grid:
The "Convensions" global attribute was not added by point2grid. It
might be added by cdo.
I will hold the github issue
(https://github.com/NCAR/MET/issues/1407).
There is other issue (https://github.com/NCAR/MET/issues/1396) which
supports multitple -field arguments. MET allows different obs_time per
field. For example, the following command is allowed:
./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
valid_time="20120409_120000";' -field 'name="RH"; level="*";
valid_time="20120409_180000";' -v 1
different valid time:
- TMP: 20120409_120000
- RH: 20120409_180000
I need to check if this is acceptable.
Cheers,
Howard
On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> Got it, thank you very much.
> Binyu
>
> On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT <met_help at ucar.edu>
> wrote:
>
> > 19700101_000000 comes from the default unix time 0.
> >
> > > date +"%Y%m%d_%H%M%S" -d at 0
> > 19700101_000000
> >
> > If the time information is missing, MET assigns the default unix
time
> > (0)
> > which is 19700101_000000.
> >
> > Cheers,Howard
> >
> > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > Thank you for correcting the config file to override NetCDF file
> > > type.
> > >
> > > The DEBUG 3 log message:
> > > It is just an information. The observation error was defined 1)
in
> > > the
> > > config file or 2) by a table lookup for each observation.
> > >
> > > Missing "time" variable at the output of point2grid:
> > > The "Convensions" global attribute is added without adding
"time"
> > > variable by point2grid. The github issue was created
> > > (https://github.com/NCAR/MET/issues/1407).
> > >
> > > Cheers,
> > > Howard
> > >
> > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > Hello,
> > > >
> > > > Back to point 2 in my previous email: I just found I also got
the
> > > > same
> > > > warning "Observation error for point verification is defined
by a
> > > > table
> > > > lookup for each observation" in the log file on WCOSS as well.
In
> > > > my
> > > > first
> > > > test, I didn' have this warning because I didn't add "-v 3" at
> > > > the
> > > > end
> > > > of
> > > > ensemble_stat command. So can I just ignore this warning?
Sorry
> > > > for
> > > > that.
> > > >
> > > > Binyu
> > > >
> > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> > > > binyu.wang at noaa.gov> wrote:
> > > >
> > > > > Howard,
> > > > >
> > > > > Thank you for the immediate help. But there are three things
I
> > > > > want
> > > > > to
> > > > > confirm:
> > > > > 1. you can see in my original *nc file, valid_time_ut =
> > > > > "1561165200",
> > > > > but the time shown in the warning message in the log file
is
> > > > > "19700101_000000", where is " 19700101_000000" coming from?
> > > > >
> > > > > 2. Actually the *nc file is my observation (NOT ensemble
> > > > > forecast),
> > > > > so I
> > > > > move the new line to obs. section in the config file, see
> > > > > below;
> > > > >
> > > > > obs = {
> > > > > wind_thresh = [ NA ];
> > > > > field = [
> > > > > {
> > > > > name = "ash";
> > > > > level = ["(*,*)"];
> > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > }
> > > > > ];
> > > > > };
> > > > > ------>
> > > > >
> > > > > obs = {
> > > > > wind_thresh = [ NA ];
> > > > > file_type = NETCDF_MET;
> > > > > field = [
> > > > > {
> > > > > name = "ash";
> > > > > level = ["(*,*)"];
> > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > }
> > > > > ];
> > > > >
> > > > > };
> > > > >
> > > > > After that, " WARNING: NcCfFile::open() -> could not
determine
> > > > > the
> > > > > valid
> > > > > time, using 0." is gone from the log file, but I still had
that
> > > > > "DEBUG 3:
> > > > > Observation error for point verification is defined by a
table
> > > > > lookup
> > > > > for
> > > > > each observation" in the log file, is that a problem?
Because
> > > > > you
> > > > > can
> > > > > not
> > > > > access Hera, so I copied everything to WCOSS and tried
again,
> > > > > then
> > > > > the
> > > > > warning message is gone. Why is it different on WCOSS? My
files
> > > > > on
> > > > > WCOSS is
> > > > > under
> > > > >
> > > > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > >
> > > > > 3. I used point2grid to convert ascII file to the *nc files
I
> > > > > used
> > > > > above,
> > > > > and I used default configure files for "ascii2nc" and
> > > > > "point2grid",
> > > > > will
> > > > > this be a reason for the "valid time" issue? The script is
> > > > > under :
> > > > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > >
> > > > > Thank you.
> > > > >
> > > > >
> > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > >> MET recognizes the input NetCDF as the CF-complaint NetCDF
> > > > >> file,
> > > > >> but
> > > > >> it
> > > > >> does not have the time variable.
> > > > >>
> > > > >> WARNING:
> > > > >> WARNING: NcCfFile::open() -> could not determine the valid
> > > > >> time,
> > > > >> using 0.
> > > > >> WARNING:
> > > > >>
> > > > >> The input NetCDF has the time information at the variable
> > > > >> attribute,
> > > > >> "valid_time_ut", which is for the MET generated NetCDF
file.
> > > > >>
> > > > >> Three possible slutions:
> > > > >>
> > > > >> 1. Remove the global attribute "Conventions" at the input
> > > > >> netcdf
> > > > >>
> > > > >> 2. Add "time" variable into the input NetCDF.
> > > > >>
> > > > >> 3. Add the file type "file_type=NETCDF_MET;" into the
config
> > > > >> file,
> > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > >>
> > > > >> ens = {
> > > > >> wind_thresh = [ NA ];
> > > > >> field = [
> > > > >> {
> > > > >> name = "VAFTD";
> > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > >> level = [ "L0-18000" ];
> > > > >> lead_time = "${LEAD_HR}";
> > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > >> ];
> > > > >>
> > > > >> }
> > > > >> ];
> > > > >> };
> > > > >>
> > > > >> ==>
> > > > >>
> > > > >> ens = {
> > > > >> wind_thresh = [ NA ];
> > > > >> file_type = NETCDF_MET;
> > > > >> field = [
> > > > >> {
> > > > >> name = "VAFTD";
> > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > >> level = [ "L0-18000" ];
> > > > >> lead_time = "${LEAD_HR}";
> > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > >> ];
> > > > >>
> > > > >> }
> > > > >> ];
> > > > >> };
> > > > >>
> > > > >> Cheers,
> > > > >> Howard
> > > > >>
> > > > >>
> > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > >> > Thanks.
> > > > >> >
> > > > >> > The time information comes from "valid_time_ut" attribute
> > > > >> > for
> > > > >> > MET
> > > > >> > generated NETCDF. Please download the config files and
log
> > > > >> > files,
> > > > >> > too.
> > > > >> >
> > > > >> > Cheers,
> > > > >> > Howard
> > > > >> >
> > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > >> > > Hi Howard,
> > > > >> > >
> > > > >> > > I have access to hera but have not retrieved files from
> > > > >> > > there
> > > > >> > > before.
> > > > >> > > A normal scp doesn't seem to work. I asked Julie for
help,
> > > > >> > > but
> > > > >> > > in the
> > > > >> > > meantime, I can paste the ncdump headers results for
that
> > > > >> > > file:
> > > > >> > >
> > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > >> > > dimensions:
> > > > >> > > lon = 721 ;
> > > > >> > > lat = 361 ;
> > > > >> > > variables:
> > > > >> > > float lon(lon) ;
> > > > >> > > lon:standard_name = "longitude" ;
> > > > >> > > lon:long_name = "longitude" ;
> > > > >> > > lon:units = "degrees_east" ;
> > > > >> > > lon:axis = "X" ;
> > > > >> > > float lat(lat) ;
> > > > >> > > lat:standard_name = "latitude" ;
> > > > >> > > lat:long_name = "latitude" ;
> > > > >> > > lat:units = "degrees_north" ;
> > > > >> > > lat:axis = "Y" ;
> > > > >> > > float ash(lat, lon) ;
> > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > >> > > ash:units = "NA" ;
> > > > >> > > ash:_FillValue = -9999.f ;
> > > > >> > > ash:missing_value = -9999.f ;
> > > > >> > > ash:name = "ash" ;
> > > > >> > > ash:level = "*,*" ;
> > > > >> > > ash:init_time = "20190622_010000" ;
> > > > >> > > ash:init_time_ut = "1561165200" ;
> > > > >> > > ash:valid_time = "20190622_010000" ;
> > > > >> > > ash:valid_time_ut = "1561165200" ;
> > > > >> > > int ash_cnt(lat, lon) ;
> > > > >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > > > >> > > ash_cnt:units = "NA" ;
> > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > >> > > ash_cnt:level = "*,*" ;
> > > > >> > > ash_cnt:init_time = "20190622_010000" ;
> > > > >> > > ash_cnt:init_time_ut = "1561165200" ;
> > > > >> > > ash_cnt:valid_time = "20190622_010000"
;
> > > > >> > > ash_cnt:valid_time_ut = "1561165200" ;
> > > > >> > > int ash_mask(lat, lon) ;
> > > > >> > > ash_mask:long_name = "ash_mask(*,*)" ;
> > > > >> > > ash_mask:units = "NA" ;
> > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > >> > > ash_mask:missing_value = -9999 ;
> > > > >> > > ash_mask:name = "ash_mask" ;
> > > > >> > > ash_mask:level = "*,*" ;
> > > > >> > > ash_mask:init_time = "20190622_010000"
;
> > > > >> > > ash_mask:init_time_ut = "1561165200" ;
> > > > >> > > ash_mask:valid_time = "20190622_010000"
;
> > > > >> > > ash_mask:valid_time_ut = "1561165200" ;
> > > > >> > >
> > > > >> > > // global attributes:
> > > > >> > > :CDI = "Climate Data Interface version
> > > > >> > > 1.9.5
> > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > >> > > :Conventions = "CF-1.6" ;
> > > > >> > > :history = "Mon Jun 29 22:06:09 2020:
cdo
> > > > >> > > ensmean
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 010000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 011000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 012000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 013000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 014000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 015000.nc
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > >> > > 01.mean.nc" ;
> > > > >> > > :FileOrigins = "File
> > > > >> > >
> > > > >>
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > >> > > 010000.nc generated 20200629_194609 UTC on host hfe10
by
> > > > >> > > the
> > > > >> > > MET
> > > > >> > > point2grid tool" ;
> > > > >> > > :MET_version = "V9.0" ;
> > > > >> > > :MET_tool = "point2grid" ;
> > > > >> > > :RunCommand = "Point obs () to
Projection:
> > > > >> > > Lat/Lon
> > > > >> > > Nx:
> > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat:
0.250
> > > > >> > > delta_lon:
> > > > >> > > 0.250" ;
> > > > >> > > :Projection = "LatLon" ;
> > > > >> > > :lat_ll = "3.292000 degrees_north" ;
> > > > >> > > :lon_ll = "63.250000 degrees_east" ;
> > > > >> > > :delta_lat = "0.250000 degrees" ;
> > > > >> > > :delta_lon = "0.250000 degrees" ;
> > > > >> > > :Nlat = "361 grid_points" ;
> > > > >> > > :Nlon = "721 grid_points" ;
> > > > >> > > :CDO = "Climate Data Operators version
> > > > >> > > 1.9.5
> > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> >
> >
> >
> >
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Tue Jul 07 07:11:53 2020
Thank you for letting me know.
Binyu
On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT <met_help at ucar.edu>
wrote:
> Missing "time" variable at the output of point2grid:
> The "Convensions" global attribute was not added by point2grid. It
might
> be added by cdo.
>
> I will hold the github issue
(https://github.com/NCAR/MET/issues/1407).
> There is other issue (https://github.com/NCAR/MET/issues/1396) which
> supports multitple -field arguments. MET allows different obs_time
per
> field. For example, the following command is allowed:
> ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
> pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> valid_time="20120409_120000";' -field 'name="RH"; level="*";
> valid_time="20120409_180000";' -v 1
>
> different valid time:
> - TMP: 20120409_120000
> - RH: 20120409_180000
>
> I need to check if this is acceptable.
>
> Cheers,
> Howard
>
>
> On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > Got it, thank you very much.
> > Binyu
> >
> > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > 19700101_000000 comes from the default unix time 0.
> > >
> > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > 19700101_000000
> > >
> > > If the time information is missing, MET assigns the default unix
time
> > > (0)
> > > which is 19700101_000000.
> > >
> > > Cheers,Howard
> > >
> > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > Thank you for correcting the config file to override NetCDF
file
> > > > type.
> > > >
> > > > The DEBUG 3 log message:
> > > > It is just an information. The observation error was defined
1) in
> > > > the
> > > > config file or 2) by a table lookup for each observation.
> > > >
> > > > Missing "time" variable at the output of point2grid:
> > > > The "Convensions" global attribute is added without adding
"time"
> > > > variable by point2grid. The github issue was created
> > > > (https://github.com/NCAR/MET/issues/1407).
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > > Hello,
> > > > >
> > > > > Back to point 2 in my previous email: I just found I also
got the
> > > > > same
> > > > > warning "Observation error for point verification is defined
by a
> > > > > table
> > > > > lookup for each observation" in the log file on WCOSS as
well. In
> > > > > my
> > > > > first
> > > > > test, I didn' have this warning because I didn't add "-v 3"
at
> > > > > the
> > > > > end
> > > > > of
> > > > > ensemble_stat command. So can I just ignore this warning?
Sorry
> > > > > for
> > > > > that.
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> > > > > binyu.wang at noaa.gov> wrote:
> > > > >
> > > > > > Howard,
> > > > > >
> > > > > > Thank you for the immediate help. But there are three
things I
> > > > > > want
> > > > > > to
> > > > > > confirm:
> > > > > > 1. you can see in my original *nc file, valid_time_ut =
> > > > > > "1561165200",
> > > > > > but the time shown in the warning message in the log file
is
> > > > > > "19700101_000000", where is " 19700101_000000" coming
from?
> > > > > >
> > > > > > 2. Actually the *nc file is my observation (NOT ensemble
> > > > > > forecast),
> > > > > > so I
> > > > > > move the new line to obs. section in the config file, see
> > > > > > below;
> > > > > >
> > > > > > obs = {
> > > > > > wind_thresh = [ NA ];
> > > > > > field = [
> > > > > > {
> > > > > > name = "ash";
> > > > > > level = ["(*,*)"];
> > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > }
> > > > > > ];
> > > > > > };
> > > > > > ------>
> > > > > >
> > > > > > obs = {
> > > > > > wind_thresh = [ NA ];
> > > > > > file_type = NETCDF_MET;
> > > > > > field = [
> > > > > > {
> > > > > > name = "ash";
> > > > > > level = ["(*,*)"];
> > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > }
> > > > > > ];
> > > > > >
> > > > > > };
> > > > > >
> > > > > > After that, " WARNING: NcCfFile::open() -> could not
determine
> > > > > > the
> > > > > > valid
> > > > > > time, using 0." is gone from the log file, but I still had
that
> > > > > > "DEBUG 3:
> > > > > > Observation error for point verification is defined by a
table
> > > > > > lookup
> > > > > > for
> > > > > > each observation" in the log file, is that a problem?
Because
> > > > > > you
> > > > > > can
> > > > > > not
> > > > > > access Hera, so I copied everything to WCOSS and tried
again,
> > > > > > then
> > > > > > the
> > > > > > warning message is gone. Why is it different on WCOSS? My
files
> > > > > > on
> > > > > > WCOSS is
> > > > > > under
> > > > > >
> > > > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > >
> > > > > > 3. I used point2grid to convert ascII file to the *nc
files I
> > > > > > used
> > > > > > above,
> > > > > > and I used default configure files for "ascii2nc" and
> > > > > > "point2grid",
> > > > > > will
> > > > > > this be a reason for the "valid time" issue? The script
is
> > > > > > under :
> > > > > >
> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > >
> > > > > > Thank you.
> > > > > >
> > > > > >
> > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > >> MET recognizes the input NetCDF as the CF-complaint
NetCDF
> > > > > >> file,
> > > > > >> but
> > > > > >> it
> > > > > >> does not have the time variable.
> > > > > >>
> > > > > >> WARNING:
> > > > > >> WARNING: NcCfFile::open() -> could not determine the
valid
> > > > > >> time,
> > > > > >> using 0.
> > > > > >> WARNING:
> > > > > >>
> > > > > >> The input NetCDF has the time information at the variable
> > > > > >> attribute,
> > > > > >> "valid_time_ut", which is for the MET generated NetCDF
file.
> > > > > >>
> > > > > >> Three possible slutions:
> > > > > >>
> > > > > >> 1. Remove the global attribute "Conventions" at the input
> > > > > >> netcdf
> > > > > >>
> > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > >>
> > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into the
config
> > > > > >> file,
> > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > >>
> > > > > >> ens = {
> > > > > >> wind_thresh = [ NA ];
> > > > > >> field = [
> > > > > >> {
> > > > > >> name = "VAFTD";
> > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > >> level = [ "L0-18000" ];
> > > > > >> lead_time = "${LEAD_HR}";
> > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > >> ];
> > > > > >>
> > > > > >> }
> > > > > >> ];
> > > > > >> };
> > > > > >>
> > > > > >> ==>
> > > > > >>
> > > > > >> ens = {
> > > > > >> wind_thresh = [ NA ];
> > > > > >> file_type = NETCDF_MET;
> > > > > >> field = [
> > > > > >> {
> > > > > >> name = "VAFTD";
> > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > >> level = [ "L0-18000" ];
> > > > > >> lead_time = "${LEAD_HR}";
> > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > >> ];
> > > > > >>
> > > > > >> }
> > > > > >> ];
> > > > > >> };
> > > > > >>
> > > > > >> Cheers,
> > > > > >> Howard
> > > > > >>
> > > > > >>
> > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > >> > Thanks.
> > > > > >> >
> > > > > >> > The time information comes from "valid_time_ut"
attribute
> > > > > >> > for
> > > > > >> > MET
> > > > > >> > generated NETCDF. Please download the config files and
log
> > > > > >> > files,
> > > > > >> > too.
> > > > > >> >
> > > > > >> > Cheers,
> > > > > >> > Howard
> > > > > >> >
> > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > >> > > Hi Howard,
> > > > > >> > >
> > > > > >> > > I have access to hera but have not retrieved files
from
> > > > > >> > > there
> > > > > >> > > before.
> > > > > >> > > A normal scp doesn't seem to work. I asked Julie for
help,
> > > > > >> > > but
> > > > > >> > > in the
> > > > > >> > > meantime, I can paste the ncdump headers results for
that
> > > > > >> > > file:
> > > > > >> > >
> > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > >> > > dimensions:
> > > > > >> > > lon = 721 ;
> > > > > >> > > lat = 361 ;
> > > > > >> > > variables:
> > > > > >> > > float lon(lon) ;
> > > > > >> > > lon:standard_name = "longitude" ;
> > > > > >> > > lon:long_name = "longitude" ;
> > > > > >> > > lon:units = "degrees_east" ;
> > > > > >> > > lon:axis = "X" ;
> > > > > >> > > float lat(lat) ;
> > > > > >> > > lat:standard_name = "latitude" ;
> > > > > >> > > lat:long_name = "latitude" ;
> > > > > >> > > lat:units = "degrees_north" ;
> > > > > >> > > lat:axis = "Y" ;
> > > > > >> > > float ash(lat, lon) ;
> > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > >> > > ash:units = "NA" ;
> > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > >> > > ash:missing_value = -9999.f ;
> > > > > >> > > ash:name = "ash" ;
> > > > > >> > > ash:level = "*,*" ;
> > > > > >> > > ash:init_time = "20190622_010000" ;
> > > > > >> > > ash:init_time_ut = "1561165200" ;
> > > > > >> > > ash:valid_time = "20190622_010000" ;
> > > > > >> > > ash:valid_time_ut = "1561165200" ;
> > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > > > > >> > > ash_cnt:units = "NA" ;
> > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > >> > > ash_cnt:init_time = "20190622_010000"
;
> > > > > >> > > ash_cnt:init_time_ut = "1561165200" ;
> > > > > >> > > ash_cnt:valid_time =
"20190622_010000" ;
> > > > > >> > > ash_cnt:valid_time_ut = "1561165200"
;
> > > > > >> > > int ash_mask(lat, lon) ;
> > > > > >> > > ash_mask:long_name = "ash_mask(*,*)"
;
> > > > > >> > > ash_mask:units = "NA" ;
> > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > >> > > ash_mask:missing_value = -9999 ;
> > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > >> > > ash_mask:level = "*,*" ;
> > > > > >> > > ash_mask:init_time =
"20190622_010000" ;
> > > > > >> > > ash_mask:init_time_ut = "1561165200"
;
> > > > > >> > > ash_mask:valid_time =
"20190622_010000" ;
> > > > > >> > > ash_mask:valid_time_ut = "1561165200"
;
> > > > > >> > >
> > > > > >> > > // global attributes:
> > > > > >> > > :CDI = "Climate Data Interface
version
> > > > > >> > > 1.9.5
> > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > >> > > :history = "Mon Jun 29 22:06:09 2020:
cdo
> > > > > >> > > ensmean
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 010000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 011000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 012000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 013000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 014000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 015000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > >> > > 01.mean.nc" ;
> > > > > >> > > :FileOrigins = "File
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 010000.nc generated 20200629_194609 UTC on host hfe10
by
> > > > > >> > > the
> > > > > >> > > MET
> > > > > >> > > point2grid tool" ;
> > > > > >> > > :MET_version = "V9.0" ;
> > > > > >> > > :MET_tool = "point2grid" ;
> > > > > >> > > :RunCommand = "Point obs () to
Projection:
> > > > > >> > > Lat/Lon
> > > > > >> > > Nx:
> > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat:
0.250
> > > > > >> > > delta_lon:
> > > > > >> > > 0.250" ;
> > > > > >> > > :Projection = "LatLon" ;
> > > > > >> > > :lat_ll = "3.292000 degrees_north" ;
> > > > > >> > > :lon_ll = "63.250000 degrees_east" ;
> > > > > >> > > :delta_lat = "0.250000 degrees" ;
> > > > > >> > > :delta_lon = "0.250000 degrees" ;
> > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > >> > > :CDO = "Climate Data Operators
version
> > > > > >> > > 1.9.5
> > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Tue Jul 14 15:31:59 2020
Hello Howard,
I have more questions about the use of ascii2nc and point2grid : Can
we do
the conversion for one variable ONLY each time? There is ONLY one
column
for variables in the ASCII point observation format. But if I have
multiple
variables that need to be converted to one nc format from ascII file
(like
UGRD, VGRD, TMP etc), how to do that?
It seems "ascii2nc" can take multiple ascII inputs, but after getting
the
*nc file, but how to set the string for the "field" to use utility
"point2grid" then?
Here is my script:
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
Thank you.
Binyu
On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT <met_help at ucar.edu>
wrote:
> Missing "time" variable at the output of point2grid:
> The "Convensions" global attribute was not added by point2grid. It
might
> be added by cdo.
>
> I will hold the github issue
(https://github.com/NCAR/MET/issues/1407).
> There is other issue (https://github.com/NCAR/MET/issues/1396) which
> supports multitple -field arguments. MET allows different obs_time
per
> field. For example, the following command is allowed:
> ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
> pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> valid_time="20120409_120000";' -field 'name="RH"; level="*";
> valid_time="20120409_180000";' -v 1
>
> different valid time:
> - TMP: 20120409_120000
> - RH: 20120409_180000
>
> I need to check if this is acceptable.
>
> Cheers,
> Howard
>
>
> On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > Got it, thank you very much.
> > Binyu
> >
> > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > 19700101_000000 comes from the default unix time 0.
> > >
> > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > 19700101_000000
> > >
> > > If the time information is missing, MET assigns the default unix
time
> > > (0)
> > > which is 19700101_000000.
> > >
> > > Cheers,Howard
> > >
> > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > Thank you for correcting the config file to override NetCDF
file
> > > > type.
> > > >
> > > > The DEBUG 3 log message:
> > > > It is just an information. The observation error was defined
1) in
> > > > the
> > > > config file or 2) by a table lookup for each observation.
> > > >
> > > > Missing "time" variable at the output of point2grid:
> > > > The "Convensions" global attribute is added without adding
"time"
> > > > variable by point2grid. The github issue was created
> > > > (https://github.com/NCAR/MET/issues/1407).
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > > Hello,
> > > > >
> > > > > Back to point 2 in my previous email: I just found I also
got the
> > > > > same
> > > > > warning "Observation error for point verification is defined
by a
> > > > > table
> > > > > lookup for each observation" in the log file on WCOSS as
well. In
> > > > > my
> > > > > first
> > > > > test, I didn' have this warning because I didn't add "-v 3"
at
> > > > > the
> > > > > end
> > > > > of
> > > > > ensemble_stat command. So can I just ignore this warning?
Sorry
> > > > > for
> > > > > that.
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate <
> > > > > binyu.wang at noaa.gov> wrote:
> > > > >
> > > > > > Howard,
> > > > > >
> > > > > > Thank you for the immediate help. But there are three
things I
> > > > > > want
> > > > > > to
> > > > > > confirm:
> > > > > > 1. you can see in my original *nc file, valid_time_ut =
> > > > > > "1561165200",
> > > > > > but the time shown in the warning message in the log file
is
> > > > > > "19700101_000000", where is " 19700101_000000" coming
from?
> > > > > >
> > > > > > 2. Actually the *nc file is my observation (NOT ensemble
> > > > > > forecast),
> > > > > > so I
> > > > > > move the new line to obs. section in the config file, see
> > > > > > below;
> > > > > >
> > > > > > obs = {
> > > > > > wind_thresh = [ NA ];
> > > > > > field = [
> > > > > > {
> > > > > > name = "ash";
> > > > > > level = ["(*,*)"];
> > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > }
> > > > > > ];
> > > > > > };
> > > > > > ------>
> > > > > >
> > > > > > obs = {
> > > > > > wind_thresh = [ NA ];
> > > > > > file_type = NETCDF_MET;
> > > > > > field = [
> > > > > > {
> > > > > > name = "ash";
> > > > > > level = ["(*,*)"];
> > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > }
> > > > > > ];
> > > > > >
> > > > > > };
> > > > > >
> > > > > > After that, " WARNING: NcCfFile::open() -> could not
determine
> > > > > > the
> > > > > > valid
> > > > > > time, using 0." is gone from the log file, but I still had
that
> > > > > > "DEBUG 3:
> > > > > > Observation error for point verification is defined by a
table
> > > > > > lookup
> > > > > > for
> > > > > > each observation" in the log file, is that a problem?
Because
> > > > > > you
> > > > > > can
> > > > > > not
> > > > > > access Hera, so I copied everything to WCOSS and tried
again,
> > > > > > then
> > > > > > the
> > > > > > warning message is gone. Why is it different on WCOSS? My
files
> > > > > > on
> > > > > > WCOSS is
> > > > > > under
> > > > > >
> > > > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > >
> > > > > > 3. I used point2grid to convert ascII file to the *nc
files I
> > > > > > used
> > > > > > above,
> > > > > > and I used default configure files for "ascii2nc" and
> > > > > > "point2grid",
> > > > > > will
> > > > > > this be a reason for the "valid time" issue? The script
is
> > > > > > under :
> > > > > >
> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > >
> > > > > > Thank you.
> > > > > >
> > > > > >
> > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > >> MET recognizes the input NetCDF as the CF-complaint
NetCDF
> > > > > >> file,
> > > > > >> but
> > > > > >> it
> > > > > >> does not have the time variable.
> > > > > >>
> > > > > >> WARNING:
> > > > > >> WARNING: NcCfFile::open() -> could not determine the
valid
> > > > > >> time,
> > > > > >> using 0.
> > > > > >> WARNING:
> > > > > >>
> > > > > >> The input NetCDF has the time information at the variable
> > > > > >> attribute,
> > > > > >> "valid_time_ut", which is for the MET generated NetCDF
file.
> > > > > >>
> > > > > >> Three possible slutions:
> > > > > >>
> > > > > >> 1. Remove the global attribute "Conventions" at the input
> > > > > >> netcdf
> > > > > >>
> > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > >>
> > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into the
config
> > > > > >> file,
> > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > >>
> > > > > >> ens = {
> > > > > >> wind_thresh = [ NA ];
> > > > > >> field = [
> > > > > >> {
> > > > > >> name = "VAFTD";
> > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > >> level = [ "L0-18000" ];
> > > > > >> lead_time = "${LEAD_HR}";
> > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > >> ];
> > > > > >>
> > > > > >> }
> > > > > >> ];
> > > > > >> };
> > > > > >>
> > > > > >> ==>
> > > > > >>
> > > > > >> ens = {
> > > > > >> wind_thresh = [ NA ];
> > > > > >> file_type = NETCDF_MET;
> > > > > >> field = [
> > > > > >> {
> > > > > >> name = "VAFTD";
> > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > >> level = [ "L0-18000" ];
> > > > > >> lead_time = "${LEAD_HR}";
> > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > >> ];
> > > > > >>
> > > > > >> }
> > > > > >> ];
> > > > > >> };
> > > > > >>
> > > > > >> Cheers,
> > > > > >> Howard
> > > > > >>
> > > > > >>
> > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > >> > Thanks.
> > > > > >> >
> > > > > >> > The time information comes from "valid_time_ut"
attribute
> > > > > >> > for
> > > > > >> > MET
> > > > > >> > generated NETCDF. Please download the config files and
log
> > > > > >> > files,
> > > > > >> > too.
> > > > > >> >
> > > > > >> > Cheers,
> > > > > >> > Howard
> > > > > >> >
> > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > >> > > Hi Howard,
> > > > > >> > >
> > > > > >> > > I have access to hera but have not retrieved files
from
> > > > > >> > > there
> > > > > >> > > before.
> > > > > >> > > A normal scp doesn't seem to work. I asked Julie for
help,
> > > > > >> > > but
> > > > > >> > > in the
> > > > > >> > > meantime, I can paste the ncdump headers results for
that
> > > > > >> > > file:
> > > > > >> > >
> > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > >> > > dimensions:
> > > > > >> > > lon = 721 ;
> > > > > >> > > lat = 361 ;
> > > > > >> > > variables:
> > > > > >> > > float lon(lon) ;
> > > > > >> > > lon:standard_name = "longitude" ;
> > > > > >> > > lon:long_name = "longitude" ;
> > > > > >> > > lon:units = "degrees_east" ;
> > > > > >> > > lon:axis = "X" ;
> > > > > >> > > float lat(lat) ;
> > > > > >> > > lat:standard_name = "latitude" ;
> > > > > >> > > lat:long_name = "latitude" ;
> > > > > >> > > lat:units = "degrees_north" ;
> > > > > >> > > lat:axis = "Y" ;
> > > > > >> > > float ash(lat, lon) ;
> > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > >> > > ash:units = "NA" ;
> > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > >> > > ash:missing_value = -9999.f ;
> > > > > >> > > ash:name = "ash" ;
> > > > > >> > > ash:level = "*,*" ;
> > > > > >> > > ash:init_time = "20190622_010000" ;
> > > > > >> > > ash:init_time_ut = "1561165200" ;
> > > > > >> > > ash:valid_time = "20190622_010000" ;
> > > > > >> > > ash:valid_time_ut = "1561165200" ;
> > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > >> > > ash_cnt:long_name = "ash_cnt(*,*)" ;
> > > > > >> > > ash_cnt:units = "NA" ;
> > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > >> > > ash_cnt:init_time = "20190622_010000"
;
> > > > > >> > > ash_cnt:init_time_ut = "1561165200" ;
> > > > > >> > > ash_cnt:valid_time =
"20190622_010000" ;
> > > > > >> > > ash_cnt:valid_time_ut = "1561165200"
;
> > > > > >> > > int ash_mask(lat, lon) ;
> > > > > >> > > ash_mask:long_name = "ash_mask(*,*)"
;
> > > > > >> > > ash_mask:units = "NA" ;
> > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > >> > > ash_mask:missing_value = -9999 ;
> > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > >> > > ash_mask:level = "*,*" ;
> > > > > >> > > ash_mask:init_time =
"20190622_010000" ;
> > > > > >> > > ash_mask:init_time_ut = "1561165200"
;
> > > > > >> > > ash_mask:valid_time =
"20190622_010000" ;
> > > > > >> > > ash_mask:valid_time_ut = "1561165200"
;
> > > > > >> > >
> > > > > >> > > // global attributes:
> > > > > >> > > :CDI = "Climate Data Interface
version
> > > > > >> > > 1.9.5
> > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > >> > > :history = "Mon Jun 29 22:06:09 2020:
cdo
> > > > > >> > > ensmean
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 010000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 011000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 012000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 013000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 014000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 015000.nc
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > >> > > 01.mean.nc" ;
> > > > > >> > > :FileOrigins = "File
> > > > > >> > >
> > > > > >>
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > >> > > 010000.nc generated 20200629_194609 UTC on host hfe10
by
> > > > > >> > > the
> > > > > >> > > MET
> > > > > >> > > point2grid tool" ;
> > > > > >> > > :MET_version = "V9.0" ;
> > > > > >> > > :MET_tool = "point2grid" ;
> > > > > >> > > :RunCommand = "Point obs () to
Projection:
> > > > > >> > > Lat/Lon
> > > > > >> > > Nx:
> > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250 delta_lat:
0.250
> > > > > >> > > delta_lon:
> > > > > >> > > 0.250" ;
> > > > > >> > > :Projection = "LatLon" ;
> > > > > >> > > :lat_ll = "3.292000 degrees_north" ;
> > > > > >> > > :lon_ll = "63.250000 degrees_east" ;
> > > > > >> > > :delta_lat = "0.250000 degrees" ;
> > > > > >> > > :delta_lon = "0.250000 degrees" ;
> > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > >> > > :CDO = "Climate Data Operators
version
> > > > > >> > > 1.9.5
> > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Tue Jul 14 16:34:32 2020
The existing point2grid supports only one variable. The newer version
(MET 9.1 beta2 which was released today) supports multiple -field
arguments (https://github.com/NCAR/MET/issues/1396). The command
example to process multiple variables is
./point2grid ascii2nc_output.nc G212 my_output.nc -field 'name="TMP";
level="*";' -field 'name="UGRD"; level="*";' -field 'name="VGRD";
level="*";' -v 1
With older point2grid, alternative is running point2grid multiple
times and combining them by using third party tools, like nccopy. For
example,
./point2grid ascii2nc_output.nc G212 my_TMP_output.nc -field
'name="TMP"; level="*";' -v 1
./point2grid ascii2nc_output.nc G212 my_VGRD_output.nc -field
'name="UGRD"; level="*";' -v 1
./point2grid ascii2nc_output.nc G212 my_UGRD_output.nc -field
'name="VGRD"; level="*";' -v 1
cp my_TMP_output.nc my_output.nc
nccopy -v UGRD my_VGRD_output.nc my_output.nc
nccopy -v VGRD my_VGRD_output.nc my_output.nc
Cheers,
Howard
On Tue Jul 14 15:31:59 2020, binyu.wang at noaa.gov wrote:
> Hello Howard,
>
> I have more questions about the use of ascii2nc and point2grid :
Can
> we do
> the conversion for one variable ONLY each time? There is ONLY one
> column
> for variables in the ASCII point observation format. But if I have
> multiple
> variables that need to be converted to one nc format from ascII file
> (like
> UGRD, VGRD, TMP etc), how to do that?
>
> It seems "ascii2nc" can take multiple ascII inputs, but after
getting
> the
> *nc file, but how to set the string for the "field" to use utility
> "point2grid" then?
>
> Here is my script:
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
>
> Thank you.
> Binyu
>
> On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT <met_help at ucar.edu>
> wrote:
>
> > Missing "time" variable at the output of point2grid:
> > The "Convensions" global attribute was not added by point2grid. It
> > might
> > be added by cdo.
> >
> > I will hold the github issue
> > (https://github.com/NCAR/MET/issues/1407).
> > There is other issue (https://github.com/NCAR/MET/issues/1396)
which
> > supports multitple -field arguments. MET allows different obs_time
> > per
> > field. For example, the following command is allowed:
> > ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
> > pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> > valid_time="20120409_120000";' -field 'name="RH"; level="*";
> > valid_time="20120409_180000";' -v 1
> >
> > different valid time:
> > - TMP: 20120409_120000
> > - RH: 20120409_180000
> >
> > I need to check if this is acceptable.
> >
> > Cheers,
> > Howard
> >
> >
> > On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > > Got it, thank you very much.
> > > Binyu
> > >
> > > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > 19700101_000000 comes from the default unix time 0.
> > > >
> > > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > > 19700101_000000
> > > >
> > > > If the time information is missing, MET assigns the default
unix
> > > > time
> > > > (0)
> > > > which is 19700101_000000.
> > > >
> > > > Cheers,Howard
> > > >
> > > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > > Thank you for correcting the config file to override NetCDF
> > > > > file
> > > > > type.
> > > > >
> > > > > The DEBUG 3 log message:
> > > > > It is just an information. The observation error was defined
1)
> > > > > in
> > > > > the
> > > > > config file or 2) by a table lookup for each observation.
> > > > >
> > > > > Missing "time" variable at the output of point2grid:
> > > > > The "Convensions" global attribute is added without adding
> > > > > "time"
> > > > > variable by point2grid. The github issue was created
> > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > >
> > > > > Cheers,
> > > > > Howard
> > > > >
> > > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > > > Hello,
> > > > > >
> > > > > > Back to point 2 in my previous email: I just found I also
got
> > > > > > the
> > > > > > same
> > > > > > warning "Observation error for point verification is
defined
> > > > > > by a
> > > > > > table
> > > > > > lookup for each observation" in the log file on WCOSS as
> > > > > > well. In
> > > > > > my
> > > > > > first
> > > > > > test, I didn' have this warning because I didn't add "-v
3"
> > > > > > at
> > > > > > the
> > > > > > end
> > > > > > of
> > > > > > ensemble_stat command. So can I just ignore this warning?
> > > > > > Sorry
> > > > > > for
> > > > > > that.
> > > > > >
> > > > > > Binyu
> > > > > >
> > > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA Affiliate
<
> > > > > > binyu.wang at noaa.gov> wrote:
> > > > > >
> > > > > > > Howard,
> > > > > > >
> > > > > > > Thank you for the immediate help. But there are three
> > > > > > > things I
> > > > > > > want
> > > > > > > to
> > > > > > > confirm:
> > > > > > > 1. you can see in my original *nc file, valid_time_ut
=
> > > > > > > "1561165200",
> > > > > > > but the time shown in the warning message in the log
file
> > > > > > > is
> > > > > > > "19700101_000000", where is " 19700101_000000" coming
> > > > > > > from?
> > > > > > >
> > > > > > > 2. Actually the *nc file is my observation (NOT ensemble
> > > > > > > forecast),
> > > > > > > so I
> > > > > > > move the new line to obs. section in the config file,
see
> > > > > > > below;
> > > > > > >
> > > > > > > obs = {
> > > > > > > wind_thresh = [ NA ];
> > > > > > > field = [
> > > > > > > {
> > > > > > > name = "ash";
> > > > > > > level = ["(*,*)"];
> > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > }
> > > > > > > ];
> > > > > > > };
> > > > > > > ------>
> > > > > > >
> > > > > > > obs = {
> > > > > > > wind_thresh = [ NA ];
> > > > > > > file_type = NETCDF_MET;
> > > > > > > field = [
> > > > > > > {
> > > > > > > name = "ash";
> > > > > > > level = ["(*,*)"];
> > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > }
> > > > > > > ];
> > > > > > >
> > > > > > > };
> > > > > > >
> > > > > > > After that, " WARNING: NcCfFile::open() -> could not
> > > > > > > determine
> > > > > > > the
> > > > > > > valid
> > > > > > > time, using 0." is gone from the log file, but I still
had
> > > > > > > that
> > > > > > > "DEBUG 3:
> > > > > > > Observation error for point verification is defined by a
> > > > > > > table
> > > > > > > lookup
> > > > > > > for
> > > > > > > each observation" in the log file, is that a problem?
> > > > > > > Because
> > > > > > > you
> > > > > > > can
> > > > > > > not
> > > > > > > access Hera, so I copied everything to WCOSS and tried
> > > > > > > again,
> > > > > > > then
> > > > > > > the
> > > > > > > warning message is gone. Why is it different on WCOSS?
My
> > > > > > > files
> > > > > > > on
> > > > > > > WCOSS is
> > > > > > > under
> > > > > > >
> > > > > > >
> > > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > > >
> > > > > > > 3. I used point2grid to convert ascII file to the *nc
files
> > > > > > > I
> > > > > > > used
> > > > > > > above,
> > > > > > > and I used default configure files for "ascii2nc" and
> > > > > > > "point2grid",
> > > > > > > will
> > > > > > > this be a reason for the "valid time" issue? The script
is
> > > > > > > under :
> > > > > > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > > >
> > > > > > > Thank you.
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > >> MET recognizes the input NetCDF as the CF-complaint
NetCDF
> > > > > > >> file,
> > > > > > >> but
> > > > > > >> it
> > > > > > >> does not have the time variable.
> > > > > > >>
> > > > > > >> WARNING:
> > > > > > >> WARNING: NcCfFile::open() -> could not determine the
valid
> > > > > > >> time,
> > > > > > >> using 0.
> > > > > > >> WARNING:
> > > > > > >>
> > > > > > >> The input NetCDF has the time information at the
variable
> > > > > > >> attribute,
> > > > > > >> "valid_time_ut", which is for the MET generated NetCDF
> > > > > > >> file.
> > > > > > >>
> > > > > > >> Three possible slutions:
> > > > > > >>
> > > > > > >> 1. Remove the global attribute "Conventions" at the
input
> > > > > > >> netcdf
> > > > > > >>
> > > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > > >>
> > > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into the
> > > > > > >> config
> > > > > > >> file,
> > > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > > >>
> > > > > > >> ens = {
> > > > > > >> wind_thresh = [ NA ];
> > > > > > >> field = [
> > > > > > >> {
> > > > > > >> name = "VAFTD";
> > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > >> level = [ "L0-18000" ];
> > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > >> ];
> > > > > > >>
> > > > > > >> }
> > > > > > >> ];
> > > > > > >> };
> > > > > > >>
> > > > > > >> ==>
> > > > > > >>
> > > > > > >> ens = {
> > > > > > >> wind_thresh = [ NA ];
> > > > > > >> file_type = NETCDF_MET;
> > > > > > >> field = [
> > > > > > >> {
> > > > > > >> name = "VAFTD";
> > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > >> level = [ "L0-18000" ];
> > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > >> ];
> > > > > > >>
> > > > > > >> }
> > > > > > >> ];
> > > > > > >> };
> > > > > > >>
> > > > > > >> Cheers,
> > > > > > >> Howard
> > > > > > >>
> > > > > > >>
> > > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > > >> > Thanks.
> > > > > > >> >
> > > > > > >> > The time information comes from "valid_time_ut"
> > > > > > >> > attribute
> > > > > > >> > for
> > > > > > >> > MET
> > > > > > >> > generated NETCDF. Please download the config files
and
> > > > > > >> > log
> > > > > > >> > files,
> > > > > > >> > too.
> > > > > > >> >
> > > > > > >> > Cheers,
> > > > > > >> > Howard
> > > > > > >> >
> > > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > > >> > > Hi Howard,
> > > > > > >> > >
> > > > > > >> > > I have access to hera but have not retrieved files
> > > > > > >> > > from
> > > > > > >> > > there
> > > > > > >> > > before.
> > > > > > >> > > A normal scp doesn't seem to work. I asked Julie
for
> > > > > > >> > > help,
> > > > > > >> > > but
> > > > > > >> > > in the
> > > > > > >> > > meantime, I can paste the ncdump headers results
for
> > > > > > >> > > that
> > > > > > >> > > file:
> > > > > > >> > >
> > > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > > >> > > dimensions:
> > > > > > >> > > lon = 721 ;
> > > > > > >> > > lat = 361 ;
> > > > > > >> > > variables:
> > > > > > >> > > float lon(lon) ;
> > > > > > >> > > lon:standard_name = "longitude" ;
> > > > > > >> > > lon:long_name = "longitude" ;
> > > > > > >> > > lon:units = "degrees_east" ;
> > > > > > >> > > lon:axis = "X" ;
> > > > > > >> > > float lat(lat) ;
> > > > > > >> > > lat:standard_name = "latitude" ;
> > > > > > >> > > lat:long_name = "latitude" ;
> > > > > > >> > > lat:units = "degrees_north" ;
> > > > > > >> > > lat:axis = "Y" ;
> > > > > > >> > > float ash(lat, lon) ;
> > > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > > >> > > ash:units = "NA" ;
> > > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > > >> > > ash:missing_value = -9999.f ;
> > > > > > >> > > ash:name = "ash" ;
> > > > > > >> > > ash:level = "*,*" ;
> > > > > > >> > > ash:init_time = "20190622_010000" ;
> > > > > > >> > > ash:init_time_ut = "1561165200" ;
> > > > > > >> > > ash:valid_time = "20190622_010000"
;
> > > > > > >> > > ash:valid_time_ut = "1561165200" ;
> > > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > > >> > > ash_cnt:long_name = "ash_cnt(*,*)"
;
> > > > > > >> > > ash_cnt:units = "NA" ;
> > > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > > >> > > ash_cnt:init_time =
"20190622_010000"
> > > > > > >> > > ;
> > > > > > >> > > ash_cnt:init_time_ut = "1561165200"
;
> > > > > > >> > > ash_cnt:valid_time =
"20190622_010000"
> > > > > > >> > > ;
> > > > > > >> > > ash_cnt:valid_time_ut =
"1561165200" ;
> > > > > > >> > > int ash_mask(lat, lon) ;
> > > > > > >> > > ash_mask:long_name =
"ash_mask(*,*)" ;
> > > > > > >> > > ash_mask:units = "NA" ;
> > > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > > >> > > ash_mask:missing_value = -9999 ;
> > > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > > >> > > ash_mask:level = "*,*" ;
> > > > > > >> > > ash_mask:init_time =
"20190622_010000"
> > > > > > >> > > ;
> > > > > > >> > > ash_mask:init_time_ut =
"1561165200" ;
> > > > > > >> > > ash_mask:valid_time =
> > > > > > >> > > "20190622_010000" ;
> > > > > > >> > > ash_mask:valid_time_ut =
"1561165200"
> > > > > > >> > > ;
> > > > > > >> > >
> > > > > > >> > > // global attributes:
> > > > > > >> > > :CDI = "Climate Data Interface
version
> > > > > > >> > > 1.9.5
> > > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > > >> > > :history = "Mon Jun 29 22:06:09
2020:
> > > > > > >> > > cdo
> > > > > > >> > > ensmean
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 010000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 011000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 012000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 013000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 014000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 015000.nc
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > > >> > > 01.mean.nc" ;
> > > > > > >> > > :FileOrigins = "File
> > > > > > >> > >
> > > > > > >>
> > > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > >> > > 010000.nc generated 20200629_194609 UTC on host
hfe10
> > > > > > >> > > by
> > > > > > >> > > the
> > > > > > >> > > MET
> > > > > > >> > > point2grid tool" ;
> > > > > > >> > > :MET_version = "V9.0" ;
> > > > > > >> > > :MET_tool = "point2grid" ;
> > > > > > >> > > :RunCommand = "Point obs () to
> > > > > > >> > > Projection:
> > > > > > >> > > Lat/Lon
> > > > > > >> > > Nx:
> > > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250
delta_lat:
> > > > > > >> > > 0.250
> > > > > > >> > > delta_lon:
> > > > > > >> > > 0.250" ;
> > > > > > >> > > :Projection = "LatLon" ;
> > > > > > >> > > :lat_ll = "3.292000 degrees_north"
;
> > > > > > >> > > :lon_ll = "63.250000 degrees_east"
;
> > > > > > >> > > :delta_lat = "0.250000 degrees" ;
> > > > > > >> > > :delta_lon = "0.250000 degrees" ;
> > > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > > >> > > :CDO = "Climate Data Operators
version
> > > > > > >> > > 1.9.5
> > > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Mon Jul 20 13:37:37 2020
How about the asciinc? Can asciinc support multiple variables in the
new
version too? If so, what should be the format for the ascII file?
Thank you.
Binyu
On Tue, Jul 14, 2020 at 6:34 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> The existing point2grid supports only one variable. The newer
version (MET
> 9.1 beta2 which was released today) supports multiple -field
arguments (
> https://github.com/NCAR/MET/issues/1396). The command example to
process
> multiple variables is
>
> ./point2grid ascii2nc_output.nc G212 my_output.nc -field
'name="TMP";
> level="*";' -field 'name="UGRD"; level="*";' -field 'name="VGRD";
> level="*";' -v 1
>
> With older point2grid, alternative is running point2grid multiple
times
> and combining them by using third party tools, like nccopy. For
example,
>
> ./point2grid ascii2nc_output.nc G212 my_TMP_output.nc -field
> 'name="TMP"; level="*";' -v 1
> ./point2grid ascii2nc_output.nc G212 my_VGRD_output.nc -field
> 'name="UGRD"; level="*";' -v 1
> ./point2grid ascii2nc_output.nc G212 my_UGRD_output.nc -field
> 'name="VGRD"; level="*";' -v 1
>
> cp my_TMP_output.nc my_output.nc
> nccopy -v UGRD my_VGRD_output.nc my_output.nc
> nccopy -v VGRD my_VGRD_output.nc my_output.nc
>
> Cheers,
> Howard
>
> On Tue Jul 14 15:31:59 2020, binyu.wang at noaa.gov wrote:
> > Hello Howard,
> >
> > I have more questions about the use of ascii2nc and point2grid :
Can
> > we do
> > the conversion for one variable ONLY each time? There is ONLY
one
> > column
> > for variables in the ASCII point observation format. But if I have
> > multiple
> > variables that need to be converted to one nc format from ascII
file
> > (like
> > UGRD, VGRD, TMP etc), how to do that?
> >
> > It seems "ascii2nc" can take multiple ascII inputs, but after
getting
> > the
> > *nc file, but how to set the string for the "field" to use
utility
> > "point2grid" then?
> >
> > Here is my script:
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
> >
> > Thank you.
> > Binyu
> >
> > On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Missing "time" variable at the output of point2grid:
> > > The "Convensions" global attribute was not added by point2grid.
It
> > > might
> > > be added by cdo.
> > >
> > > I will hold the github issue
> > > (https://github.com/NCAR/MET/issues/1407).
> > > There is other issue (https://github.com/NCAR/MET/issues/1396)
which
> > > supports multitple -field arguments. MET allows different
obs_time
> > > per
> > > field. For example, the following command is allowed:
> > > ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
> > > pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> > > valid_time="20120409_120000";' -field 'name="RH"; level="*";
> > > valid_time="20120409_180000";' -v 1
> > >
> > > different valid time:
> > > - TMP: 20120409_120000
> > > - RH: 20120409_180000
> > >
> > > I need to check if this is acceptable.
> > >
> > > Cheers,
> > > Howard
> > >
> > >
> > > On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > > > Got it, thank you very much.
> > > > Binyu
> > > >
> > > > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > 19700101_000000 comes from the default unix time 0.
> > > > >
> > > > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > > > 19700101_000000
> > > > >
> > > > > If the time information is missing, MET assigns the default
unix
> > > > > time
> > > > > (0)
> > > > > which is 19700101_000000.
> > > > >
> > > > > Cheers,Howard
> > > > >
> > > > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > > > Thank you for correcting the config file to override
NetCDF
> > > > > > file
> > > > > > type.
> > > > > >
> > > > > > The DEBUG 3 log message:
> > > > > > It is just an information. The observation error was
defined 1)
> > > > > > in
> > > > > > the
> > > > > > config file or 2) by a table lookup for each observation.
> > > > > >
> > > > > > Missing "time" variable at the output of point2grid:
> > > > > > The "Convensions" global attribute is added without
adding
> > > > > > "time"
> > > > > > variable by point2grid. The github issue was created
> > > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > >
> > > > > > Cheers,
> > > > > > Howard
> > > > > >
> > > > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > > > > Hello,
> > > > > > >
> > > > > > > Back to point 2 in my previous email: I just found I
also got
> > > > > > > the
> > > > > > > same
> > > > > > > warning "Observation error for point verification is
defined
> > > > > > > by a
> > > > > > > table
> > > > > > > lookup for each observation" in the log file on WCOSS as
> > > > > > > well. In
> > > > > > > my
> > > > > > > first
> > > > > > > test, I didn' have this warning because I didn't add "-v
3"
> > > > > > > at
> > > > > > > the
> > > > > > > end
> > > > > > > of
> > > > > > > ensemble_stat command. So can I just ignore this
warning?
> > > > > > > Sorry
> > > > > > > for
> > > > > > > that.
> > > > > > >
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA
Affiliate <
> > > > > > > binyu.wang at noaa.gov> wrote:
> > > > > > >
> > > > > > > > Howard,
> > > > > > > >
> > > > > > > > Thank you for the immediate help. But there are three
> > > > > > > > things I
> > > > > > > > want
> > > > > > > > to
> > > > > > > > confirm:
> > > > > > > > 1. you can see in my original *nc file,
valid_time_ut =
> > > > > > > > "1561165200",
> > > > > > > > but the time shown in the warning message in the log
file
> > > > > > > > is
> > > > > > > > "19700101_000000", where is " 19700101_000000" coming
> > > > > > > > from?
> > > > > > > >
> > > > > > > > 2. Actually the *nc file is my observation (NOT
ensemble
> > > > > > > > forecast),
> > > > > > > > so I
> > > > > > > > move the new line to obs. section in the config file,
see
> > > > > > > > below;
> > > > > > > >
> > > > > > > > obs = {
> > > > > > > > wind_thresh = [ NA ];
> > > > > > > > field = [
> > > > > > > > {
> > > > > > > > name = "ash";
> > > > > > > > level = ["(*,*)"];
> > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > }
> > > > > > > > ];
> > > > > > > > };
> > > > > > > > ------>
> > > > > > > >
> > > > > > > > obs = {
> > > > > > > > wind_thresh = [ NA ];
> > > > > > > > file_type = NETCDF_MET;
> > > > > > > > field = [
> > > > > > > > {
> > > > > > > > name = "ash";
> > > > > > > > level = ["(*,*)"];
> > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > }
> > > > > > > > ];
> > > > > > > >
> > > > > > > > };
> > > > > > > >
> > > > > > > > After that, " WARNING: NcCfFile::open() -> could not
> > > > > > > > determine
> > > > > > > > the
> > > > > > > > valid
> > > > > > > > time, using 0." is gone from the log file, but I still
had
> > > > > > > > that
> > > > > > > > "DEBUG 3:
> > > > > > > > Observation error for point verification is defined by
a
> > > > > > > > table
> > > > > > > > lookup
> > > > > > > > for
> > > > > > > > each observation" in the log file, is that a problem?
> > > > > > > > Because
> > > > > > > > you
> > > > > > > > can
> > > > > > > > not
> > > > > > > > access Hera, so I copied everything to WCOSS and tried
> > > > > > > > again,
> > > > > > > > then
> > > > > > > > the
> > > > > > > > warning message is gone. Why is it different on WCOSS?
My
> > > > > > > > files
> > > > > > > > on
> > > > > > > > WCOSS is
> > > > > > > > under
> > > > > > > >
> > > > > > > >
> > > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > > > >
> > > > > > > > 3. I used point2grid to convert ascII file to the *nc
files
> > > > > > > > I
> > > > > > > > used
> > > > > > > > above,
> > > > > > > > and I used default configure files for "ascii2nc" and
> > > > > > > > "point2grid",
> > > > > > > > will
> > > > > > > > this be a reason for the "valid time" issue? The
script is
> > > > > > > > under :
> > > > > > > >
> > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > > > >
> > > > > > > > Thank you.
> > > > > > > >
> > > > > > > >
> > > > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > >> MET recognizes the input NetCDF as the CF-complaint
NetCDF
> > > > > > > >> file,
> > > > > > > >> but
> > > > > > > >> it
> > > > > > > >> does not have the time variable.
> > > > > > > >>
> > > > > > > >> WARNING:
> > > > > > > >> WARNING: NcCfFile::open() -> could not determine the
valid
> > > > > > > >> time,
> > > > > > > >> using 0.
> > > > > > > >> WARNING:
> > > > > > > >>
> > > > > > > >> The input NetCDF has the time information at the
variable
> > > > > > > >> attribute,
> > > > > > > >> "valid_time_ut", which is for the MET generated
NetCDF
> > > > > > > >> file.
> > > > > > > >>
> > > > > > > >> Three possible slutions:
> > > > > > > >>
> > > > > > > >> 1. Remove the global attribute "Conventions" at the
input
> > > > > > > >> netcdf
> > > > > > > >>
> > > > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > > > >>
> > > > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into the
> > > > > > > >> config
> > > > > > > >> file,
> > > > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > > > >>
> > > > > > > >> ens = {
> > > > > > > >> wind_thresh = [ NA ];
> > > > > > > >> field = [
> > > > > > > >> {
> > > > > > > >> name = "VAFTD";
> > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > >> level = [ "L0-18000" ];
> > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > >> ];
> > > > > > > >>
> > > > > > > >> }
> > > > > > > >> ];
> > > > > > > >> };
> > > > > > > >>
> > > > > > > >> ==>
> > > > > > > >>
> > > > > > > >> ens = {
> > > > > > > >> wind_thresh = [ NA ];
> > > > > > > >> file_type = NETCDF_MET;
> > > > > > > >> field = [
> > > > > > > >> {
> > > > > > > >> name = "VAFTD";
> > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > >> level = [ "L0-18000" ];
> > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > >> ];
> > > > > > > >>
> > > > > > > >> }
> > > > > > > >> ];
> > > > > > > >> };
> > > > > > > >>
> > > > > > > >> Cheers,
> > > > > > > >> Howard
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > > > >> > Thanks.
> > > > > > > >> >
> > > > > > > >> > The time information comes from "valid_time_ut"
> > > > > > > >> > attribute
> > > > > > > >> > for
> > > > > > > >> > MET
> > > > > > > >> > generated NETCDF. Please download the config files
and
> > > > > > > >> > log
> > > > > > > >> > files,
> > > > > > > >> > too.
> > > > > > > >> >
> > > > > > > >> > Cheers,
> > > > > > > >> > Howard
> > > > > > > >> >
> > > > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > > > >> > > Hi Howard,
> > > > > > > >> > >
> > > > > > > >> > > I have access to hera but have not retrieved
files
> > > > > > > >> > > from
> > > > > > > >> > > there
> > > > > > > >> > > before.
> > > > > > > >> > > A normal scp doesn't seem to work. I asked Julie
for
> > > > > > > >> > > help,
> > > > > > > >> > > but
> > > > > > > >> > > in the
> > > > > > > >> > > meantime, I can paste the ncdump headers results
for
> > > > > > > >> > > that
> > > > > > > >> > > file:
> > > > > > > >> > >
> > > > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > > > >> > > dimensions:
> > > > > > > >> > > lon = 721 ;
> > > > > > > >> > > lat = 361 ;
> > > > > > > >> > > variables:
> > > > > > > >> > > float lon(lon) ;
> > > > > > > >> > > lon:standard_name = "longitude" ;
> > > > > > > >> > > lon:long_name = "longitude" ;
> > > > > > > >> > > lon:units = "degrees_east" ;
> > > > > > > >> > > lon:axis = "X" ;
> > > > > > > >> > > float lat(lat) ;
> > > > > > > >> > > lat:standard_name = "latitude" ;
> > > > > > > >> > > lat:long_name = "latitude" ;
> > > > > > > >> > > lat:units = "degrees_north" ;
> > > > > > > >> > > lat:axis = "Y" ;
> > > > > > > >> > > float ash(lat, lon) ;
> > > > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > > > >> > > ash:units = "NA" ;
> > > > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > > > >> > > ash:missing_value = -9999.f ;
> > > > > > > >> > > ash:name = "ash" ;
> > > > > > > >> > > ash:level = "*,*" ;
> > > > > > > >> > > ash:init_time = "20190622_010000"
;
> > > > > > > >> > > ash:init_time_ut = "1561165200" ;
> > > > > > > >> > > ash:valid_time =
"20190622_010000" ;
> > > > > > > >> > > ash:valid_time_ut = "1561165200"
;
> > > > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > > > >> > > ash_cnt:long_name =
"ash_cnt(*,*)" ;
> > > > > > > >> > > ash_cnt:units = "NA" ;
> > > > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > > > >> > > ash_cnt:init_time =
"20190622_010000"
> > > > > > > >> > > ;
> > > > > > > >> > > ash_cnt:init_time_ut =
"1561165200" ;
> > > > > > > >> > > ash_cnt:valid_time =
"20190622_010000"
> > > > > > > >> > > ;
> > > > > > > >> > > ash_cnt:valid_time_ut =
"1561165200" ;
> > > > > > > >> > > int ash_mask(lat, lon) ;
> > > > > > > >> > > ash_mask:long_name =
"ash_mask(*,*)" ;
> > > > > > > >> > > ash_mask:units = "NA" ;
> > > > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > > > >> > > ash_mask:missing_value = -9999 ;
> > > > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > > > >> > > ash_mask:level = "*,*" ;
> > > > > > > >> > > ash_mask:init_time =
"20190622_010000"
> > > > > > > >> > > ;
> > > > > > > >> > > ash_mask:init_time_ut =
"1561165200" ;
> > > > > > > >> > > ash_mask:valid_time =
> > > > > > > >> > > "20190622_010000" ;
> > > > > > > >> > > ash_mask:valid_time_ut =
"1561165200"
> > > > > > > >> > > ;
> > > > > > > >> > >
> > > > > > > >> > > // global attributes:
> > > > > > > >> > > :CDI = "Climate Data Interface
version
> > > > > > > >> > > 1.9.5
> > > > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > > > >> > > :history = "Mon Jun 29 22:06:09
2020:
> > > > > > > >> > > cdo
> > > > > > > >> > > ensmean
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 010000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 011000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 012000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 013000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 014000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 015000.nc
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 01.mean.nc" ;
> > > > > > > >> > > :FileOrigins = "File
> > > > > > > >> > >
> > > > > > > >>
> > > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > >> > > 010000.nc generated 20200629_194609 UTC on host
hfe10
> > > > > > > >> > > by
> > > > > > > >> > > the
> > > > > > > >> > > MET
> > > > > > > >> > > point2grid tool" ;
> > > > > > > >> > > :MET_version = "V9.0" ;
> > > > > > > >> > > :MET_tool = "point2grid" ;
> > > > > > > >> > > :RunCommand = "Point obs () to
> > > > > > > >> > > Projection:
> > > > > > > >> > > Lat/Lon
> > > > > > > >> > > Nx:
> > > > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250
delta_lat:
> > > > > > > >> > > 0.250
> > > > > > > >> > > delta_lon:
> > > > > > > >> > > 0.250" ;
> > > > > > > >> > > :Projection = "LatLon" ;
> > > > > > > >> > > :lat_ll = "3.292000
degrees_north" ;
> > > > > > > >> > > :lon_ll = "63.250000
degrees_east" ;
> > > > > > > >> > > :delta_lat = "0.250000 degrees" ;
> > > > > > > >> > > :delta_lon = "0.250000 degrees" ;
> > > > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > > > >> > > :CDO = "Climate Data Operators
version
> > > > > > > >> > > 1.9.5
> > > > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: valid time
From: John Halley Gotway
Time: Mon Jul 20 13:58:25 2020
The ascii2nc tool has always been able to process multiple observation
types in each run. ascii2nc supports multiple flavors of input ascii
files,
as described in section 4.2 of the MET user's guide:
https://dtcenter.org/sites/default/files/community-code/met/docs/user-
guide/MET_Users_Guide_v9.0.3.pdf
One of the supported formats is a simple 11-column table of data as
listed
in the ascii2nc usage statement and described in table 4.4 on page
150.
Thanks,
John
On Mon, Jul 20, 2020 at 1:37 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95824 >
>
> How about the asciinc? Can asciinc support multiple variables in
the new
> version too? If so, what should be the format for the ascII file?
Thank
> you.
>
> Binyu
>
> On Tue, Jul 14, 2020 at 6:34 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
> > The existing point2grid supports only one variable. The newer
version
> (MET
> > 9.1 beta2 which was released today) supports multiple -field
arguments (
> > https://github.com/NCAR/MET/issues/1396). The command example to
process
> > multiple variables is
> >
> > ./point2grid ascii2nc_output.nc G212 my_output.nc -field
'name="TMP";
> > level="*";' -field 'name="UGRD"; level="*";' -field 'name="VGRD";
> > level="*";' -v 1
> >
> > With older point2grid, alternative is running point2grid multiple
times
> > and combining them by using third party tools, like nccopy. For
example,
> >
> > ./point2grid ascii2nc_output.nc G212 my_TMP_output.nc -field
> > 'name="TMP"; level="*";' -v 1
> > ./point2grid ascii2nc_output.nc G212 my_VGRD_output.nc -field
> > 'name="UGRD"; level="*";' -v 1
> > ./point2grid ascii2nc_output.nc G212 my_UGRD_output.nc -field
> > 'name="VGRD"; level="*";' -v 1
> >
> > cp my_TMP_output.nc my_output.nc
> > nccopy -v UGRD my_VGRD_output.nc my_output.nc
> > nccopy -v VGRD my_VGRD_output.nc my_output.nc
> >
> > Cheers,
> > Howard
> >
> > On Tue Jul 14 15:31:59 2020, binyu.wang at noaa.gov wrote:
> > > Hello Howard,
> > >
> > > I have more questions about the use of ascii2nc and point2grid :
Can
> > > we do
> > > the conversion for one variable ONLY each time? There is ONLY
one
> > > column
> > > for variables in the ASCII point observation format. But if I
have
> > > multiple
> > > variables that need to be converted to one nc format from ascII
file
> > > (like
> > > UGRD, VGRD, TMP etc), how to do that?
> > >
> > > It seems "ascii2nc" can take multiple ascII inputs, but after
getting
> > > the
> > > *nc file, but how to set the string for the "field" to use
utility
> > > "point2grid" then?
> > >
> > > Here is my script:
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
> > >
> > > Thank you.
> > > Binyu
> > >
> > > On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > Missing "time" variable at the output of point2grid:
> > > > The "Convensions" global attribute was not added by
point2grid. It
> > > > might
> > > > be added by cdo.
> > > >
> > > > I will hold the github issue
> > > > (https://github.com/NCAR/MET/issues/1407).
> > > > There is other issue (https://github.com/NCAR/MET/issues/1396)
which
> > > > supports multitple -field arguments. MET allows different
obs_time
> > > > per
> > > > field. For example, the following command is allowed:
> > > > ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc G212
> > > > pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> > > > valid_time="20120409_120000";' -field 'name="RH"; level="*";
> > > > valid_time="20120409_180000";' -v 1
> > > >
> > > > different valid time:
> > > > - TMP: 20120409_120000
> > > > - RH: 20120409_180000
> > > >
> > > > I need to check if this is acceptable.
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > >
> > > > On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > > > > Got it, thank you very much.
> > > > > Binyu
> > > > >
> > > > > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > 19700101_000000 comes from the default unix time 0.
> > > > > >
> > > > > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > > > > 19700101_000000
> > > > > >
> > > > > > If the time information is missing, MET assigns the
default unix
> > > > > > time
> > > > > > (0)
> > > > > > which is 19700101_000000.
> > > > > >
> > > > > > Cheers,Howard
> > > > > >
> > > > > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > > > > Thank you for correcting the config file to override
NetCDF
> > > > > > > file
> > > > > > > type.
> > > > > > >
> > > > > > > The DEBUG 3 log message:
> > > > > > > It is just an information. The observation error was
defined 1)
> > > > > > > in
> > > > > > > the
> > > > > > > config file or 2) by a table lookup for each
observation.
> > > > > > >
> > > > > > > Missing "time" variable at the output of point2grid:
> > > > > > > The "Convensions" global attribute is added without
adding
> > > > > > > "time"
> > > > > > > variable by point2grid. The github issue was created
> > > > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > > >
> > > > > > > Cheers,
> > > > > > > Howard
> > > > > > >
> > > > > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > Back to point 2 in my previous email: I just found I
also got
> > > > > > > > the
> > > > > > > > same
> > > > > > > > warning "Observation error for point verification is
defined
> > > > > > > > by a
> > > > > > > > table
> > > > > > > > lookup for each observation" in the log file on WCOSS
as
> > > > > > > > well. In
> > > > > > > > my
> > > > > > > > first
> > > > > > > > test, I didn' have this warning because I didn't add
"-v 3"
> > > > > > > > at
> > > > > > > > the
> > > > > > > > end
> > > > > > > > of
> > > > > > > > ensemble_stat command. So can I just ignore this
warning?
> > > > > > > > Sorry
> > > > > > > > for
> > > > > > > > that.
> > > > > > > >
> > > > > > > > Binyu
> > > > > > > >
> > > > > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA
Affiliate <
> > > > > > > > binyu.wang at noaa.gov> wrote:
> > > > > > > >
> > > > > > > > > Howard,
> > > > > > > > >
> > > > > > > > > Thank you for the immediate help. But there are
three
> > > > > > > > > things I
> > > > > > > > > want
> > > > > > > > > to
> > > > > > > > > confirm:
> > > > > > > > > 1. you can see in my original *nc file,
valid_time_ut =
> > > > > > > > > "1561165200",
> > > > > > > > > but the time shown in the warning message in the
log file
> > > > > > > > > is
> > > > > > > > > "19700101_000000", where is " 19700101_000000"
coming
> > > > > > > > > from?
> > > > > > > > >
> > > > > > > > > 2. Actually the *nc file is my observation (NOT
ensemble
> > > > > > > > > forecast),
> > > > > > > > > so I
> > > > > > > > > move the new line to obs. section in the config
file, see
> > > > > > > > > below;
> > > > > > > > >
> > > > > > > > > obs = {
> > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > field = [
> > > > > > > > > {
> > > > > > > > > name = "ash";
> > > > > > > > > level = ["(*,*)"];
> > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > }
> > > > > > > > > ];
> > > > > > > > > };
> > > > > > > > > ------>
> > > > > > > > >
> > > > > > > > > obs = {
> > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > file_type = NETCDF_MET;
> > > > > > > > > field = [
> > > > > > > > > {
> > > > > > > > > name = "ash";
> > > > > > > > > level = ["(*,*)"];
> > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > }
> > > > > > > > > ];
> > > > > > > > >
> > > > > > > > > };
> > > > > > > > >
> > > > > > > > > After that, " WARNING: NcCfFile::open() -> could
not
> > > > > > > > > determine
> > > > > > > > > the
> > > > > > > > > valid
> > > > > > > > > time, using 0." is gone from the log file, but I
still had
> > > > > > > > > that
> > > > > > > > > "DEBUG 3:
> > > > > > > > > Observation error for point verification is defined
by a
> > > > > > > > > table
> > > > > > > > > lookup
> > > > > > > > > for
> > > > > > > > > each observation" in the log file, is that a
problem?
> > > > > > > > > Because
> > > > > > > > > you
> > > > > > > > > can
> > > > > > > > > not
> > > > > > > > > access Hera, so I copied everything to WCOSS and
tried
> > > > > > > > > again,
> > > > > > > > > then
> > > > > > > > > the
> > > > > > > > > warning message is gone. Why is it different on
WCOSS? My
> > > > > > > > > files
> > > > > > > > > on
> > > > > > > > > WCOSS is
> > > > > > > > > under
> > > > > > > > >
> > > > > > > > >
> > > > > >
> > > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > > > > >
> > > > > > > > > 3. I used point2grid to convert ascII file to the
*nc files
> > > > > > > > > I
> > > > > > > > > used
> > > > > > > > > above,
> > > > > > > > > and I used default configure files for "ascii2nc"
and
> > > > > > > > > "point2grid",
> > > > > > > > > will
> > > > > > > > > this be a reason for the "valid time" issue? The
script is
> > > > > > > > > under :
> > > > > > > > >
> > > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > > > > >
> > > > > > > > > Thank you.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >> MET recognizes the input NetCDF as the CF-complaint
NetCDF
> > > > > > > > >> file,
> > > > > > > > >> but
> > > > > > > > >> it
> > > > > > > > >> does not have the time variable.
> > > > > > > > >>
> > > > > > > > >> WARNING:
> > > > > > > > >> WARNING: NcCfFile::open() -> could not determine
the valid
> > > > > > > > >> time,
> > > > > > > > >> using 0.
> > > > > > > > >> WARNING:
> > > > > > > > >>
> > > > > > > > >> The input NetCDF has the time information at the
variable
> > > > > > > > >> attribute,
> > > > > > > > >> "valid_time_ut", which is for the MET generated
NetCDF
> > > > > > > > >> file.
> > > > > > > > >>
> > > > > > > > >> Three possible slutions:
> > > > > > > > >>
> > > > > > > > >> 1. Remove the global attribute "Conventions" at the
input
> > > > > > > > >> netcdf
> > > > > > > > >>
> > > > > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > > > > >>
> > > > > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into
the
> > > > > > > > >> config
> > > > > > > > >> file,
> > > > > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > > > > >>
> > > > > > > > >> ens = {
> > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > >> field = [
> > > > > > > > >> {
> > > > > > > > >> name = "VAFTD";
> > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > >> ];
> > > > > > > > >>
> > > > > > > > >> }
> > > > > > > > >> ];
> > > > > > > > >> };
> > > > > > > > >>
> > > > > > > > >> ==>
> > > > > > > > >>
> > > > > > > > >> ens = {
> > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > >> file_type = NETCDF_MET;
> > > > > > > > >> field = [
> > > > > > > > >> {
> > > > > > > > >> name = "VAFTD";
> > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > >> ];
> > > > > > > > >>
> > > > > > > > >> }
> > > > > > > > >> ];
> > > > > > > > >> };
> > > > > > > > >>
> > > > > > > > >> Cheers,
> > > > > > > > >> Howard
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > > > > >> > Thanks.
> > > > > > > > >> >
> > > > > > > > >> > The time information comes from "valid_time_ut"
> > > > > > > > >> > attribute
> > > > > > > > >> > for
> > > > > > > > >> > MET
> > > > > > > > >> > generated NETCDF. Please download the config
files and
> > > > > > > > >> > log
> > > > > > > > >> > files,
> > > > > > > > >> > too.
> > > > > > > > >> >
> > > > > > > > >> > Cheers,
> > > > > > > > >> > Howard
> > > > > > > > >> >
> > > > > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > > > > >> > > Hi Howard,
> > > > > > > > >> > >
> > > > > > > > >> > > I have access to hera but have not retrieved
files
> > > > > > > > >> > > from
> > > > > > > > >> > > there
> > > > > > > > >> > > before.
> > > > > > > > >> > > A normal scp doesn't seem to work. I asked
Julie for
> > > > > > > > >> > > help,
> > > > > > > > >> > > but
> > > > > > > > >> > > in the
> > > > > > > > >> > > meantime, I can paste the ncdump headers
results for
> > > > > > > > >> > > that
> > > > > > > > >> > > file:
> > > > > > > > >> > >
> > > > > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > > > > >> > > dimensions:
> > > > > > > > >> > > lon = 721 ;
> > > > > > > > >> > > lat = 361 ;
> > > > > > > > >> > > variables:
> > > > > > > > >> > > float lon(lon) ;
> > > > > > > > >> > > lon:standard_name = "longitude"
;
> > > > > > > > >> > > lon:long_name = "longitude" ;
> > > > > > > > >> > > lon:units = "degrees_east" ;
> > > > > > > > >> > > lon:axis = "X" ;
> > > > > > > > >> > > float lat(lat) ;
> > > > > > > > >> > > lat:standard_name = "latitude"
;
> > > > > > > > >> > > lat:long_name = "latitude" ;
> > > > > > > > >> > > lat:units = "degrees_north" ;
> > > > > > > > >> > > lat:axis = "Y" ;
> > > > > > > > >> > > float ash(lat, lon) ;
> > > > > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > > > > >> > > ash:units = "NA" ;
> > > > > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > > > > >> > > ash:missing_value = -9999.f ;
> > > > > > > > >> > > ash:name = "ash" ;
> > > > > > > > >> > > ash:level = "*,*" ;
> > > > > > > > >> > > ash:init_time =
"20190622_010000" ;
> > > > > > > > >> > > ash:init_time_ut = "1561165200"
;
> > > > > > > > >> > > ash:valid_time =
"20190622_010000" ;
> > > > > > > > >> > > ash:valid_time_ut =
"1561165200" ;
> > > > > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > > > > >> > > ash_cnt:long_name =
"ash_cnt(*,*)" ;
> > > > > > > > >> > > ash_cnt:units = "NA" ;
> > > > > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > > > > >> > > ash_cnt:missing_value = -9999 ;
> > > > > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > > > > >> > > ash_cnt:init_time =
"20190622_010000"
> > > > > > > > >> > > ;
> > > > > > > > >> > > ash_cnt:init_time_ut =
"1561165200" ;
> > > > > > > > >> > > ash_cnt:valid_time =
"20190622_010000"
> > > > > > > > >> > > ;
> > > > > > > > >> > > ash_cnt:valid_time_ut =
"1561165200" ;
> > > > > > > > >> > > int ash_mask(lat, lon) ;
> > > > > > > > >> > > ash_mask:long_name =
"ash_mask(*,*)" ;
> > > > > > > > >> > > ash_mask:units = "NA" ;
> > > > > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > > > > >> > > ash_mask:missing_value = -9999
;
> > > > > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > > > > >> > > ash_mask:level = "*,*" ;
> > > > > > > > >> > > ash_mask:init_time =
"20190622_010000"
> > > > > > > > >> > > ;
> > > > > > > > >> > > ash_mask:init_time_ut =
"1561165200" ;
> > > > > > > > >> > > ash_mask:valid_time =
> > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > >> > > ash_mask:valid_time_ut =
"1561165200"
> > > > > > > > >> > > ;
> > > > > > > > >> > >
> > > > > > > > >> > > // global attributes:
> > > > > > > > >> > > :CDI = "Climate Data Interface
version
> > > > > > > > >> > > 1.9.5
> > > > > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > > > > >> > > :history = "Mon Jun 29 22:06:09
2020:
> > > > > > > > >> > > cdo
> > > > > > > > >> > > ensmean
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 010000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 011000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 012000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 013000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 014000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 015000.nc
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 01.mean.nc" ;
> > > > > > > > >> > > :FileOrigins = "File
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > >
> > > >
> >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > >> > > 010000.nc generated 20200629_194609 UTC on host
hfe10
> > > > > > > > >> > > by
> > > > > > > > >> > > the
> > > > > > > > >> > > MET
> > > > > > > > >> > > point2grid tool" ;
> > > > > > > > >> > > :MET_version = "V9.0" ;
> > > > > > > > >> > > :MET_tool = "point2grid" ;
> > > > > > > > >> > > :RunCommand = "Point obs () to
> > > > > > > > >> > > Projection:
> > > > > > > > >> > > Lat/Lon
> > > > > > > > >> > > Nx:
> > > > > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250
delta_lat:
> > > > > > > > >> > > 0.250
> > > > > > > > >> > > delta_lon:
> > > > > > > > >> > > 0.250" ;
> > > > > > > > >> > > :Projection = "LatLon" ;
> > > > > > > > >> > > :lat_ll = "3.292000
degrees_north" ;
> > > > > > > > >> > > :lon_ll = "63.250000
degrees_east" ;
> > > > > > > > >> > > :delta_lat = "0.250000 degrees"
;
> > > > > > > > >> > > :delta_lon = "0.250000 degrees"
;
> > > > > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > > > > >> > > :CDO = "Climate Data Operators
version
> > > > > > > > >> > > 1.9.5
> > > > > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
>
>
------------------------------------------------
Subject: valid time
From: Howard Soh
Time: Tue Oct 13 10:33:30 2020
The MET 9.1 supports the multiple fields with point2grid.
If you don't have other issue, I would like to close this ticket.
Cheers,
Howard
On Mon Jul 20 13:58:25 2020, johnhg wrote:
> The ascii2nc tool has always been able to process multiple
observation
> types in each run. ascii2nc supports multiple flavors of input ascii
> files,
> as described in section 4.2 of the MET user's guide:
> https://dtcenter.org/sites/default/files/community-
code/met/docs/user-
> guide/MET_Users_Guide_v9.0.3.pdf
>
> One of the supported formats is a simple 11-column table of data as
> listed
> in the ascii2nc usage statement and described in table 4.4 on page
> 150.
>
> Thanks,
> John
>
> On Mon, Jul 20, 2020 at 1:37 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95824 >
> >
> > How about the asciinc? Can asciinc support multiple variables in
the
> > new
> > version too? If so, what should be the format for the ascII file?
> > Thank
> > you.
> >
> > Binyu
> >
> > On Tue, Jul 14, 2020 at 6:34 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > The existing point2grid supports only one variable. The newer
> > > version
> > (MET
> > > 9.1 beta2 which was released today) supports multiple -field
> > > arguments (
> > > https://github.com/NCAR/MET/issues/1396). The command example to
> > > process
> > > multiple variables is
> > >
> > > ./point2grid ascii2nc_output.nc G212 my_output.nc -field
> > > 'name="TMP";
> > > level="*";' -field 'name="UGRD"; level="*";' -field
'name="VGRD";
> > > level="*";' -v 1
> > >
> > > With older point2grid, alternative is running point2grid
multiple
> > > times
> > > and combining them by using third party tools, like nccopy. For
> > > example,
> > >
> > > ./point2grid ascii2nc_output.nc G212 my_TMP_output.nc -field
> > > 'name="TMP"; level="*";' -v 1
> > > ./point2grid ascii2nc_output.nc G212 my_VGRD_output.nc -field
> > > 'name="UGRD"; level="*";' -v 1
> > > ./point2grid ascii2nc_output.nc G212 my_UGRD_output.nc -field
> > > 'name="VGRD"; level="*";' -v 1
> > >
> > > cp my_TMP_output.nc my_output.nc
> > > nccopy -v UGRD my_VGRD_output.nc my_output.nc
> > > nccopy -v VGRD my_VGRD_output.nc my_output.nc
> > >
> > > Cheers,
> > > Howard
> > >
> > > On Tue Jul 14 15:31:59 2020, binyu.wang at noaa.gov wrote:
> > > > Hello Howard,
> > > >
> > > > I have more questions about the use of ascii2nc and point2grid
:
> > > > Can
> > > > we do
> > > > the conversion for one variable ONLY each time? There is
ONLY
> > > > one
> > > > column
> > > > for variables in the ASCII point observation format. But if I
> > > > have
> > > > multiple
> > > > variables that need to be converted to one nc format from
ascII
> > > > file
> > > > (like
> > > > UGRD, VGRD, TMP etc), how to do that?
> > > >
> > > > It seems "ascii2nc" can take multiple ascII inputs, but after
> > > > getting
> > > > the
> > > > *nc file, but how to set the string for the "field" to use
> > > > utility
> > > > "point2grid" then?
> > > >
> > > > Here is my script:
> > > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
> > > >
> > > > Thank you.
> > > > Binyu
> > > >
> > > > On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Missing "time" variable at the output of point2grid:
> > > > > The "Convensions" global attribute was not added by
point2grid.
> > > > > It
> > > > > might
> > > > > be added by cdo.
> > > > >
> > > > > I will hold the github issue
> > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > There is other issue
(https://github.com/NCAR/MET/issues/1396)
> > > > > which
> > > > > supports multitple -field arguments. MET allows different
> > > > > obs_time
> > > > > per
> > > > > field. For example, the following command is allowed:
> > > > > ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc
G212
> > > > > pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> > > > > valid_time="20120409_120000";' -field 'name="RH"; level="*";
> > > > > valid_time="20120409_180000";' -v 1
> > > > >
> > > > > different valid time:
> > > > > - TMP: 20120409_120000
> > > > > - RH: 20120409_180000
> > > > >
> > > > > I need to check if this is acceptable.
> > > > >
> > > > > Cheers,
> > > > > Howard
> > > > >
> > > > >
> > > > > On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > > > > > Got it, thank you very much.
> > > > > > Binyu
> > > > > >
> > > > > > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > 19700101_000000 comes from the default unix time 0.
> > > > > > >
> > > > > > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > > > > > 19700101_000000
> > > > > > >
> > > > > > > If the time information is missing, MET assigns the
default
> > > > > > > unix
> > > > > > > time
> > > > > > > (0)
> > > > > > > which is 19700101_000000.
> > > > > > >
> > > > > > > Cheers,Howard
> > > > > > >
> > > > > > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > > > > > Thank you for correcting the config file to override
> > > > > > > > NetCDF
> > > > > > > > file
> > > > > > > > type.
> > > > > > > >
> > > > > > > > The DEBUG 3 log message:
> > > > > > > > It is just an information. The observation error was
> > > > > > > > defined 1)
> > > > > > > > in
> > > > > > > > the
> > > > > > > > config file or 2) by a table lookup for each
observation.
> > > > > > > >
> > > > > > > > Missing "time" variable at the output of point2grid:
> > > > > > > > The "Convensions" global attribute is added without
> > > > > > > > adding
> > > > > > > > "time"
> > > > > > > > variable by point2grid. The github issue was created
> > > > > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > > > >
> > > > > > > > Cheers,
> > > > > > > > Howard
> > > > > > > >
> > > > > > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov
wrote:
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > Back to point 2 in my previous email: I just found I
> > > > > > > > > also got
> > > > > > > > > the
> > > > > > > > > same
> > > > > > > > > warning "Observation error for point verification is
> > > > > > > > > defined
> > > > > > > > > by a
> > > > > > > > > table
> > > > > > > > > lookup for each observation" in the log file on
WCOSS
> > > > > > > > > as
> > > > > > > > > well. In
> > > > > > > > > my
> > > > > > > > > first
> > > > > > > > > test, I didn' have this warning because I didn't add
"-
> > > > > > > > > v 3"
> > > > > > > > > at
> > > > > > > > > the
> > > > > > > > > end
> > > > > > > > > of
> > > > > > > > > ensemble_stat command. So can I just ignore this
> > > > > > > > > warning?
> > > > > > > > > Sorry
> > > > > > > > > for
> > > > > > > > > that.
> > > > > > > > >
> > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA
> > > > > > > > > Affiliate <
> > > > > > > > > binyu.wang at noaa.gov> wrote:
> > > > > > > > >
> > > > > > > > > > Howard,
> > > > > > > > > >
> > > > > > > > > > Thank you for the immediate help. But there are
three
> > > > > > > > > > things I
> > > > > > > > > > want
> > > > > > > > > > to
> > > > > > > > > > confirm:
> > > > > > > > > > 1. you can see in my original *nc file,
> > > > > > > > > > valid_time_ut =
> > > > > > > > > > "1561165200",
> > > > > > > > > > but the time shown in the warning message in the
log
> > > > > > > > > > file
> > > > > > > > > > is
> > > > > > > > > > "19700101_000000", where is " 19700101_000000"
> > > > > > > > > > coming
> > > > > > > > > > from?
> > > > > > > > > >
> > > > > > > > > > 2. Actually the *nc file is my observation (NOT
> > > > > > > > > > ensemble
> > > > > > > > > > forecast),
> > > > > > > > > > so I
> > > > > > > > > > move the new line to obs. section in the config
file,
> > > > > > > > > > see
> > > > > > > > > > below;
> > > > > > > > > >
> > > > > > > > > > obs = {
> > > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > > field = [
> > > > > > > > > > {
> > > > > > > > > > name = "ash";
> > > > > > > > > > level = ["(*,*)"];
> > > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > > }
> > > > > > > > > > ];
> > > > > > > > > > };
> > > > > > > > > > ------>
> > > > > > > > > >
> > > > > > > > > > obs = {
> > > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > > file_type = NETCDF_MET;
> > > > > > > > > > field = [
> > > > > > > > > > {
> > > > > > > > > > name = "ash";
> > > > > > > > > > level = ["(*,*)"];
> > > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > > }
> > > > > > > > > > ];
> > > > > > > > > >
> > > > > > > > > > };
> > > > > > > > > >
> > > > > > > > > > After that, " WARNING: NcCfFile::open() -> could
not
> > > > > > > > > > determine
> > > > > > > > > > the
> > > > > > > > > > valid
> > > > > > > > > > time, using 0." is gone from the log file, but I
> > > > > > > > > > still had
> > > > > > > > > > that
> > > > > > > > > > "DEBUG 3:
> > > > > > > > > > Observation error for point verification is
defined
> > > > > > > > > > by a
> > > > > > > > > > table
> > > > > > > > > > lookup
> > > > > > > > > > for
> > > > > > > > > > each observation" in the log file, is that a
problem?
> > > > > > > > > > Because
> > > > > > > > > > you
> > > > > > > > > > can
> > > > > > > > > > not
> > > > > > > > > > access Hera, so I copied everything to WCOSS and
> > > > > > > > > > tried
> > > > > > > > > > again,
> > > > > > > > > > then
> > > > > > > > > > the
> > > > > > > > > > warning message is gone. Why is it different on
> > > > > > > > > > WCOSS? My
> > > > > > > > > > files
> > > > > > > > > > on
> > > > > > > > > > WCOSS is
> > > > > > > > > > under
> > > > > > > > > >
> > > > > > > > > >
> > > > > > >
> > > > >
> > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > > > > > >
> > > > > > > > > > 3. I used point2grid to convert ascII file to the
*nc
> > > > > > > > > > files
> > > > > > > > > > I
> > > > > > > > > > used
> > > > > > > > > > above,
> > > > > > > > > > and I used default configure files for "ascii2nc"
> > > > > > > > > > and
> > > > > > > > > > "point2grid",
> > > > > > > > > > will
> > > > > > > > > > this be a reason for the "valid time" issue? The
> > > > > > > > > > script is
> > > > > > > > > > under :
> > > > > > > > > >
> > > > >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > > > > > >
> > > > > > > > > > Thank you.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via RT
> > > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >> MET recognizes the input NetCDF as the CF-
complaint
> > > > > > > > > >> NetCDF
> > > > > > > > > >> file,
> > > > > > > > > >> but
> > > > > > > > > >> it
> > > > > > > > > >> does not have the time variable.
> > > > > > > > > >>
> > > > > > > > > >> WARNING:
> > > > > > > > > >> WARNING: NcCfFile::open() -> could not determine
the
> > > > > > > > > >> valid
> > > > > > > > > >> time,
> > > > > > > > > >> using 0.
> > > > > > > > > >> WARNING:
> > > > > > > > > >>
> > > > > > > > > >> The input NetCDF has the time information at the
> > > > > > > > > >> variable
> > > > > > > > > >> attribute,
> > > > > > > > > >> "valid_time_ut", which is for the MET generated
> > > > > > > > > >> NetCDF
> > > > > > > > > >> file.
> > > > > > > > > >>
> > > > > > > > > >> Three possible slutions:
> > > > > > > > > >>
> > > > > > > > > >> 1. Remove the global attribute "Conventions" at
the
> > > > > > > > > >> input
> > > > > > > > > >> netcdf
> > > > > > > > > >>
> > > > > > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > > > > > >>
> > > > > > > > > >> 3. Add the file type "file_type=NETCDF_MET;" into
> > > > > > > > > >> the
> > > > > > > > > >> config
> > > > > > > > > >> file,
> > > > > > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > > > > > >>
> > > > > > > > > >> ens = {
> > > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > > >> field = [
> > > > > > > > > >> {
> > > > > > > > > >> name = "VAFTD";
> > > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > > >> ];
> > > > > > > > > >>
> > > > > > > > > >> }
> > > > > > > > > >> ];
> > > > > > > > > >> };
> > > > > > > > > >>
> > > > > > > > > >> ==>
> > > > > > > > > >>
> > > > > > > > > >> ens = {
> > > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > > >> file_type = NETCDF_MET;
> > > > > > > > > >> field = [
> > > > > > > > > >> {
> > > > > > > > > >> name = "VAFTD";
> > > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > > >> ];
> > > > > > > > > >>
> > > > > > > > > >> }
> > > > > > > > > >> ];
> > > > > > > > > >> };
> > > > > > > > > >>
> > > > > > > > > >> Cheers,
> > > > > > > > > >> Howard
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > > > > > >> > Thanks.
> > > > > > > > > >> >
> > > > > > > > > >> > The time information comes from "valid_time_ut"
> > > > > > > > > >> > attribute
> > > > > > > > > >> > for
> > > > > > > > > >> > MET
> > > > > > > > > >> > generated NETCDF. Please download the config
files
> > > > > > > > > >> > and
> > > > > > > > > >> > log
> > > > > > > > > >> > files,
> > > > > > > > > >> > too.
> > > > > > > > > >> >
> > > > > > > > > >> > Cheers,
> > > > > > > > > >> > Howard
> > > > > > > > > >> >
> > > > > > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > > > > > >> > > Hi Howard,
> > > > > > > > > >> > >
> > > > > > > > > >> > > I have access to hera but have not retrieved
> > > > > > > > > >> > > files
> > > > > > > > > >> > > from
> > > > > > > > > >> > > there
> > > > > > > > > >> > > before.
> > > > > > > > > >> > > A normal scp doesn't seem to work. I asked
Julie
> > > > > > > > > >> > > for
> > > > > > > > > >> > > help,
> > > > > > > > > >> > > but
> > > > > > > > > >> > > in the
> > > > > > > > > >> > > meantime, I can paste the ncdump headers
results
> > > > > > > > > >> > > for
> > > > > > > > > >> > > that
> > > > > > > > > >> > > file:
> > > > > > > > > >> > >
> > > > > > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean {
> > > > > > > > > >> > > dimensions:
> > > > > > > > > >> > > lon = 721 ;
> > > > > > > > > >> > > lat = 361 ;
> > > > > > > > > >> > > variables:
> > > > > > > > > >> > > float lon(lon) ;
> > > > > > > > > >> > > lon:standard_name =
"longitude"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > lon:long_name = "longitude" ;
> > > > > > > > > >> > > lon:units = "degrees_east" ;
> > > > > > > > > >> > > lon:axis = "X" ;
> > > > > > > > > >> > > float lat(lat) ;
> > > > > > > > > >> > > lat:standard_name =
"latitude" ;
> > > > > > > > > >> > > lat:long_name = "latitude" ;
> > > > > > > > > >> > > lat:units = "degrees_north" ;
> > > > > > > > > >> > > lat:axis = "Y" ;
> > > > > > > > > >> > > float ash(lat, lon) ;
> > > > > > > > > >> > > ash:long_name = "ash(*,*)" ;
> > > > > > > > > >> > > ash:units = "NA" ;
> > > > > > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > > > > > >> > > ash:missing_value = -9999.f ;
> > > > > > > > > >> > > ash:name = "ash" ;
> > > > > > > > > >> > > ash:level = "*,*" ;
> > > > > > > > > >> > > ash:init_time =
> > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > >> > > ash:init_time_ut =
"1561165200"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > ash:valid_time =
> > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > >> > > ash:valid_time_ut =
"1561165200"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > > > > > >> > > ash_cnt:long_name =
> > > > > > > > > >> > > "ash_cnt(*,*)" ;
> > > > > > > > > >> > > ash_cnt:units = "NA" ;
> > > > > > > > > >> > > ash_cnt:_FillValue = -9999 ;
> > > > > > > > > >> > > ash_cnt:missing_value = -9999
;
> > > > > > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > > > > > >> > > ash_cnt:init_time =
> > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > ash_cnt:init_time_ut =
> > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > >> > > ash_cnt:valid_time =
> > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > ash_cnt:valid_time_ut =
> > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > >> > > int ash_mask(lat, lon) ;
> > > > > > > > > >> > > ash_mask:long_name =
> > > > > > > > > >> > > "ash_mask(*,*)" ;
> > > > > > > > > >> > > ash_mask:units = "NA" ;
> > > > > > > > > >> > > ash_mask:_FillValue = -9999 ;
> > > > > > > > > >> > > ash_mask:missing_value =
-9999 ;
> > > > > > > > > >> > > ash_mask:name = "ash_mask" ;
> > > > > > > > > >> > > ash_mask:level = "*,*" ;
> > > > > > > > > >> > > ash_mask:init_time =
> > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > ash_mask:init_time_ut =
> > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > >> > > ash_mask:valid_time =
> > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > >> > > ash_mask:valid_time_ut =
> > > > > > > > > >> > > "1561165200"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > >
> > > > > > > > > >> > > // global attributes:
> > > > > > > > > >> > > :CDI = "Climate Data
Interface
> > > > > > > > > >> > > version
> > > > > > > > > >> > > 1.9.5
> > > > > > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > > > > > >> > > :history = "Mon Jun 29
22:06:09
> > > > > > > > > >> > > 2020:
> > > > > > > > > >> > > cdo
> > > > > > > > > >> > > ensmean
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 010000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 011000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 012000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 013000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 014000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 015000.nc
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 01.mean.nc" ;
> > > > > > > > > >> > > :FileOrigins = "File
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > >
> > > > >
> > >
> >
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > >> > > 010000.nc generated 20200629_194609 UTC on
host
> > > > > > > > > >> > > hfe10
> > > > > > > > > >> > > by
> > > > > > > > > >> > > the
> > > > > > > > > >> > > MET
> > > > > > > > > >> > > point2grid tool" ;
> > > > > > > > > >> > > :MET_version = "V9.0" ;
> > > > > > > > > >> > > :MET_tool = "point2grid" ;
> > > > > > > > > >> > > :RunCommand = "Point obs ()
to
> > > > > > > > > >> > > Projection:
> > > > > > > > > >> > > Lat/Lon
> > > > > > > > > >> > > Nx:
> > > > > > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250
> > > > > > > > > >> > > delta_lat:
> > > > > > > > > >> > > 0.250
> > > > > > > > > >> > > delta_lon:
> > > > > > > > > >> > > 0.250" ;
> > > > > > > > > >> > > :Projection = "LatLon" ;
> > > > > > > > > >> > > :lat_ll = "3.292000
> > > > > > > > > >> > > degrees_north" ;
> > > > > > > > > >> > > :lon_ll = "63.250000
> > > > > > > > > >> > > degrees_east" ;
> > > > > > > > > >> > > :delta_lat = "0.250000
degrees"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > :delta_lon = "0.250000
degrees"
> > > > > > > > > >> > > ;
> > > > > > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > > > > > >> > > :CDO = "Climate Data
Operators
> > > > > > > > > >> > > version
> > > > > > > > > >> > > 1.9.5
> > > > > > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
> >
> >
------------------------------------------------
Subject: valid time
From: binyu.wang at noaa.gov
Time: Tue Oct 13 11:26:38 2020
Sure, you can close it.Thank you for confirmation.
Binyu
On Tue, Oct 13, 2020 at 12:33 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> The MET 9.1 supports the multiple fields with point2grid.
> If you don't have other issue, I would like to close this ticket.
>
> Cheers,
> Howard
>
> On Mon Jul 20 13:58:25 2020, johnhg wrote:
> > The ascii2nc tool has always been able to process multiple
observation
> > types in each run. ascii2nc supports multiple flavors of input
ascii
> > files,
> > as described in section 4.2 of the MET user's guide:
> > https://dtcenter.org/sites/default/files/community-
code/met/docs/user-
> > guide/MET_Users_Guide_v9.0.3.pdf
> >
> > One of the supported formats is a simple 11-column table of data
as
> > listed
> > in the ascii2nc usage statement and described in table 4.4 on page
> > 150.
> >
> > Thanks,
> > John
> >
> > On Mon, Jul 20, 2020 at 1:37 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95824 >
> > >
> > > How about the asciinc? Can asciinc support multiple variables
in the
> > > new
> > > version too? If so, what should be the format for the ascII
file?
> > > Thank
> > > you.
> > >
> > > Binyu
> > >
> > > On Tue, Jul 14, 2020 at 6:34 PM Howard Soh via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > The existing point2grid supports only one variable. The newer
> > > > version
> > > (MET
> > > > 9.1 beta2 which was released today) supports multiple -field
> > > > arguments (
> > > > https://github.com/NCAR/MET/issues/1396). The command example
to
> > > > process
> > > > multiple variables is
> > > >
> > > > ./point2grid ascii2nc_output.nc G212 my_output.nc -field
> > > > 'name="TMP";
> > > > level="*";' -field 'name="UGRD"; level="*";' -field
'name="VGRD";
> > > > level="*";' -v 1
> > > >
> > > > With older point2grid, alternative is running point2grid
multiple
> > > > times
> > > > and combining them by using third party tools, like nccopy.
For
> > > > example,
> > > >
> > > > ./point2grid ascii2nc_output.nc G212 my_TMP_output.nc -field
> > > > 'name="TMP"; level="*";' -v 1
> > > > ./point2grid ascii2nc_output.nc G212 my_VGRD_output.nc -field
> > > > 'name="UGRD"; level="*";' -v 1
> > > > ./point2grid ascii2nc_output.nc G212 my_UGRD_output.nc -field
> > > > 'name="VGRD"; level="*";' -v 1
> > > >
> > > > cp my_TMP_output.nc my_output.nc
> > > > nccopy -v UGRD my_VGRD_output.nc my_output.nc
> > > > nccopy -v VGRD my_VGRD_output.nc my_output.nc
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Tue Jul 14 15:31:59 2020, binyu.wang at noaa.gov wrote:
> > > > > Hello Howard,
> > > > >
> > > > > I have more questions about the use of ascii2nc and
point2grid :
> > > > > Can
> > > > > we do
> > > > > the conversion for one variable ONLY each time? There is
ONLY
> > > > > one
> > > > > column
> > > > > for variables in the ASCII point observation format. But if
I
> > > > > have
> > > > > multiple
> > > > > variables that need to be converted to one nc format from
ascII
> > > > > file
> > > > > (like
> > > > > UGRD, VGRD, TMP etc), how to do that?
> > > > >
> > > > > It seems "ascii2nc" can take multiple ascII inputs, but
after
> > > > > getting
> > > > > the
> > > > > *nc file, but how to set the string for the "field" to use
> > > > > utility
> > > > > "point2grid" then?
> > > > >
> > > > > Here is my script:
> > > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid_uwyo.sh
> > > > >
> > > > > Thank you.
> > > > > Binyu
> > > > >
> > > > > On Tue, Jul 7, 2020 at 2:29 AM Howard Soh via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Missing "time" variable at the output of point2grid:
> > > > > > The "Convensions" global attribute was not added by
point2grid.
> > > > > > It
> > > > > > might
> > > > > > be added by cdo.
> > > > > >
> > > > > > I will hold the github issue
> > > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > > There is other issue
(https://github.com/NCAR/MET/issues/1396)
> > > > > > which
> > > > > > supports multitple -field arguments. MET allows different
> > > > > > obs_time
> > > > > > per
> > > > > > field. For example, the following command is allowed:
> > > > > > ./point2grid pb2nc_ndas.20120409.t12z.prepbufr.tm00.nc
G212
> > > > > > pb2nc_TMP_RH.nc -field 'name="TMP"; level="*";
> > > > > > valid_time="20120409_120000";' -field 'name="RH";
level="*";
> > > > > > valid_time="20120409_180000";' -v 1
> > > > > >
> > > > > > different valid time:
> > > > > > - TMP: 20120409_120000
> > > > > > - RH: 20120409_180000
> > > > > >
> > > > > > I need to check if this is acceptable.
> > > > > >
> > > > > > Cheers,
> > > > > > Howard
> > > > > >
> > > > > >
> > > > > > On Mon Jul 06 13:41:48 2020, binyu.wang at noaa.gov wrote:
> > > > > > > Got it, thank you very much.
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Mon, Jul 6, 2020 at 3:31 PM Howard Soh via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > 19700101_000000 comes from the default unix time 0.
> > > > > > > >
> > > > > > > > > date +"%Y%m%d_%H%M%S" -d at 0
> > > > > > > > 19700101_000000
> > > > > > > >
> > > > > > > > If the time information is missing, MET assigns the
default
> > > > > > > > unix
> > > > > > > > time
> > > > > > > > (0)
> > > > > > > > which is 19700101_000000.
> > > > > > > >
> > > > > > > > Cheers,Howard
> > > > > > > >
> > > > > > > > On Mon Jul 06 13:25:01 2020, hsoh wrote:
> > > > > > > > > Thank you for correcting the config file to override
> > > > > > > > > NetCDF
> > > > > > > > > file
> > > > > > > > > type.
> > > > > > > > >
> > > > > > > > > The DEBUG 3 log message:
> > > > > > > > > It is just an information. The observation error was
> > > > > > > > > defined 1)
> > > > > > > > > in
> > > > > > > > > the
> > > > > > > > > config file or 2) by a table lookup for each
observation.
> > > > > > > > >
> > > > > > > > > Missing "time" variable at the output of point2grid:
> > > > > > > > > The "Convensions" global attribute is added without
> > > > > > > > > adding
> > > > > > > > > "time"
> > > > > > > > > variable by point2grid. The github issue was created
> > > > > > > > > (https://github.com/NCAR/MET/issues/1407).
> > > > > > > > >
> > > > > > > > > Cheers,
> > > > > > > > > Howard
> > > > > > > > >
> > > > > > > > > On Mon Jul 06 12:59:13 2020, binyu.wang at noaa.gov
wrote:
> > > > > > > > > > Hello,
> > > > > > > > > >
> > > > > > > > > > Back to point 2 in my previous email: I just found
I
> > > > > > > > > > also got
> > > > > > > > > > the
> > > > > > > > > > same
> > > > > > > > > > warning "Observation error for point verification
is
> > > > > > > > > > defined
> > > > > > > > > > by a
> > > > > > > > > > table
> > > > > > > > > > lookup for each observation" in the log file on
WCOSS
> > > > > > > > > > as
> > > > > > > > > > well. In
> > > > > > > > > > my
> > > > > > > > > > first
> > > > > > > > > > test, I didn' have this warning because I didn't
add "-
> > > > > > > > > > v 3"
> > > > > > > > > > at
> > > > > > > > > > the
> > > > > > > > > > end
> > > > > > > > > > of
> > > > > > > > > > ensemble_stat command. So can I just ignore this
> > > > > > > > > > warning?
> > > > > > > > > > Sorry
> > > > > > > > > > for
> > > > > > > > > > that.
> > > > > > > > > >
> > > > > > > > > > Binyu
> > > > > > > > > >
> > > > > > > > > > On Mon, Jul 6, 2020 at 2:50 PM Binyu Wang - NOAA
> > > > > > > > > > Affiliate <
> > > > > > > > > > binyu.wang at noaa.gov> wrote:
> > > > > > > > > >
> > > > > > > > > > > Howard,
> > > > > > > > > > >
> > > > > > > > > > > Thank you for the immediate help. But there are
three
> > > > > > > > > > > things I
> > > > > > > > > > > want
> > > > > > > > > > > to
> > > > > > > > > > > confirm:
> > > > > > > > > > > 1. you can see in my original *nc file,
> > > > > > > > > > > valid_time_ut =
> > > > > > > > > > > "1561165200",
> > > > > > > > > > > but the time shown in the warning message in
the log
> > > > > > > > > > > file
> > > > > > > > > > > is
> > > > > > > > > > > "19700101_000000", where is " 19700101_000000"
> > > > > > > > > > > coming
> > > > > > > > > > > from?
> > > > > > > > > > >
> > > > > > > > > > > 2. Actually the *nc file is my observation (NOT
> > > > > > > > > > > ensemble
> > > > > > > > > > > forecast),
> > > > > > > > > > > so I
> > > > > > > > > > > move the new line to obs. section in the config
file,
> > > > > > > > > > > see
> > > > > > > > > > > below;
> > > > > > > > > > >
> > > > > > > > > > > obs = {
> > > > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > > > field = [
> > > > > > > > > > > {
> > > > > > > > > > > name = "ash";
> > > > > > > > > > > level = ["(*,*)"];
> > > > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > > > }
> > > > > > > > > > > ];
> > > > > > > > > > > };
> > > > > > > > > > > ------>
> > > > > > > > > > >
> > > > > > > > > > > obs = {
> > > > > > > > > > > wind_thresh = [ NA ];
> > > > > > > > > > > file_type = NETCDF_MET;
> > > > > > > > > > > field = [
> > > > > > > > > > > {
> > > > > > > > > > > name = "ash";
> > > > > > > > > > > level = ["(*,*)"];
> > > > > > > > > > > cat_thresh = [ >=0.05, >=0.1,>=0.3,
> > > > > > > > > > > > =0.5,>=1,>=3,>=5,>=7,>=10 ];
> > > > > > > > > > > }
> > > > > > > > > > > ];
> > > > > > > > > > >
> > > > > > > > > > > };
> > > > > > > > > > >
> > > > > > > > > > > After that, " WARNING: NcCfFile::open() ->
could not
> > > > > > > > > > > determine
> > > > > > > > > > > the
> > > > > > > > > > > valid
> > > > > > > > > > > time, using 0." is gone from the log file, but I
> > > > > > > > > > > still had
> > > > > > > > > > > that
> > > > > > > > > > > "DEBUG 3:
> > > > > > > > > > > Observation error for point verification is
defined
> > > > > > > > > > > by a
> > > > > > > > > > > table
> > > > > > > > > > > lookup
> > > > > > > > > > > for
> > > > > > > > > > > each observation" in the log file, is that a
problem?
> > > > > > > > > > > Because
> > > > > > > > > > > you
> > > > > > > > > > > can
> > > > > > > > > > > not
> > > > > > > > > > > access Hera, so I copied everything to WCOSS and
> > > > > > > > > > > tried
> > > > > > > > > > > again,
> > > > > > > > > > > then
> > > > > > > > > > > the
> > > > > > > > > > > warning message is gone. Why is it different on
> > > > > > > > > > > WCOSS? My
> > > > > > > > > > > files
> > > > > > > > > > > on
> > > > > > > > > > > WCOSS is
> > > > > > > > > > > under
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/grid2grid/verf_met_ens/ush/verf_g2g_Raikoke.sh
> > > > > > > > > > >
> > > > > > > > > > > 3. I used point2grid to convert ascII file to
the *nc
> > > > > > > > > > > files
> > > > > > > > > > > I
> > > > > > > > > > > used
> > > > > > > > > > > above,
> > > > > > > > > > > and I used default configure files for
"ascii2nc"
> > > > > > > > > > > and
> > > > > > > > > > > "point2grid",
> > > > > > > > > > > will
> > > > > > > > > > > this be a reason for the "valid time" issue?
The
> > > > > > > > > > > script is
> > > > > > > > > > > under :
> > > > > > > > > > >
> > > > > >
> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/Scripts/MET/asc2grid.sh
> > > > > > > > > > >
> > > > > > > > > > > Thank you.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On Mon, Jul 6, 2020 at 12:36 PM Howard Soh via
RT
> > > > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >> MET recognizes the input NetCDF as the CF-
complaint
> > > > > > > > > > >> NetCDF
> > > > > > > > > > >> file,
> > > > > > > > > > >> but
> > > > > > > > > > >> it
> > > > > > > > > > >> does not have the time variable.
> > > > > > > > > > >>
> > > > > > > > > > >> WARNING:
> > > > > > > > > > >> WARNING: NcCfFile::open() -> could not
determine the
> > > > > > > > > > >> valid
> > > > > > > > > > >> time,
> > > > > > > > > > >> using 0.
> > > > > > > > > > >> WARNING:
> > > > > > > > > > >>
> > > > > > > > > > >> The input NetCDF has the time information at
the
> > > > > > > > > > >> variable
> > > > > > > > > > >> attribute,
> > > > > > > > > > >> "valid_time_ut", which is for the MET generated
> > > > > > > > > > >> NetCDF
> > > > > > > > > > >> file.
> > > > > > > > > > >>
> > > > > > > > > > >> Three possible slutions:
> > > > > > > > > > >>
> > > > > > > > > > >> 1. Remove the global attribute "Conventions" at
the
> > > > > > > > > > >> input
> > > > > > > > > > >> netcdf
> > > > > > > > > > >>
> > > > > > > > > > >> 2. Add "time" variable into the input NetCDF.
> > > > > > > > > > >>
> > > > > > > > > > >> 3. Add the file type "file_type=NETCDF_MET;"
into
> > > > > > > > > > >> the
> > > > > > > > > > >> config
> > > > > > > > > > >> file,
> > > > > > > > > > >> verf_g2g_ens_stat_regn_config_Raikoke
> > > > > > > > > > >>
> > > > > > > > > > >> ens = {
> > > > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > > > >> field = [
> > > > > > > > > > >> {
> > > > > > > > > > >> name = "VAFTD";
> > > > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > > > >> ];
> > > > > > > > > > >>
> > > > > > > > > > >> }
> > > > > > > > > > >> ];
> > > > > > > > > > >> };
> > > > > > > > > > >>
> > > > > > > > > > >> ==>
> > > > > > > > > > >>
> > > > > > > > > > >> ens = {
> > > > > > > > > > >> wind_thresh = [ NA ];
> > > > > > > > > > >> file_type = NETCDF_MET;
> > > > > > > > > > >> field = [
> > > > > > > > > > >> {
> > > > > > > > > > >> name = "VAFTD";
> > > > > > > > > > >> convert(x) = 3.91*10^16*(10^(x));
> > > > > > > > > > >> level = [ "L0-18000" ];
> > > > > > > > > > >> lead_time = "${LEAD_HR}";
> > > > > > > > > > >> cat_thresh = [>=0.05, >=0.1,>=0.3,
> > > > > > > > > > >> > =0.5,>=1,>=3,>=5,>=7,>=10
> > > > > > > > > > >> ];
> > > > > > > > > > >>
> > > > > > > > > > >> }
> > > > > > > > > > >> ];
> > > > > > > > > > >> };
> > > > > > > > > > >>
> > > > > > > > > > >> Cheers,
> > > > > > > > > > >> Howard
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >> On Mon Jul 06 09:04:54 2020, hsoh wrote:
> > > > > > > > > > >> > Thanks.
> > > > > > > > > > >> >
> > > > > > > > > > >> > The time information comes from
"valid_time_ut"
> > > > > > > > > > >> > attribute
> > > > > > > > > > >> > for
> > > > > > > > > > >> > MET
> > > > > > > > > > >> > generated NETCDF. Please download the config
files
> > > > > > > > > > >> > and
> > > > > > > > > > >> > log
> > > > > > > > > > >> > files,
> > > > > > > > > > >> > too.
> > > > > > > > > > >> >
> > > > > > > > > > >> > Cheers,
> > > > > > > > > > >> > Howard
> > > > > > > > > > >> >
> > > > > > > > > > >> > On Mon Jul 06 08:58:29 2020, mccabe wrote:
> > > > > > > > > > >> > > Hi Howard,
> > > > > > > > > > >> > >
> > > > > > > > > > >> > > I have access to hera but have not
retrieved
> > > > > > > > > > >> > > files
> > > > > > > > > > >> > > from
> > > > > > > > > > >> > > there
> > > > > > > > > > >> > > before.
> > > > > > > > > > >> > > A normal scp doesn't seem to work. I asked
Julie
> > > > > > > > > > >> > > for
> > > > > > > > > > >> > > help,
> > > > > > > > > > >> > > but
> > > > > > > > > > >> > > in the
> > > > > > > > > > >> > > meantime, I can paste the ncdump headers
results
> > > > > > > > > > >> > > for
> > > > > > > > > > >> > > that
> > > > > > > > > > >> > > file:
> > > > > > > > > > >> > >
> > > > > > > > > > >> > > netcdf regrid_Himawari_ash_20190622-01.mean
{
> > > > > > > > > > >> > > dimensions:
> > > > > > > > > > >> > > lon = 721 ;
> > > > > > > > > > >> > > lat = 361 ;
> > > > > > > > > > >> > > variables:
> > > > > > > > > > >> > > float lon(lon) ;
> > > > > > > > > > >> > > lon:standard_name =
"longitude"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > lon:long_name = "longitude"
;
> > > > > > > > > > >> > > lon:units = "degrees_east"
;
> > > > > > > > > > >> > > lon:axis = "X" ;
> > > > > > > > > > >> > > float lat(lat) ;
> > > > > > > > > > >> > > lat:standard_name =
"latitude" ;
> > > > > > > > > > >> > > lat:long_name = "latitude"
;
> > > > > > > > > > >> > > lat:units = "degrees_north"
;
> > > > > > > > > > >> > > lat:axis = "Y" ;
> > > > > > > > > > >> > > float ash(lat, lon) ;
> > > > > > > > > > >> > > ash:long_name = "ash(*,*)"
;
> > > > > > > > > > >> > > ash:units = "NA" ;
> > > > > > > > > > >> > > ash:_FillValue = -9999.f ;
> > > > > > > > > > >> > > ash:missing_value = -9999.f
;
> > > > > > > > > > >> > > ash:name = "ash" ;
> > > > > > > > > > >> > > ash:level = "*,*" ;
> > > > > > > > > > >> > > ash:init_time =
> > > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > > >> > > ash:init_time_ut =
"1561165200"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > ash:valid_time =
> > > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > > >> > > ash:valid_time_ut =
"1561165200"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > int ash_cnt(lat, lon) ;
> > > > > > > > > > >> > > ash_cnt:long_name =
> > > > > > > > > > >> > > "ash_cnt(*,*)" ;
> > > > > > > > > > >> > > ash_cnt:units = "NA" ;
> > > > > > > > > > >> > > ash_cnt:_FillValue = -9999
;
> > > > > > > > > > >> > > ash_cnt:missing_value =
-9999 ;
> > > > > > > > > > >> > > ash_cnt:name = "ash_cnt" ;
> > > > > > > > > > >> > > ash_cnt:level = "*,*" ;
> > > > > > > > > > >> > > ash_cnt:init_time =
> > > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > ash_cnt:init_time_ut =
> > > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > > >> > > ash_cnt:valid_time =
> > > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > ash_cnt:valid_time_ut =
> > > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > > >> > > int ash_mask(lat, lon) ;
> > > > > > > > > > >> > > ash_mask:long_name =
> > > > > > > > > > >> > > "ash_mask(*,*)" ;
> > > > > > > > > > >> > > ash_mask:units = "NA" ;
> > > > > > > > > > >> > > ash_mask:_FillValue = -9999
;
> > > > > > > > > > >> > > ash_mask:missing_value =
-9999 ;
> > > > > > > > > > >> > > ash_mask:name = "ash_mask"
;
> > > > > > > > > > >> > > ash_mask:level = "*,*" ;
> > > > > > > > > > >> > > ash_mask:init_time =
> > > > > > > > > > >> > > "20190622_010000"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > ash_mask:init_time_ut =
> > > > > > > > > > >> > > "1561165200" ;
> > > > > > > > > > >> > > ash_mask:valid_time =
> > > > > > > > > > >> > > "20190622_010000" ;
> > > > > > > > > > >> > > ash_mask:valid_time_ut =
> > > > > > > > > > >> > > "1561165200"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > >
> > > > > > > > > > >> > > // global attributes:
> > > > > > > > > > >> > > :CDI = "Climate Data
Interface
> > > > > > > > > > >> > > version
> > > > > > > > > > >> > > 1.9.5
> > > > > > > > > > >> > > (http://mpimet.mpg.de/cdi)" ;
> > > > > > > > > > >> > > :Conventions = "CF-1.6" ;
> > > > > > > > > > >> > > :history = "Mon Jun 29
22:06:09
> > > > > > > > > > >> > > 2020:
> > > > > > > > > > >> > > cdo
> > > > > > > > > > >> > > ensmean
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 010000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 011000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 012000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 013000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 014000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 015000.nc
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met_mean/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 01.mean.nc" ;
> > > > > > > > > > >> > > :FileOrigins = "File
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> > >
>
/scratch2/NCEPDEV/naqfc/Binyu.Wang/MET/Obs/Raikoke/ARL_obs_met/regrid_Himawari_ash_20190622-
> > > > > > > > > > >> > > 010000.nc generated 20200629_194609 UTC on
host
> > > > > > > > > > >> > > hfe10
> > > > > > > > > > >> > > by
> > > > > > > > > > >> > > the
> > > > > > > > > > >> > > MET
> > > > > > > > > > >> > > point2grid tool" ;
> > > > > > > > > > >> > > :MET_version = "V9.0" ;
> > > > > > > > > > >> > > :MET_tool = "point2grid" ;
> > > > > > > > > > >> > > :RunCommand = "Point obs ()
to
> > > > > > > > > > >> > > Projection:
> > > > > > > > > > >> > > Lat/Lon
> > > > > > > > > > >> > > Nx:
> > > > > > > > > > >> > > 721 Ny: 361 lat_ll: 3.292 lon_ll: -63.250
> > > > > > > > > > >> > > delta_lat:
> > > > > > > > > > >> > > 0.250
> > > > > > > > > > >> > > delta_lon:
> > > > > > > > > > >> > > 0.250" ;
> > > > > > > > > > >> > > :Projection = "LatLon" ;
> > > > > > > > > > >> > > :lat_ll = "3.292000
> > > > > > > > > > >> > > degrees_north" ;
> > > > > > > > > > >> > > :lon_ll = "63.250000
> > > > > > > > > > >> > > degrees_east" ;
> > > > > > > > > > >> > > :delta_lat = "0.250000
degrees"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > :delta_lon = "0.250000
degrees"
> > > > > > > > > > >> > > ;
> > > > > > > > > > >> > > :Nlat = "361 grid_points" ;
> > > > > > > > > > >> > > :Nlon = "721 grid_points" ;
> > > > > > > > > > >> > > :CDO = "Climate Data
Operators
> > > > > > > > > > >> > > version
> > > > > > > > > > >> > > 1.9.5
> > > > > > > > > > >> > > (http://mpimet.mpg.de/cdo)" ;
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list