[Met_help] [rt.rap.ucar.edu #75238] History for Cmorph rainfall
John Halley Gotway via RT
met_help at ucar.edu
Wed Mar 2 11:48:47 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear met_help.
I have cmorph rainfall from the link
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
I have also downloaded the data for the past years. the files are (attached)
1. CMORPH_8KM-30MIN_2015120112 ; binary uncompressed
2. CMORPH_V0.x_RAW_8km-30min_2014060200
You had given me a program that converts the binary file into NC file (attached). When I run this program the NC files are created but NOT plotted by NCL.
I also plotted the NC files using ncview (attached)
I tried to plot the nc outputs for the two dates (ie 2015120112 when NCL plots are generated and when the NCL is unable to generate the plot 2014060200).
I feel that there is some issue with the conversion of the binary data to NETCDF.
can u help me sort out this issue.
Geeta
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Cmorph rainfall
From: John Halley Gotway
Time: Wed Feb 24 09:29:26 2016
Geeta,
I see you have some questions about using CMORPH data.
Here are some commands I ran:
# Pull a binary CMORPH file
wget
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2016020712.Z
# Uncompress it
gunzip CMORPH_8KM-30MIN_2016020712.Z
# Edit the ncl script you sent to list this input file name.
# Run NCL to convert to NetCDF
ncl cmorph8km2nc.ncl
# Plot the output NetCDF file
met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712.nc
CMORPH_8KM-30MIN_2016020712.ps 'name="CMORPH"; level="(0,*,*)";'
# Convert image to png format
convert -rotate 90 -background white -flatten
CMORPH_8KM-30MIN_2016020712.ps CMORPH_8KM-30MIN_2016020712.png
The resulting image is attached. You'll notice that the map is
upside-down
and backwards. That's fine actually. I think the data is in the
correct
spot on the earth. And you can still use this in MET.
We should probably update the logic in MET to detect this situation
and
flip the data after we read it. But you can still use it as is.
met-5.1 supports automated regridding and also includes a tool named
regrid_data_plane. Here's how you could run it on this data:
# Regrid to a domain over India using budget interpolation
met-5.1/bin/regrid_data_plane CMORPH_8KM-30MIN_2016020712.nc 'latlon
200
200 0 55 0.25 0.25' CMORPH_8KM-30MIN_2016020712_India.nc -field
'name="CMORPH"; level="(0,*,*)";' -method BUDGET -width 2
# Plot the result and convert to png
met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712_India.nc
CMORPH_8KM-30MIN_2016020712_India.ps 'name="CMORPH"; level="(*,*)";'
convert -rotate 90 -background white -flatten
CMORPH_8KM-30MIN_2016020712_India.ps CMORPH_8KM-
30MIN_2016020712_India.png
The resulting image is attached.
Lastly, I imagine you're using this CMORPH data to compare to some
forecast
output on a smaller domain. You don't even need to do that regridding
step
before using this data. Just pass the global NetCDF output from the
NCL
script to grid_stat or MODE (for example) and set up the "regrid"
section
of the configuration file like this:
regrid = {
to_grid = FCST;
method = BUDGET;
width = 2;
vld_thresh = 0.5;
}
Then Grid-Stat will read the forecast and observation data files and
automatically regrid the CMORPH observation data to the domain of your
forecast. Budget interpolation is typically recommended when
evaluating
precipitation.
Hopefully that helps. Unfortunately, I don't have any suggestions for
working with the older CMORPH data. I can tell you that the NCL
script
expects a very specific naming convention. So you could try renaming
the
older data to follow the newer naming convention.
Thanks,
John Halley Gotway
On Wed, Feb 24, 2016 at 3:20 AM, Geeta Geeta via RT
<met_help at ucar.edu>
wrote:
>
> Wed Feb 24 03:20:57 2016: Request 75238 was acted upon.
> Transaction: Ticket created by geeta124 at hotmail.com
> Queue: met_help
> Subject: Cmorph rainfall
> Owner: Nobody
> Requestors: geeta124 at hotmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238 >
>
>
> Dear met_help.
> I have cmorph rainfall from the link
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
>
> I have also downloaded the data for the past years. the files are
> (attached)
> 1. CMORPH_8KM-30MIN_2015120112
;
> binary uncompressed
> 2. CMORPH_V0.x_RAW_8km-30min_2014060200
>
>
>
> You had given me a program that converts the binary file into NC
file
> (attached). When I run this program the NC files are created but NOT
> plotted by NCL.
> I also plotted the NC files using ncview (attached)
> I tried to plot the nc outputs for the two dates (ie 2015120112 when
NCL
> plots are generated and when the NCL is unable to generate the plot
> 2014060200).
>
> I feel that there is some issue with the conversion of the binary
data to
> NETCDF.
>
>
> can u help me sort out this issue.
> Geeta
>
>
>
------------------------------------------------
Subject: Cmorph rainfall
From: Geeta Geeta
Time: Thu Feb 25 09:36:12 2016
Hi John. The program (cmorph8km2nc.ncl) converts the binary file into
NC. I feel that is not done properly. Variable: filiType: stringTotal
Size: 4 bytes 1 valuesNumber of Dimensions: 1Dimensions and
sizes: [1]Coordinates: (0) ./201104/CMORPH_V1.0_ADJ_8km-
30min_2011042301CDMS error: Day-of-year error; month: 0
(0) min=-59.96361529599999 max=59.963614(0) min=0.036378335
max=359.963619878(0) min=0 max=252
Variable: prcType: floatTotal Size: 32637008 bytes 8159252
valuesNumber of Dimensions: 3Dimensions and sizes: [time | 1] x [lat |
1649] x [lon | 4948]Coordinates: time:
[2.121783591386373e-310..2.121783591386373e-310] lat:
[59.963614..-59.96361529599999] lon:
[0.036378335..359.963619878]Number Of Attributes: 3 units : mm/hr
long_name : CMORPH 8km _FillValue : -9999(0) CMORPH 8km: min=0
max=50.4aditya at agniilap:~/geeta/ncl/CMORPH-L$ ls -lrt *.nc-rw-rw-r-- 1
aditya aditya 32690904 Feb 20 22:09 CMORPH_8KM-30MIN_2015120100.nc-rw-
rw-r-- 1 aditya aditya 32690904 Feb 20 22:10 CMORPH_8KM-
30MIN_2015120101.ncaditya at agniilap:~/geeta/ncl/CMORPH-L$
I feel that time dimension is not Okay. Can u pls suggest???geeta
From: geeta124 at hotmail.com
To: met_help at ucar.edu
Subject: RE: [rt.rap.ucar.edu #75238] Cmorph rainfall
Date: Wed, 24 Feb 2016 23:26:51 +0530
thanks john. I have 8km rainfall data. 1. I could plot 2015 Dec data
both ways (binary and when converted to NETCDF).
2. for the 2011-April-23 00 UTC data, when I try to covert bin file to
NC file, it gets converted without an issue. I want to plot 2011-april
(NC file) to see if the plot is OKAY and hence data can be used by
MET, I run into problems.
My plot is NOT OKAY. (just attaching two plots). The data is
downloaded from
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
I am attaching my NCL code as well.
Geeta
> Subject: Re: [rt.rap.ucar.edu #75238] Cmorph rainfall
> From: met_help at ucar.edu
> To: geeta124 at hotmail.com
> Date: Wed, 24 Feb 2016 09:29:27 -0700
>
> Geeta,
>
> I see you have some questions about using CMORPH data.
>
> Here are some commands I ran:
>
> # Pull a binary CMORPH file
> wget
>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2016020712.Z
>
> # Uncompress it
> gunzip CMORPH_8KM-30MIN_2016020712.Z
>
> # Edit the ncl script you sent to list this input file name.
>
> # Run NCL to convert to NetCDF
> ncl cmorph8km2nc.ncl
>
> # Plot the output NetCDF file
> met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712.nc
> CMORPH_8KM-30MIN_2016020712.ps 'name="CMORPH"; level="(0,*,*)";'
>
> # Convert image to png format
> convert -rotate 90 -background white -flatten
> CMORPH_8KM-30MIN_2016020712.ps CMORPH_8KM-30MIN_2016020712.png
>
> The resulting image is attached. You'll notice that the map is
upside-down
> and backwards. That's fine actually. I think the data is in the
correct
> spot on the earth. And you can still use this in MET.
>
> We should probably update the logic in MET to detect this situation
and
> flip the data after we read it. But you can still use it as is.
>
> met-5.1 supports automated regridding and also includes a tool named
> regrid_data_plane. Here's how you could run it on this data:
>
> # Regrid to a domain over India using budget interpolation
> met-5.1/bin/regrid_data_plane CMORPH_8KM-30MIN_2016020712.nc 'latlon
200
> 200 0 55 0.25 0.25' CMORPH_8KM-30MIN_2016020712_India.nc -field
> 'name="CMORPH"; level="(0,*,*)";' -method BUDGET -width 2
>
> # Plot the result and convert to png
> met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712_India.nc
> CMORPH_8KM-30MIN_2016020712_India.ps 'name="CMORPH"; level="(*,*)";'
> convert -rotate 90 -background white -flatten
> CMORPH_8KM-30MIN_2016020712_India.ps CMORPH_8KM-
30MIN_2016020712_India.png
>
> The resulting image is attached.
>
> Lastly, I imagine you're using this CMORPH data to compare to some
forecast
> output on a smaller domain. You don't even need to do that
regridding step
> before using this data. Just pass the global NetCDF output from the
NCL
> script to grid_stat or MODE (for example) and set up the "regrid"
section
> of the configuration file like this:
>
> regrid = {
> to_grid = FCST;
> method = BUDGET;
> width = 2;
> vld_thresh = 0.5;
> }
>
> Then Grid-Stat will read the forecast and observation data files and
> automatically regrid the CMORPH observation data to the domain of
your
> forecast. Budget interpolation is typically recommended when
evaluating
> precipitation.
>
> Hopefully that helps. Unfortunately, I don't have any suggestions
for
> working with the older CMORPH data. I can tell you that the NCL
script
> expects a very specific naming convention. So you could try
renaming the
> older data to follow the newer naming convention.
>
> Thanks,
> John Halley Gotway
>
>
>
>
> On Wed, Feb 24, 2016 at 3:20 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Wed Feb 24 03:20:57 2016: Request 75238 was acted upon.
> > Transaction: Ticket created by geeta124 at hotmail.com
> > Queue: met_help
> > Subject: Cmorph rainfall
> > Owner: Nobody
> > Requestors: geeta124 at hotmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238 >
> >
> >
> > Dear met_help.
> > I have cmorph rainfall from the link
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
> >
> > I have also downloaded the data for the past years. the files are
> > (attached)
> > 1. CMORPH_8KM-30MIN_2015120112
;
> > binary uncompressed
> > 2. CMORPH_V0.x_RAW_8km-30min_2014060200
> >
> >
> >
> > You had given me a program that converts the binary file into NC
file
> > (attached). When I run this program the NC files are created but
NOT
> > plotted by NCL.
> > I also plotted the NC files using ncview (attached)
> > I tried to plot the nc outputs for the two dates (ie 2015120112
when NCL
> > plots are generated and when the NCL is unable to generate the
plot
> > 2014060200).
> >
> > I feel that there is some issue with the conversion of the binary
data to
> > NETCDF.
> >
> >
> > can u help me sort out this issue.
> > Geeta
> >
> >
> >
>
------------------------------------------------
Subject: Cmorph rainfall
From: John Halley Gotway
Time: Thu Feb 25 09:52:47 2016
Geeta,
I see from the log message you sent that you're using the NCL script
to
process a file named:
CMORPH_V1.0_ADJ_8km-30min_2011042301
The does not follow the precise naming convention the script expects.
The
file names must look like this:
CMORPH_8KM-30MIN_2015120112
I don't have any suggestions for processing older CMORPH data which
doesn't
follow that naming convention.
Thanks,
John
On Thu, Feb 25, 2016 at 9:36 AM, Geeta Geeta via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238 >
>
> Hi John. The program (cmorph8km2nc.ncl) converts the binary file
into NC.
> I feel that is not done properly. Variable: filiType: stringTotal
Size: 4
> bytes 1 valuesNumber of Dimensions: 1Dimensions and
sizes:
> [1]Coordinates: (0) ./201104/CMORPH_V1.0_ADJ_8km-
30min_2011042301CDMS
> error: Day-of-year error; month: 0
> (0) min=-59.96361529599999 max=59.963614(0)
min=0.036378335
> max=359.963619878(0) min=0 max=252
> Variable: prcType: floatTotal Size: 32637008 bytes
8159252
> valuesNumber of Dimensions: 3Dimensions and sizes: [time | 1]
x [lat
> | 1649] x [lon | 4948]Coordinates: time:
> [2.121783591386373e-310..2.121783591386373e-310] lat:
> [59.963614..-59.96361529599999] lon:
> [0.036378335..359.963619878]Number Of Attributes: 3 units :
mm/hr
> long_name : CMORPH 8km _FillValue : -9999(0)
CMORPH
> 8km: min=0 max=50.4aditya at agniilap:~/geeta/ncl/CMORPH-L$ ls -lrt
> *.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:09 CMORPH_8KM-
30MIN_
> 2015120100.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:10
> CMORPH_8KM-30MIN_2015120101.ncaditya at agniilap:~/geeta/ncl/CMORPH-L$
> I feel that time dimension is not Okay. Can u pls suggest???geeta
>
> From: geeta124 at hotmail.com
> To: met_help at ucar.edu
> Subject: RE: [rt.rap.ucar.edu #75238] Cmorph rainfall
> Date: Wed, 24 Feb 2016 23:26:51 +0530
>
>
>
>
> thanks john. I have 8km rainfall data. 1. I could plot 2015 Dec data
both
> ways (binary and when converted to NETCDF).
> 2. for the 2011-April-23 00 UTC data, when I try to covert bin file
to NC
> file, it gets converted without an issue. I want to plot 2011-april
(NC
> file) to see if the plot is OKAY and hence data can be used by MET,
I run
> into problems.
> My plot is NOT OKAY. (just attaching two plots). The data is
downloaded
> from ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
> I am attaching my NCL code as well.
> Geeta
>
> > Subject: Re: [rt.rap.ucar.edu #75238] Cmorph rainfall
> > From: met_help at ucar.edu
> > To: geeta124 at hotmail.com
> > Date: Wed, 24 Feb 2016 09:29:27 -0700
> >
> > Geeta,
> >
> > I see you have some questions about using CMORPH data.
> >
> > Here are some commands I ran:
> >
> > # Pull a binary CMORPH file
> > wget
> >
>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2016020712.Z
> >
> > # Uncompress it
> > gunzip CMORPH_8KM-30MIN_2016020712.Z
> >
> > # Edit the ncl script you sent to list this input file name.
> >
> > # Run NCL to convert to NetCDF
> > ncl cmorph8km2nc.ncl
> >
> > # Plot the output NetCDF file
> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712.nc
> > CMORPH_8KM-30MIN_2016020712.ps 'name="CMORPH"; level="(0,*,*)";'
> >
> > # Convert image to png format
> > convert -rotate 90 -background white -flatten
> > CMORPH_8KM-30MIN_2016020712.ps CMORPH_8KM-30MIN_2016020712.png
> >
> > The resulting image is attached. You'll notice that the map is
> upside-down
> > and backwards. That's fine actually. I think the data is in the
correct
> > spot on the earth. And you can still use this in MET.
> >
> > We should probably update the logic in MET to detect this
situation and
> > flip the data after we read it. But you can still use it as is.
> >
> > met-5.1 supports automated regridding and also includes a tool
named
> > regrid_data_plane. Here's how you could run it on this data:
> >
> > # Regrid to a domain over India using budget interpolation
> > met-5.1/bin/regrid_data_plane CMORPH_8KM-30MIN_2016020712.nc
'latlon 200
> > 200 0 55 0.25 0.25' CMORPH_8KM-30MIN_2016020712_India.nc -field
> > 'name="CMORPH"; level="(0,*,*)";' -method BUDGET -width 2
> >
> > # Plot the result and convert to png
> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712_India.nc
> > CMORPH_8KM-30MIN_2016020712_India.ps 'name="CMORPH";
level="(*,*)";'
> > convert -rotate 90 -background white -flatten
> > CMORPH_8KM-30MIN_2016020712_India.ps
> CMORPH_8KM-30MIN_2016020712_India.png
> >
> > The resulting image is attached.
> >
> > Lastly, I imagine you're using this CMORPH data to compare to some
> forecast
> > output on a smaller domain. You don't even need to do that
regridding
> step
> > before using this data. Just pass the global NetCDF output from
the NCL
> > script to grid_stat or MODE (for example) and set up the "regrid"
section
> > of the configuration file like this:
> >
> > regrid = {
> > to_grid = FCST;
> > method = BUDGET;
> > width = 2;
> > vld_thresh = 0.5;
> > }
> >
> > Then Grid-Stat will read the forecast and observation data files
and
> > automatically regrid the CMORPH observation data to the domain of
your
> > forecast. Budget interpolation is typically recommended when
evaluating
> > precipitation.
> >
> > Hopefully that helps. Unfortunately, I don't have any suggestions
for
> > working with the older CMORPH data. I can tell you that the NCL
script
> > expects a very specific naming convention. So you could try
renaming the
> > older data to follow the newer naming convention.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> >
> >
> > On Wed, Feb 24, 2016 at 3:20 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Wed Feb 24 03:20:57 2016: Request 75238 was acted upon.
> > > Transaction: Ticket created by geeta124 at hotmail.com
> > > Queue: met_help
> > > Subject: Cmorph rainfall
> > > Owner: Nobody
> > > Requestors: geeta124 at hotmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238
> >
> > >
> > >
> > > Dear met_help.
> > > I have cmorph rainfall from the link
> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
> > >
> > > I have also downloaded the data for the past years. the files
are
> > > (attached)
> > > 1. CMORPH_8KM-30MIN_2015120112
;
> > > binary uncompressed
> > > 2. CMORPH_V0.x_RAW_8km-30min_2014060200
> > >
> > >
> > >
> > > You had given me a program that converts the binary file into NC
file
> > > (attached). When I run this program the NC files are created but
NOT
> > > plotted by NCL.
> > > I also plotted the NC files using ncview (attached)
> > > I tried to plot the nc outputs for the two dates (ie 2015120112
when
> NCL
> > > plots are generated and when the NCL is unable to generate the
plot
> > > 2014060200).
> > >
> > > I feel that there is some issue with the conversion of the
binary data
> to
> > > NETCDF.
> > >
> > >
> > > can u help me sort out this issue.
> > > Geeta
> > >
> > >
> > >
> >
>
>
------------------------------------------------
Subject: Cmorph rainfall
From: John Halley Gotway
Time: Thu Feb 25 09:53:38 2016
FYI, I've attached the output from my run of that ncl script which
produces
reasonable output.
Thanks,
John
On Thu, Feb 25, 2016 at 9:52 AM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Geeta,
>
> I see from the log message you sent that you're using the NCL script
to
> process a file named:
> CMORPH_V1.0_ADJ_8km-30min_2011042301
>
> The does not follow the precise naming convention the script
expects. The
> file names must look like this:
> CMORPH_8KM-30MIN_2015120112
>
> I don't have any suggestions for processing older CMORPH data which
> doesn't follow that naming convention.
>
> Thanks,
> John
>
>
> On Thu, Feb 25, 2016 at 9:36 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238 >
>>
>> Hi John. The program (cmorph8km2nc.ncl) converts the binary file
into NC.
>> I feel that is not done properly. Variable: filiType: stringTotal
Size: 4
>> bytes 1 valuesNumber of Dimensions: 1Dimensions and
sizes:
>> [1]Coordinates: (0) ./201104/CMORPH_V1.0_ADJ_8km-
30min_2011042301CDMS
>> error: Day-of-year error; month: 0
>> (0) min=-59.96361529599999 max=59.963614(0)
min=0.036378335
>> max=359.963619878(0) min=0 max=252
>> Variable: prcType: floatTotal Size: 32637008 bytes
8159252
>> valuesNumber of Dimensions: 3Dimensions and sizes: [time |
1] x [lat
>> | 1649] x [lon | 4948]Coordinates: time:
>> [2.121783591386373e-310..2.121783591386373e-310] lat:
>> [59.963614..-59.96361529599999] lon:
>> [0.036378335..359.963619878]Number Of Attributes: 3 units :
mm/hr
>> long_name : CMORPH 8km _FillValue : -9999(0)
CMORPH
>> 8km: min=0 max=50.4aditya at agniilap:~/geeta/ncl/CMORPH-L$ ls -lrt
>> *.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:09 CMORPH_8KM-
30MIN_
>> 2015120100.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:10
>> CMORPH_8KM-30MIN_2015120101.ncaditya at agniilap:~/geeta/ncl/CMORPH-L$
>> I feel that time dimension is not Okay. Can u pls suggest???geeta
>>
>> From: geeta124 at hotmail.com
>> To: met_help at ucar.edu
>> Subject: RE: [rt.rap.ucar.edu #75238] Cmorph rainfall
>> Date: Wed, 24 Feb 2016 23:26:51 +0530
>>
>>
>>
>>
>> thanks john. I have 8km rainfall data. 1. I could plot 2015 Dec
data both
>> ways (binary and when converted to NETCDF).
>> 2. for the 2011-April-23 00 UTC data, when I try to covert bin file
to NC
>> file, it gets converted without an issue. I want to plot 2011-april
(NC
>> file) to see if the plot is OKAY and hence data can be used by MET,
I run
>> into problems.
>> My plot is NOT OKAY. (just attaching two plots). The data is
downloaded
>> from ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
>> I am attaching my NCL code as well.
>> Geeta
>>
>> > Subject: Re: [rt.rap.ucar.edu #75238] Cmorph rainfall
>> > From: met_help at ucar.edu
>> > To: geeta124 at hotmail.com
>> > Date: Wed, 24 Feb 2016 09:29:27 -0700
>> >
>> > Geeta,
>> >
>> > I see you have some questions about using CMORPH data.
>> >
>> > Here are some commands I ran:
>> >
>> > # Pull a binary CMORPH file
>> > wget
>> >
>>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2016020712.Z
>> >
>> > # Uncompress it
>> > gunzip CMORPH_8KM-30MIN_2016020712.Z
>> >
>> > # Edit the ncl script you sent to list this input file name.
>> >
>> > # Run NCL to convert to NetCDF
>> > ncl cmorph8km2nc.ncl
>> >
>> > # Plot the output NetCDF file
>> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712.nc
>> > CMORPH_8KM-30MIN_2016020712.ps 'name="CMORPH"; level="(0,*,*)";'
>> >
>> > # Convert image to png format
>> > convert -rotate 90 -background white -flatten
>> > CMORPH_8KM-30MIN_2016020712.ps CMORPH_8KM-30MIN_2016020712.png
>> >
>> > The resulting image is attached. You'll notice that the map is
>> upside-down
>> > and backwards. That's fine actually. I think the data is in the
>> correct
>> > spot on the earth. And you can still use this in MET.
>> >
>> > We should probably update the logic in MET to detect this
situation and
>> > flip the data after we read it. But you can still use it as is.
>> >
>> > met-5.1 supports automated regridding and also includes a tool
named
>> > regrid_data_plane. Here's how you could run it on this data:
>> >
>> > # Regrid to a domain over India using budget interpolation
>> > met-5.1/bin/regrid_data_plane CMORPH_8KM-30MIN_2016020712.nc
'latlon
>> 200
>> > 200 0 55 0.25 0.25' CMORPH_8KM-30MIN_2016020712_India.nc -field
>> > 'name="CMORPH"; level="(0,*,*)";' -method BUDGET -width 2
>> >
>> > # Plot the result and convert to png
>> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712_India.nc
>> > CMORPH_8KM-30MIN_2016020712_India.ps 'name="CMORPH";
level="(*,*)";'
>> > convert -rotate 90 -background white -flatten
>> > CMORPH_8KM-30MIN_2016020712_India.ps CMORPH_8KM-30MIN_2016020712
>> _India.png
>> >
>> > The resulting image is attached.
>> >
>> > Lastly, I imagine you're using this CMORPH data to compare to
some
>> forecast
>> > output on a smaller domain. You don't even need to do that
regridding
>> step
>> > before using this data. Just pass the global NetCDF output from
the NCL
>> > script to grid_stat or MODE (for example) and set up the "regrid"
>> section
>> > of the configuration file like this:
>> >
>> > regrid = {
>> > to_grid = FCST;
>> > method = BUDGET;
>> > width = 2;
>> > vld_thresh = 0.5;
>> > }
>> >
>> > Then Grid-Stat will read the forecast and observation data files
and
>> > automatically regrid the CMORPH observation data to the domain of
your
>> > forecast. Budget interpolation is typically recommended when
evaluating
>> > precipitation.
>> >
>> > Hopefully that helps. Unfortunately, I don't have any
suggestions for
>> > working with the older CMORPH data. I can tell you that the NCL
script
>> > expects a very specific naming convention. So you could try
renaming
>> the
>> > older data to follow the newer naming convention.
>> >
>> > Thanks,
>> > John Halley Gotway
>> >
>> >
>> >
>> >
>> > On Wed, Feb 24, 2016 at 3:20 AM, Geeta Geeta via RT
<met_help at ucar.edu>
>> > wrote:
>> >
>> > >
>> > > Wed Feb 24 03:20:57 2016: Request 75238 was acted upon.
>> > > Transaction: Ticket created by geeta124 at hotmail.com
>> > > Queue: met_help
>> > > Subject: Cmorph rainfall
>> > > Owner: Nobody
>> > > Requestors: geeta124 at hotmail.com
>> > > Status: new
>> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238
>> >
>> > >
>> > >
>> > > Dear met_help.
>> > > I have cmorph rainfall from the link
>> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
>> > >
>> > > I have also downloaded the data for the past years. the files
are
>> > > (attached)
>> > > 1. CMORPH_8KM-30MIN_2015120112
;
>> > > binary uncompressed
>> > > 2. CMORPH_V0.x_RAW_8km-30min_2014060200
>> > >
>> > >
>> > >
>> > > You had given me a program that converts the binary file into
NC file
>> > > (attached). When I run this program the NC files are created
but NOT
>> > > plotted by NCL.
>> > > I also plotted the NC files using ncview (attached)
>> > > I tried to plot the nc outputs for the two dates (ie 2015120112
when
>> NCL
>> > > plots are generated and when the NCL is unable to generate the
plot
>> > > 2014060200).
>> > >
>> > > I feel that there is some issue with the conversion of the
binary
>> data to
>> > > NETCDF.
>> > >
>> > >
>> > > can u help me sort out this issue.
>> > > Geeta
>> > >
>> > >
>> > >
>> >
>>
>>
>
------------------------------------------------
Subject: Cmorph rainfall
From: Geeta Geeta
Time: Thu Feb 25 23:22:46 2016
thanks again John.
I am running into problems when I use data of some past years say,
2011april23, 00 UTC (file attached). this time I have changed the
file name of the file, (i.e original file name from
CMORPH_V1.0_ADJ_8km-30min_2011042300 CMORPH_8KM-
30MIN_2011042300)and then run the ncl script (cmorph8km2nc.ncl).
I got the nc file
[mcbng at localhost CMORPH-CentOS]$ ls -l CMORPH*_2011042300*
-rw-r--r-- 1 mcbng mcbng 65274016 Feb 26 11:03 CMORPH_8KM-
30MIN_2011042300
-rw-rw-r-- 1 mcbng mcbng 32690904 Feb 26 11:11 CMORPH_8KM-
30MIN_2011042300.nc
-rw-r--r-- 1 mcbng mcbng 65274016 Feb 26 11:02 CMORPH_V1.0_ADJ_8km-
30min_2011042300
but had another file called missing.nc (attached)
-rw-rw-r-- 1 mcbng mcbng 32690904 Feb 24 15:32 CMORPH_8KM-
30MIN_2015120112.nc
-rw-rw-r-- 1 mcbng mcbng 32690936 Feb 26 11:10 advt-8km-interp-prim-
sat-spat-2lag-2.5+5dovlp8kmIR-2015042312.nc
-rw-rw-r-- 1 mcbng mcbng 53788 Feb 26 11:11 missing.nc
I
run into problems with any file other than Nov and Dec 2015. I tried
with 2011042300 I get the same
image (attached). Also while generating the netcdf file, I also get
another file called "missing.nc" which is also attached
Pls ignore the title in the image.
even 23April2015 also I have the same issue (data file of 2015042300
is attached)
Geeta
> Subject: Re: [rt.rap.ucar.edu #75238] Cmorph rainfall
> From: met_help at ucar.edu
> To: geeta124 at hotmail.com
> Date: Thu, 25 Feb 2016 09:53:39 -0700
>
> FYI, I've attached the output from my run of that ncl script which
produces
> reasonable output.
>
> Thanks,
> John
>
> On Thu, Feb 25, 2016 at 9:52 AM, John Halley Gotway
<johnhg at ucar.edu> wrote:
>
> > Geeta,
> >
> > I see from the log message you sent that you're using the NCL
script to
> > process a file named:
> > CMORPH_V1.0_ADJ_8km-30min_2011042301
> >
> > The does not follow the precise naming convention the script
expects. The
> > file names must look like this:
> > CMORPH_8KM-30MIN_2015120112
> >
> > I don't have any suggestions for processing older CMORPH data
which
> > doesn't follow that naming convention.
> >
> > Thanks,
> > John
> >
> >
> > On Thu, Feb 25, 2016 at 9:36 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238 >
> >>
> >> Hi John. The program (cmorph8km2nc.ncl) converts the binary file
into NC.
> >> I feel that is not done properly. Variable: filiType: stringTotal
Size: 4
> >> bytes 1 valuesNumber of Dimensions: 1Dimensions and
sizes:
> >> [1]Coordinates: (0) ./201104/CMORPH_V1.0_ADJ_8km-
30min_2011042301CDMS
> >> error: Day-of-year error; month: 0
> >> (0) min=-59.96361529599999 max=59.963614(0)
min=0.036378335
> >> max=359.963619878(0) min=0 max=252
> >> Variable: prcType: floatTotal Size: 32637008 bytes
8159252
> >> valuesNumber of Dimensions: 3Dimensions and sizes: [time |
1] x [lat
> >> | 1649] x [lon | 4948]Coordinates: time:
> >> [2.121783591386373e-310..2.121783591386373e-310] lat:
> >> [59.963614..-59.96361529599999] lon:
> >> [0.036378335..359.963619878]Number Of Attributes: 3 units :
mm/hr
> >> long_name : CMORPH 8km _FillValue : -9999(0)
CMORPH
> >> 8km: min=0 max=50.4aditya at agniilap:~/geeta/ncl/CMORPH-L$ ls
-lrt
> >> *.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:09 CMORPH_8KM-
30MIN_
> >> 2015120100.nc-rw-rw-r-- 1 aditya aditya 32690904 Feb 20 22:10
> >> CMORPH_8KM-30MIN_2015120101.ncaditya at agniilap:~/geeta/ncl/CMORPH-
L$
> >> I feel that time dimension is not Okay. Can u pls suggest???geeta
> >>
> >> From: geeta124 at hotmail.com
> >> To: met_help at ucar.edu
> >> Subject: RE: [rt.rap.ucar.edu #75238] Cmorph rainfall
> >> Date: Wed, 24 Feb 2016 23:26:51 +0530
> >>
> >>
> >>
> >>
> >> thanks john. I have 8km rainfall data. 1. I could plot 2015 Dec
data both
> >> ways (binary and when converted to NETCDF).
> >> 2. for the 2011-April-23 00 UTC data, when I try to covert bin
file to NC
> >> file, it gets converted without an issue. I want to plot 2011-
april (NC
> >> file) to see if the plot is OKAY and hence data can be used by
MET, I run
> >> into problems.
> >> My plot is NOT OKAY. (just attaching two plots). The data is
downloaded
> >> from ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
> >> I am attaching my NCL code as well.
> >> Geeta
> >>
> >> > Subject: Re: [rt.rap.ucar.edu #75238] Cmorph rainfall
> >> > From: met_help at ucar.edu
> >> > To: geeta124 at hotmail.com
> >> > Date: Wed, 24 Feb 2016 09:29:27 -0700
> >> >
> >> > Geeta,
> >> >
> >> > I see you have some questions about using CMORPH data.
> >> >
> >> > Here are some commands I ran:
> >> >
> >> > # Pull a binary CMORPH file
> >> > wget
> >> >
> >>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2016020712.Z
> >> >
> >> > # Uncompress it
> >> > gunzip CMORPH_8KM-30MIN_2016020712.Z
> >> >
> >> > # Edit the ncl script you sent to list this input file name.
> >> >
> >> > # Run NCL to convert to NetCDF
> >> > ncl cmorph8km2nc.ncl
> >> >
> >> > # Plot the output NetCDF file
> >> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2016020712.nc
> >> > CMORPH_8KM-30MIN_2016020712.ps 'name="CMORPH";
level="(0,*,*)";'
> >> >
> >> > # Convert image to png format
> >> > convert -rotate 90 -background white -flatten
> >> > CMORPH_8KM-30MIN_2016020712.ps CMORPH_8KM-30MIN_2016020712.png
> >> >
> >> > The resulting image is attached. You'll notice that the map is
> >> upside-down
> >> > and backwards. That's fine actually. I think the data is in
the
> >> correct
> >> > spot on the earth. And you can still use this in MET.
> >> >
> >> > We should probably update the logic in MET to detect this
situation and
> >> > flip the data after we read it. But you can still use it as
is.
> >> >
> >> > met-5.1 supports automated regridding and also includes a tool
named
> >> > regrid_data_plane. Here's how you could run it on this data:
> >> >
> >> > # Regrid to a domain over India using budget interpolation
> >> > met-5.1/bin/regrid_data_plane CMORPH_8KM-30MIN_2016020712.nc
'latlon
> >> 200
> >> > 200 0 55 0.25 0.25' CMORPH_8KM-30MIN_2016020712_India.nc -field
> >> > 'name="CMORPH"; level="(0,*,*)";' -method BUDGET -width 2
> >> >
> >> > # Plot the result and convert to png
> >> > met-5.1/bin/plot_data_plane CMORPH_8KM-
30MIN_2016020712_India.nc
> >> > CMORPH_8KM-30MIN_2016020712_India.ps 'name="CMORPH";
level="(*,*)";'
> >> > convert -rotate 90 -background white -flatten
> >> > CMORPH_8KM-30MIN_2016020712_India.ps CMORPH_8KM-
30MIN_2016020712
> >> _India.png
> >> >
> >> > The resulting image is attached.
> >> >
> >> > Lastly, I imagine you're using this CMORPH data to compare to
some
> >> forecast
> >> > output on a smaller domain. You don't even need to do that
regridding
> >> step
> >> > before using this data. Just pass the global NetCDF output
from the NCL
> >> > script to grid_stat or MODE (for example) and set up the
"regrid"
> >> section
> >> > of the configuration file like this:
> >> >
> >> > regrid = {
> >> > to_grid = FCST;
> >> > method = BUDGET;
> >> > width = 2;
> >> > vld_thresh = 0.5;
> >> > }
> >> >
> >> > Then Grid-Stat will read the forecast and observation data
files and
> >> > automatically regrid the CMORPH observation data to the domain
of your
> >> > forecast. Budget interpolation is typically recommended when
evaluating
> >> > precipitation.
> >> >
> >> > Hopefully that helps. Unfortunately, I don't have any
suggestions for
> >> > working with the older CMORPH data. I can tell you that the
NCL script
> >> > expects a very specific naming convention. So you could try
renaming
> >> the
> >> > older data to follow the newer naming convention.
> >> >
> >> > Thanks,
> >> > John Halley Gotway
> >> >
> >> >
> >> >
> >> >
> >> > On Wed, Feb 24, 2016 at 3:20 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> >> > wrote:
> >> >
> >> > >
> >> > > Wed Feb 24 03:20:57 2016: Request 75238 was acted upon.
> >> > > Transaction: Ticket created by geeta124 at hotmail.com
> >> > > Queue: met_help
> >> > > Subject: Cmorph rainfall
> >> > > Owner: Nobody
> >> > > Requestors: geeta124 at hotmail.com
> >> > > Status: new
> >> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75238
> >> >
> >> > >
> >> > >
> >> > > Dear met_help.
> >> > > I have cmorph rainfall from the link
> >> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/
> >> > >
> >> > > I have also downloaded the data for the past years. the files
are
> >> > > (attached)
> >> > > 1. CMORPH_8KM-30MIN_2015120112
;
> >> > > binary uncompressed
> >> > > 2. CMORPH_V0.x_RAW_8km-30min_2014060200
> >> > >
> >> > >
> >> > >
> >> > > You had given me a program that converts the binary file into
NC file
> >> > > (attached). When I run this program the NC files are created
but NOT
> >> > > plotted by NCL.
> >> > > I also plotted the NC files using ncview (attached)
> >> > > I tried to plot the nc outputs for the two dates (ie
2015120112 when
> >> NCL
> >> > > plots are generated and when the NCL is unable to generate
the plot
> >> > > 2014060200).
> >> > >
> >> > > I feel that there is some issue with the conversion of the
binary
> >> data to
> >> > > NETCDF.
> >> > >
> >> > >
> >> > > can u help me sort out this issue.
> >> > > Geeta
> >> > >
> >> > >
> >> > >
> >> >
> >>
> >>
> >
>
------------------------------------------------
More information about the Met_help
mailing list