[Met_help] [rt.rap.ucar.edu #74240] History for handling CMORPH data
Julie Prestopnik via RT
met_help at ucar.edu
Wed Feb 10 09:38:37 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi met_help. I have to verify the model data with the CMORPH data.
what all data conversions I have to do in order to achieve the same.
Geeta
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: handling CMORPH data
From: Julie Prestopnik
Time: Tue Dec 01 11:23:49 2015
Hi Geeta.
We were able to pull a CMORPH file following this naming convention:
YYYYMMDD_3hr-025deg_cpc+comb
from this location:
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
and convert it to a grib format that you can use with MET.
I have attached the scripts that we used to convert the file. You
will
need "ncl" and "cdo" to run the scripts. In the cmorph2grib.ksh
script,
please note that we have the following lines:
NCL=/usr/local/ncl/bin/ncl
CDO=/usr/local/cdo/bin/cdo
If "ncl" and "cdo" are not in those locations on your machine, please
modify the locations in the script to match the location on your
machine.
The scripts will only work on the data following in the naming
convention
and from the location listed above. However, this README indicates
that
things are changing:
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
I hope this helps!
Julie
On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT <met_help at ucar.edu>
wrote:
>
> Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> Transaction: Ticket created by geeta124 at hotmail.com
> Queue: met_help
> Subject: handling CMORPH data
> Owner: Nobody
> Requestors: geeta124 at hotmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
>
>
> Hi met_help. I have to verify the model data with the CMORPH data.
> what all data conversions I have to do in order to achieve the same.
> Geeta
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: handling CMORPH data
From: Geeta Geeta
Time: Fri Dec 18 01:46:40 2015
Hi Julie. I was unable to convert the CMORPH data at 8 km resolution.
Kindly guide further.
Geeta
> Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> From: met_help at ucar.edu
> To: geeta124 at hotmail.com
> Date: Tue, 1 Dec 2015 11:23:50 -0700
>
> Hi Geeta.
>
> We were able to pull a CMORPH file following this naming convention:
>
> YYYYMMDD_3hr-025deg_cpc+comb
>
> from this location:
>
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
>
> and convert it to a grib format that you can use with MET.
>
> I have attached the scripts that we used to convert the file. You
will
> need "ncl" and "cdo" to run the scripts. In the cmorph2grib.ksh
script,
> please note that we have the following lines:
>
> NCL=/usr/local/ncl/bin/ncl
> CDO=/usr/local/cdo/bin/cdo
>
> If "ncl" and "cdo" are not in those locations on your machine,
please
> modify the locations in the script to match the location on your
machine.
>
> The scripts will only work on the data following in the naming
convention
> and from the location listed above. However, this README indicates
that
> things are changing:
>
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
>
> I hope this helps!
>
> Julie
>
> On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > Transaction: Ticket created by geeta124 at hotmail.com
> > Queue: met_help
> > Subject: handling CMORPH data
> > Owner: Nobody
> > Requestors: geeta124 at hotmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> >
> >
> > Hi met_help. I have to verify the model data with the CMORPH data.
> > what all data conversions I have to do in order to achieve the
same.
> > Geeta
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
------------------------------------------------
Subject: handling CMORPH data
From: Julie Prestopnik
Time: Fri Dec 18 10:12:45 2015
Hi Geeta.
I see that you are having trouble converting the CMORPH data. Did
your
file follow this naming convention:
YYYYMMDD_3hr-025deg_cpc+comb
and was it from the following location?
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
Can you please pass on the command that you ran and the output that
you
received from cmorph2grib.ksh?
Thanks,
Julie
On Fri, Dec 18, 2015 at 1:46 AM, Geeta Geeta via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
>
> Hi Julie. I was unable to convert the CMORPH data at 8 km
resolution.
> Kindly guide further.
>
> Geeta
>
> > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > From: met_help at ucar.edu
> > To: geeta124 at hotmail.com
> > Date: Tue, 1 Dec 2015 11:23:50 -0700
> >
> > Hi Geeta.
> >
> > We were able to pull a CMORPH file following this naming
convention:
> >
> > YYYYMMDD_3hr-025deg_cpc+comb
> >
> > from this location:
> >
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
> >
> > and convert it to a grib format that you can use with MET.
> >
> > I have attached the scripts that we used to convert the file. You
will
> > need "ncl" and "cdo" to run the scripts. In the cmorph2grib.ksh
script,
> > please note that we have the following lines:
> >
> > NCL=/usr/local/ncl/bin/ncl
> > CDO=/usr/local/cdo/bin/cdo
> >
> > If "ncl" and "cdo" are not in those locations on your machine,
please
> > modify the locations in the script to match the location on your
machine.
> >
> > The scripts will only work on the data following in the naming
convention
> > and from the location listed above. However, this README
indicates that
> > things are changing:
> >
> >
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
> >
> > I hope this helps!
> >
> > Julie
> >
> > On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > > Transaction: Ticket created by geeta124 at hotmail.com
> > > Queue: met_help
> > > Subject: handling CMORPH data
> > > Owner: Nobody
> > > Requestors: geeta124 at hotmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
> >
> > >
> > >
> > > Hi met_help. I have to verify the model data with the CMORPH
data.
> > > what all data conversions I have to do in order to achieve the
same.
> > > Geeta
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: handling CMORPH data
From: Geeta Geeta
Time: Sun Dec 20 05:12:21 2015
Thanks Julie. I am downloading the data from the following address
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
I have files for each hour -rw-r--r-- 1 aditya aditya 48955512 Dec 1
19:33 CMORPH_8KM-30MIN_2015113013-rw-r--r-- 1 aditya aditya 48955512
Dec 1 19:33 CMORPH_8KM-30MIN_2015113014-rw-r--r-- 1 aditya aditya
48955512 Dec 1 19:33 CMORPH_8KM-30MIN_2015113015-rw-r--r-- 1 aditya
aditya 48955512 Dec 1 19:33 CMORPH_8KM-30MIN_2015113016-rw-r--r-- 1
aditya aditya 48955512 Dec 1 19:33 CMORPH_8KM-30MIN_2015113017-rw-r--
r-- 1 aditya aditya 48955512 Dec 1 19:33 CMORPH_8KM-30MIN_2015113018-
rw-r--r-- 1 aditya aditya 48955512 Dec 1 19:33 CMORPH_8KM-
30MIN_2015113019-rw-r--r-- 1 aditya aditya 48955512 Dec 1 19:33
CMORPH_8KM-30MIN_2015113020-rw-r--r-- 1 aditya aditya 48955512 Dec 1
19:33 CMORPH_8KM-30MIN_2015113021-rw-r--r-- 1 aditya aditya 48955512
Dec 1 19:33 CMORPH_8KM-30MIN_2015113022-rw-r--r-- 1 aditya aditya
48955512 Dec 1 19:33 CMORPH_8KM-30MIN_2015113023
These are binary files.
aditya at agniilap:~/geeta/ncl/CMORPH$ file CMORPH_8KM-30MIN_2015113023
CMORPH_8KM-30MIN_2015113023: data
I edited the ncl path in the ksh script. and run the ksh script given
by you. aditya at agniilap:~/geeta/ncl/CMORPH$ ./cmorph2grib.ksh
CMORPH_8KM-30MIN_2015113023 >outls: cannot access CMORPH_8KM-
30MIN_2015113023.nc: No such file or directory
aditya at agniilap:~/geeta/ncl/bin$ lscgm2ncgm ncargex
ncl.xq.fix rassplitConvertMapData ncargf77 ng4ex
rasstatctlib ncargf90 nhlcc
rasviewctrans ncargfile nhlf77
scr1.nclESMF_RegridWeightGen ncargpath nhlf90
scrip_check_inputezmapdemo ncargrun nnalg
tdpackdemofcaps ncargversion pre2ncgm
tgks0afindg ncargworld pre2ncgm.prog tlocalfontc
ncarlogo2ps psblack WRAPITgcaps
ncarvversion psplit wrapit77graphc ncgm2cgm
pswhite WriteLineFileictrans ncgmstat
pwritxnt WriteNameFileidt ncl
ras2ccir601 WritePlotcharDataMakeNcl ncl_convert2nc
rascatmed ncl_filedump rasgetpalncargcc
ncl_grib2nc raslsaditya at agniilap:~/geeta/ncl/bin$ echo $NCARG_ROOT
/home/aditya/geeta/ncl
I am sending you the modified script and the out message from ksh
script.
Would be waiting for your suggestions.
Geeta
> Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> From: met_help at ucar.edu
> To: geeta124 at hotmail.com
> Date: Fri, 18 Dec 2015 10:12:45 -0700
>
> Hi Geeta.
>
> I see that you are having trouble converting the CMORPH data. Did
your
> file follow this naming convention:
>
> YYYYMMDD_3hr-025deg_cpc+comb
>
> and was it from the following location?
>
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
>
> Can you please pass on the command that you ran and the output that
you
> received from cmorph2grib.ksh?
>
> Thanks,
> Julie
>
>
> On Fri, Dec 18, 2015 at 1:46 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> >
> > Hi Julie. I was unable to convert the CMORPH data at 8 km
resolution.
> > Kindly guide further.
> >
> > Geeta
> >
> > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > From: met_help at ucar.edu
> > > To: geeta124 at hotmail.com
> > > Date: Tue, 1 Dec 2015 11:23:50 -0700
> > >
> > > Hi Geeta.
> > >
> > > We were able to pull a CMORPH file following this naming
convention:
> > >
> > > YYYYMMDD_3hr-025deg_cpc+comb
> > >
> > > from this location:
> > >
> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/
> > >
> > > and convert it to a grib format that you can use with MET.
> > >
> > > I have attached the scripts that we used to convert the file.
You will
> > > need "ncl" and "cdo" to run the scripts. In the cmorph2grib.ksh
script,
> > > please note that we have the following lines:
> > >
> > > NCL=/usr/local/ncl/bin/ncl
> > > CDO=/usr/local/cdo/bin/cdo
> > >
> > > If "ncl" and "cdo" are not in those locations on your machine,
please
> > > modify the locations in the script to match the location on your
machine.
> > >
> > > The scripts will only work on the data following in the naming
convention
> > > and from the location listed above. However, this README
indicates that
> > > things are changing:
> > >
> > >
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
> > >
> > > I hope this helps!
> > >
> > > Julie
> > >
> > > On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > > > Transaction: Ticket created by geeta124 at hotmail.com
> > > > Queue: met_help
> > > > Subject: handling CMORPH data
> > > > Owner: Nobody
> > > > Requestors: geeta124 at hotmail.com
> > > > Status: new
> > > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
> > >
> > > >
> > > >
> > > > Hi met_help. I have to verify the model data with the CMORPH
data.
> > > > what all data conversions I have to do in order to achieve the
same.
> > > > Geeta
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
------------------------------------------------
Subject: handling CMORPH data
From: John Halley Gotway
Time: Mon Dec 21 15:30:18 2015
Hello Geeta,
Julie asked me to take a look at this. I see that you're using the
hourly
CMORPH 8km data. I was able to combine some of two different NCL
scripts
to read this data and write it to NetCDF:
https://www.ncl.ucar.edu/Applications/Scripts/cmorph_3.ncl
https://www.ncl.ucar.edu/Applications/Scripts/cmorph_4.ncl
I've attached the resulting script, named cmorph8km2nc.ncl. Try
running
the following commands:
wget
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2015122012.Z
gunzip CMORPH_8KM-30MIN_2015122012.Z
ncl 'in="CMORPH_8KM-30MIN_2015122012"' cmorph8km2nc.ncl
met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2015122012.nc
CMORPH_8KM-30MIN_2015122012.ps 'name="CMORPH"; level="(0,*,*)";'
I converted the PostScript output to png format and attached it here.
As
you can see, the world is upside down and backwards. But at least MET
can
read it. I did try to run a cdo command to produce GRIB output but
wasn't
successful. Perhaps the size of the data is too large for CDO to
handle?
I'll leave it to you to confirm that this data is correct and to
decide how
you'd like to proceed. Hopefully this provides a good starting point.
Thanks,
John
On Sun, Dec 20, 2015 at 5:12 AM, Geeta Geeta via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
>
>
>
>
> Thanks Julie. I am downloading the data from the following address
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
> I have files for each hour -rw-r--r-- 1 aditya aditya 48955512 Dec
1
> 19:33 CMORPH_8KM-30MIN_2015113013-rw-r--r-- 1 aditya aditya 48955512
Dec
> 1 19:33 CMORPH_8KM-30MIN_2015113014-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113015-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113016-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113017-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113018-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113019-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113020-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113021-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113022-rw-r--r-- 1 aditya aditya
48955512
> Dec 1 19:33 CMORPH_8KM-30MIN_2015113023
>
> These are binary files.
> aditya at agniilap:~/geeta/ncl/CMORPH$ file CMORPH_8KM-30MIN_2015113023
> CMORPH_8KM-30MIN_2015113023: data
>
> I edited the ncl path in the ksh script. and run the ksh script
given by
> you. aditya at agniilap:~/geeta/ncl/CMORPH$ ./cmorph2grib.ksh
> CMORPH_8KM-30MIN_2015113023 >outls: cannot access CMORPH_8KM-30MIN_
> 2015113023.nc: No such file or directory
> aditya at agniilap:~/geeta/ncl/bin$ lscgm2ncgm ncargex
> ncl.xq.fix rassplitConvertMapData ncargf77 ng4ex
> rasstatctlib ncargf90 nhlcc
> rasviewctrans ncargfile nhlf77
> scr1.nclESMF_RegridWeightGen ncargpath nhlf90
> scrip_check_inputezmapdemo ncargrun nnalg
> tdpackdemofcaps ncargversion pre2ncgm
tgks0afindg
> ncargworld pre2ncgm.prog tlocalfontc
> ncarlogo2ps psblack WRAPITgcaps
ncarvversion
> psplit wrapit77graphc ncgm2cgm pswhite
> WriteLineFileictrans ncgmstat pwritxnt
> WriteNameFileidt ncl ras2ccir601
> WritePlotcharDataMakeNcl ncl_convert2nc rascatmed
> ncl_filedump rasgetpalncargcc ncl_grib2nc
> raslsadity!
> a at agniilap:~/geeta/ncl/bin$ echo $NCARG_ROOT /home/aditya/geeta/ncl
> I am sending you the modified script and the out message from ksh
script.
> Would be waiting for your suggestions.
> Geeta
>
> > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > From: met_help at ucar.edu
> > To: geeta124 at hotmail.com
> > Date: Fri, 18 Dec 2015 10:12:45 -0700
> >
> > Hi Geeta.
> >
> > I see that you are having trouble converting the CMORPH data. Did
your
> > file follow this naming convention:
> >
> > YYYYMMDD_3hr-025deg_cpc+comb
> >
> > and was it from the following location?
> >
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
> >
> > Can you please pass on the command that you ran and the output
that you
> > received from cmorph2grib.ksh?
> >
> > Thanks,
> > Julie
> >
> >
> > On Fri, Dec 18, 2015 at 1:46 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> > >
> > > Hi Julie. I was unable to convert the CMORPH data at 8 km
resolution.
> > > Kindly guide further.
> > >
> > > Geeta
> > >
> > > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > > From: met_help at ucar.edu
> > > > To: geeta124 at hotmail.com
> > > > Date: Tue, 1 Dec 2015 11:23:50 -0700
> > > >
> > > > Hi Geeta.
> > > >
> > > > We were able to pull a CMORPH file following this naming
convention:
> > > >
> > > > YYYYMMDD_3hr-025deg_cpc+comb
> > > >
> > > > from this location:
> > > >
> > > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/
> > > >
> > > > and convert it to a grib format that you can use with MET.
> > > >
> > > > I have attached the scripts that we used to convert the file.
You
> will
> > > > need "ncl" and "cdo" to run the scripts. In the
cmorph2grib.ksh
> script,
> > > > please note that we have the following lines:
> > > >
> > > > NCL=/usr/local/ncl/bin/ncl
> > > > CDO=/usr/local/cdo/bin/cdo
> > > >
> > > > If "ncl" and "cdo" are not in those locations on your machine,
please
> > > > modify the locations in the script to match the location on
your
> machine.
> > > >
> > > > The scripts will only work on the data following in the naming
> convention
> > > > and from the location listed above. However, this README
indicates
> that
> > > > things are changing:
> > > >
> > > >
> > >
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
> > > >
> > > > I hope this helps!
> > > >
> > > > Julie
> > > >
> > > > On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT <
> met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > > > > Transaction: Ticket created by geeta124 at hotmail.com
> > > > > Queue: met_help
> > > > > Subject: handling CMORPH data
> > > > > Owner: Nobody
> > > > > Requestors: geeta124 at hotmail.com
> > > > > Status: new
> > > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
> > > >
> > > > >
> > > > >
> > > > > Hi met_help. I have to verify the model data with the CMORPH
data.
> > > > > what all data conversions I have to do in order to achieve
the
> same.
> > > > > Geeta
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
>
------------------------------------------------
Subject: handling CMORPH data
From: Geeta Geeta
Time: Wed Jan 13 03:53:30 2016
hi John. sorry for reverting back so late. I have tried the
command.........
aditya at agniilap:~/geeta/ncl/CMORPH$ ../bin/ncl 'in = "CMORPH_8KM-
30MIN_2015120100"' cmorph8km2nc.ncl
~/geeta/installs/met/bin/plot_data_plane CMORPH_8KM-
30MIN_2015120100.nc CMORPH_8km-30MIN_2015120100.ps 'name = "CMORPH" ;
level = "(0,*,*)"' Copyright (C) 1995-2014 - All Rights Reserved
University Corporation for Atmospheric Research NCAR Command Language
Version 6.2.1 The use of this software is governed by a License
Agreement. See http://www.ncl.ucar.edu/ for more details.fatal: can't
find file "CMORPH_8KM-30MIN_2015120100.nc"
I have edited the the script sent by you. diri =
systemfunc("~/geeta/ncl/CMORPH "+in) ; input
directory fili = systemfunc("CMORPH_8KM-30MIN_2015120100 "+in)
; binary uncompressed pthi = diri+"/"+fili
; OUTPUT ncDir = "./" ;
directory for netCDF output ncFil = fili + ".nc"
; netCDF name output
;;setfileoption("bin","ReadByteOrder","BigEndian") ; *not*
needed; input are type byte
dlim = "_-" ; string
delimiter nfld = str_fields_count(fili, dlim) ;
nfld=4
ymdh = toint(str_get_field(fili, 4, dlim)) can u pls
suggest???
> Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> From: met_help at ucar.edu
> To: geeta124 at hotmail.com
> Date: Mon, 21 Dec 2015 15:30:19 -0700
>
> Hello Geeta,
>
> Julie asked me to take a look at this. I see that you're using the
hourly
> CMORPH 8km data. I was able to combine some of two different NCL
scripts
> to read this data and write it to NetCDF:
> https://www.ncl.ucar.edu/Applications/Scripts/cmorph_3.ncl
> https://www.ncl.ucar.edu/Applications/Scripts/cmorph_4.ncl
>
> I've attached the resulting script, named cmorph8km2nc.ncl. Try
running
> the following commands:
>
> wget
>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2015122012.Z
> gunzip CMORPH_8KM-30MIN_2015122012.Z
> ncl 'in="CMORPH_8KM-30MIN_2015122012"' cmorph8km2nc.ncl
> met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2015122012.nc
> CMORPH_8KM-30MIN_2015122012.ps 'name="CMORPH"; level="(0,*,*)";'
>
> I converted the PostScript output to png format and attached it
here. As
> you can see, the world is upside down and backwards. But at least
MET can
> read it. I did try to run a cdo command to produce GRIB output but
wasn't
> successful. Perhaps the size of the data is too large for CDO to
handle?
>
> I'll leave it to you to confirm that this data is correct and to
decide how
> you'd like to proceed. Hopefully this provides a good starting
point.
>
> Thanks,
> John
>
> On Sun, Dec 20, 2015 at 5:12 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> >
> >
> >
> >
> > Thanks Julie. I am downloading the data from the following address
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
> > I have files for each hour -rw-r--r-- 1 aditya aditya 48955512 Dec
1
> > 19:33 CMORPH_8KM-30MIN_2015113013-rw-r--r-- 1 aditya aditya
48955512 Dec
> > 1 19:33 CMORPH_8KM-30MIN_2015113014-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113015-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113016-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113017-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113018-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113019-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113020-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113021-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113022-rw-r--r-- 1 aditya aditya
48955512
> > Dec 1 19:33 CMORPH_8KM-30MIN_2015113023
> >
> > These are binary files.
> > aditya at agniilap:~/geeta/ncl/CMORPH$ file CMORPH_8KM-
30MIN_2015113023
> > CMORPH_8KM-30MIN_2015113023: data
> >
> > I edited the ncl path in the ksh script. and run the ksh script
given by
> > you. aditya at agniilap:~/geeta/ncl/CMORPH$ ./cmorph2grib.ksh
> > CMORPH_8KM-30MIN_2015113023 >outls: cannot access CMORPH_8KM-
30MIN_
> > 2015113023.nc: No such file or directory
> > aditya at agniilap:~/geeta/ncl/bin$ lscgm2ncgm ncargex
> > ncl.xq.fix rassplitConvertMapData ncargf77
ng4ex
> > rasstatctlib ncargf90 nhlcc
> > rasviewctrans ncargfile nhlf77
> > scr1.nclESMF_RegridWeightGen ncargpath nhlf90
> > scrip_check_inputezmapdemo ncargrun nnalg
> > tdpackdemofcaps ncargversion pre2ncgm
tgks0afindg
> > ncargworld pre2ncgm.prog tlocalfontc
> > ncarlogo2ps psblack WRAPITgcaps
ncarvversion
> > psplit wrapit77graphc ncgm2cgm
pswhite
> > WriteLineFileictrans ncgmstat pwritxnt
> > WriteNameFileidt ncl ras2ccir601
> > WritePlotcharDataMakeNcl ncl_convert2nc rascatmed
> > ncl_filedump rasgetpalncargcc ncl_grib2nc
> > raslsadity!
> > a at agniilap:~/geeta/ncl/bin$ echo $NCARG_ROOT
/home/aditya/geeta/ncl
> > I am sending you the modified script and the out message from ksh
script.
> > Would be waiting for your suggestions.
> > Geeta
> >
> > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > From: met_help at ucar.edu
> > > To: geeta124 at hotmail.com
> > > Date: Fri, 18 Dec 2015 10:12:45 -0700
> > >
> > > Hi Geeta.
> > >
> > > I see that you are having trouble converting the CMORPH data.
Did your
> > > file follow this naming convention:
> > >
> > > YYYYMMDD_3hr-025deg_cpc+comb
> > >
> > > and was it from the following location?
> > >
> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/
> > >
> > > Can you please pass on the command that you ran and the output
that you
> > > received from cmorph2grib.ksh?
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Fri, Dec 18, 2015 at 1:46 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
>
> > > >
> > > > Hi Julie. I was unable to convert the CMORPH data at 8 km
resolution.
> > > > Kindly guide further.
> > > >
> > > > Geeta
> > > >
> > > > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > > > From: met_help at ucar.edu
> > > > > To: geeta124 at hotmail.com
> > > > > Date: Tue, 1 Dec 2015 11:23:50 -0700
> > > > >
> > > > > Hi Geeta.
> > > > >
> > > > > We were able to pull a CMORPH file following this naming
convention:
> > > > >
> > > > > YYYYMMDD_3hr-025deg_cpc+comb
> > > > >
> > > > > from this location:
> > > > >
> > > > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/
> > > > >
> > > > > and convert it to a grib format that you can use with MET.
> > > > >
> > > > > I have attached the scripts that we used to convert the
file. You
> > will
> > > > > need "ncl" and "cdo" to run the scripts. In the
cmorph2grib.ksh
> > script,
> > > > > please note that we have the following lines:
> > > > >
> > > > > NCL=/usr/local/ncl/bin/ncl
> > > > > CDO=/usr/local/cdo/bin/cdo
> > > > >
> > > > > If "ncl" and "cdo" are not in those locations on your
machine, please
> > > > > modify the locations in the script to match the location on
your
> > machine.
> > > > >
> > > > > The scripts will only work on the data following in the
naming
> > convention
> > > > > and from the location listed above. However, this README
indicates
> > that
> > > > > things are changing:
> > > > >
> > > > >
> > > >
> > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
> > > > >
> > > > > I hope this helps!
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT <
> > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > > > > > Transaction: Ticket created by geeta124 at hotmail.com
> > > > > > Queue: met_help
> > > > > > Subject: handling CMORPH data
> > > > > > Owner: Nobody
> > > > > > Requestors: geeta124 at hotmail.com
> > > > > > Status: new
> > > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
> > > > >
> > > > > >
> > > > > >
> > > > > > Hi met_help. I have to verify the model data with the
CMORPH data.
> > > > > > what all data conversions I have to do in order to achieve
the
> > same.
> > > > > > Geeta
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> >
> >
> >
>
------------------------------------------------
Subject: handling CMORPH data
From: John Halley Gotway
Time: Tue Jan 19 11:08:08 2016
Geeta,
Looks like the relevant error in the output you sent me is this:
fatal: can't find file "CMORPH_8KM-30MIN_2015120100.nc"
Based on the information you sent me. I have no suggestions. I think
you'll need to debug this issue on your end.
John
On Wed, Jan 13, 2016 at 3:53 AM, Geeta Geeta via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
>
> hi John. sorry for reverting back so late. I have tried the
> command.........
> aditya at agniilap:~/geeta/ncl/CMORPH$ ../bin/ncl 'in = "CMORPH_8KM-
30MIN_
> 2015120100"' cmorph8km2nc.ncl
~/geeta/installs/met/bin/plot_data_plane
> CMORPH_8KM-30MIN_2015120100.nc CMORPH_8km-30MIN_2015120100.ps 'name
=
> "CMORPH" ; level = "(0,*,*)"' Copyright (C) 1995-2014 - All Rights
Reserved
> University Corporation for Atmospheric Research NCAR Command
Language
> Version 6.2.1 The use of this software is governed by a License
Agreement.
> See http://www.ncl.ucar.edu/ for more details.fatal: can't find file
> "CMORPH_8KM-30MIN_2015120100.nc"
> I have edited the the script sent by you. diri =
> systemfunc("~/geeta/ncl/CMORPH "+in) ; input
> directory fili = systemfunc("CMORPH_8KM-30MIN_2015120100 "+in)
> ; binary uncompressed pthi = diri+"/"+fili
> ; OUTPUT ncDir = "./"
> ; directory for netCDF output ncFil =
fili +
> ".nc" ; netCDF name output
> ;;setfileoption("bin","ReadByteOrder","BigEndian") ; *not*
needed;
> input are type byte
> dlim = "_-" ; string
> delimiter nfld = str_fields_count(fili, dlim) ;
nfld=4
> ymdh = toint(str_get_field(fili, 4, dlim)) can u pls
suggest???
>
>
>
>
>
> > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > From: met_help at ucar.edu
> > To: geeta124 at hotmail.com
> > Date: Mon, 21 Dec 2015 15:30:19 -0700
> >
> > Hello Geeta,
> >
> > Julie asked me to take a look at this. I see that you're using
the
> hourly
> > CMORPH 8km data. I was able to combine some of two different NCL
scripts
> > to read this data and write it to NetCDF:
> > https://www.ncl.ucar.edu/Applications/Scripts/cmorph_3.ncl
> > https://www.ncl.ucar.edu/Applications/Scripts/cmorph_4.ncl
> >
> > I've attached the resulting script, named cmorph8km2nc.ncl. Try
running
> > the following commands:
> >
> > wget
> >
>
ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km/CMORPH_8KM-
30MIN_2015122012.Z
> > gunzip CMORPH_8KM-30MIN_2015122012.Z
> > ncl 'in="CMORPH_8KM-30MIN_2015122012"' cmorph8km2nc.ncl
> > met-5.1/bin/plot_data_plane CMORPH_8KM-30MIN_2015122012.nc
> > CMORPH_8KM-30MIN_2015122012.ps 'name="CMORPH"; level="(0,*,*)";'
> >
> > I converted the PostScript output to png format and attached it
here. As
> > you can see, the world is upside down and backwards. But at least
MET
> can
> > read it. I did try to run a cdo command to produce GRIB output
but
> wasn't
> > successful. Perhaps the size of the data is too large for CDO to
handle?
> >
> > I'll leave it to you to confirm that this data is correct and to
decide
> how
> > you'd like to proceed. Hopefully this provides a good starting
point.
> >
> > Thanks,
> > John
> >
> > On Sun, Dec 20, 2015 at 5:12 AM, Geeta Geeta via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> > >
> > >
> > >
> > >
> > > Thanks Julie. I am downloading the data from the following
address
> > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/30min_8km
> > > I have files for each hour -rw-r--r-- 1 aditya aditya 48955512
Dec 1
> > > 19:33 CMORPH_8KM-30MIN_2015113013-rw-r--r-- 1 aditya aditya
48955512
> Dec
> > > 1 19:33 CMORPH_8KM-30MIN_2015113014-rw-r--r-- 1 aditya aditya
48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113015-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113016-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113017-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113018-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113019-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113020-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113021-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113022-rw-r--r-- 1 aditya
aditya
> 48955512
> > > Dec 1 19:33 CMORPH_8KM-30MIN_2015113023
> > >
> > > These are binary files.
> > > aditya at agniilap:~/geeta/ncl/CMORPH$ file CMORPH_8KM-
30MIN_2015113023
> > > CMORPH_8KM-30MIN_2015113023: data
> > >
> > > I edited the ncl path in the ksh script. and run the ksh script
given
> by
> > > you. aditya at agniilap:~/geeta/ncl/CMORPH$ ./cmorph2grib.ksh
> > > CMORPH_8KM-30MIN_2015113023 >outls: cannot access CMORPH_8KM-
30MIN_
> > > 2015113023.nc: No such file or directory
> > > aditya at agniilap:~/geeta/ncl/bin$ lscgm2ncgm ncargex
> > > ncl.xq.fix rassplitConvertMapData ncargf77
ng4ex
> > > rasstatctlib ncargf90 nhlcc
> > > rasviewctrans ncargfile nhlf77
> > > scr1.nclESMF_RegridWeightGen ncargpath nhlf90
> > > scrip_check_inputezmapdemo ncargrun nnalg
> > > tdpackdemofcaps ncargversion pre2ncgm
> tgks0afindg
> > > ncargworld pre2ncgm.prog tlocalfontc
> > > ncarlogo2ps psblack WRAPITgcaps
> ncarvversion
> > > psplit wrapit77graphc ncgm2cgm
pswhite
> > > WriteLineFileictrans ncgmstat pwritxnt
> > > WriteNameFileidt ncl ras2ccir601
> > > WritePlotcharDataMakeNcl ncl_convert2nc rascatmed
> > > ncl_filedump rasgetpalncargcc
ncl_grib2nc
> > > raslsadity!
> > > a at agniilap:~/geeta/ncl/bin$ echo $NCARG_ROOT
/home/aditya/geeta/ncl
> > > I am sending you the modified script and the out message from
ksh
> script.
> > > Would be waiting for your suggestions.
> > > Geeta
> > >
> > > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > > From: met_help at ucar.edu
> > > > To: geeta124 at hotmail.com
> > > > Date: Fri, 18 Dec 2015 10:12:45 -0700
> > > >
> > > > Hi Geeta.
> > > >
> > > > I see that you are having trouble converting the CMORPH data.
Did
> your
> > > > file follow this naming convention:
> > > >
> > > > YYYYMMDD_3hr-025deg_cpc+comb
> > > >
> > > > and was it from the following location?
> > > >
> > > > ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/
> > > >
> > > > Can you please pass on the command that you ran and the output
that
> you
> > > > received from cmorph2grib.ksh?
> > > >
> > > > Thanks,
> > > > Julie
> > > >
> > > >
> > > > On Fri, Dec 18, 2015 at 1:46 AM, Geeta Geeta via RT <
> met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240 >
> > > > >
> > > > > Hi Julie. I was unable to convert the CMORPH data at 8 km
> resolution.
> > > > > Kindly guide further.
> > > > >
> > > > > Geeta
> > > > >
> > > > > > Subject: Re: [rt.rap.ucar.edu #74240] handling CMORPH data
> > > > > > From: met_help at ucar.edu
> > > > > > To: geeta124 at hotmail.com
> > > > > > Date: Tue, 1 Dec 2015 11:23:50 -0700
> > > > > >
> > > > > > Hi Geeta.
> > > > > >
> > > > > > We were able to pull a CMORPH file following this naming
> convention:
> > > > > >
> > > > > > YYYYMMDD_3hr-025deg_cpc+comb
> > > > > >
> > > > > > from this location:
> > > > > >
> > > > > >
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-hourly_025deg/
> > > > > >
> > > > > > and convert it to a grib format that you can use with MET.
> > > > > >
> > > > > > I have attached the scripts that we used to convert the
file.
> You
> > > will
> > > > > > need "ncl" and "cdo" to run the scripts. In the
cmorph2grib.ksh
> > > script,
> > > > > > please note that we have the following lines:
> > > > > >
> > > > > > NCL=/usr/local/ncl/bin/ncl
> > > > > > CDO=/usr/local/cdo/bin/cdo
> > > > > >
> > > > > > If "ncl" and "cdo" are not in those locations on your
machine,
> please
> > > > > > modify the locations in the script to match the location
on your
> > > machine.
> > > > > >
> > > > > > The scripts will only work on the data following in the
naming
> > > convention
> > > > > > and from the location listed above. However, this README
> indicates
> > > that
> > > > > > things are changing:
> > > > > >
> > > > > >
> > > > >
> > >
> ftp://ftp.cpc.ncep.noaa.gov/precip/global_CMORPH/3-
hourly_025deg/NOTICE-OF-TEMINATION-OF-THESE-CMORPH-DATA-LOCATIONS
> > > > > >
> > > > > > I hope this helps!
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Dec 1, 2015 at 3:33 AM, Geeta Geeta via RT <
> > > met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > Tue Dec 01 03:33:05 2015: Request 74240 was acted upon.
> > > > > > > Transaction: Ticket created by geeta124 at hotmail.com
> > > > > > > Queue: met_help
> > > > > > > Subject: handling CMORPH data
> > > > > > > Owner: Nobody
> > > > > > > Requestors: geeta124 at hotmail.com
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74240
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hi met_help. I have to verify the model data with the
CMORPH
> data.
> > > > > > > what all data conversions I have to do in order to
achieve the
> > > same.
> > > > > > > Geeta
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > Phone: 303.497.8399
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > >
> > >
> > >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list