[Met_help] [rt.rap.ucar.edu #92412] History for Help
John Halley Gotway via RT
met_help at ucar.edu
Thu Nov 21 09:22:55 MST 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello dear,
I am writing because I need your help.
when I run the preproc.sh with command ./preproc.sh, I get these errors.
What should I change in the preproc file before running.
It's been two weeks since I tried to run met. And, I need it as soon as
possible to fill my contingency tables and continue my work of memory.
endiantest.c: In function 'endian':
endiantest.c:2:130: warning: implicit declaration of function 'putchar'
[-Wimplicit-function-declaration]
#define Order(x) fill((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x);
i++) { c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' : (char)c); } printf("\n");
^
endiantest.c:17:2: note: in expansion of macro 'Order'
Order(j);
^~~~~
endiantest.c:2:165: warning: implicit declaration of function 'printf'
[-Wimplicit-function-declaration]
ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
(char)c); } printf("\n");
^
endiantest.c:17:2: note: in expansion of macro 'Order'
Order(j);
^~~~~
endiantest.c:2:165: warning: incompatible implicit declaration of built-in
function 'printf'
ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
(char)c); } printf("\n");
^
endiantest.c:17:2: note: in expansion of macro 'Order'
Order(j);
^~~~~
endiantest.c:2:165: note: include '<stdio.h>' or provide a declaration of
'printf'
ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
(char)c); } printf("\n");
^
endiantest.c:17:2: note: in expansion of macro 'Order'
Order(j);
^~~~~
endiantest.c: At top level:
endiantest.c:31:1: warning: return type defaults to 'int' [-Wimplicit-int]
main()
^~~~
irev.F:8:59: warning: missing terminating " character
C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS "LITTLE-
^
irev.F:9:11: warning: missing terminating " character
C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE BYTES
^
irev.F:44:54: warning: missing terminating " character
C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN THEN
Warm regards,
Dorès.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Wed Oct 02 13:05:52 2019
Hi Dorès.
It sounds like you're having trouble installing the BUFRLIB library
that
MET depends on. First, I'd like to ensure that you are compiling
BUFRLIBv10-2-3 and not a later version of BUFRLIB. MET will upgrade
the
version of BUFRLIB that it is using with our next release (METv9.0).
I
have attached BUFRLIB_v10-2-3.tar.gz along with a preproc.sh_v10.2.3
script that you can use.
You can simply run:
cp preproc.sh_v10.2.3 preproc.sh
You can follow the directions for compiling BUFRLIB in our online
tutorial
under the "Compiling BUFRLIB" section of our Required Libraries page
to be
sure that you are using the necessary compiler flags:
https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
Pleas let us know if you have any questions.
Thanks,
Julie
On Wed, Oct 2, 2019 at 8:02 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> Wed Oct 02 08:02:43 2019: Request 92412 was acted upon.
> Transaction: Ticket created by ngaminidas at gmail.com
> Queue: met_help
> Subject: Help
> Owner: Nobody
> Requestors: ngaminidas at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
>
> Hello dear,
>
> I am writing because I need your help.
> when I run the preproc.sh with command ./preproc.sh, I get these
errors.
> What should I change in the preproc file before running.
> It's been two weeks since I tried to run met. And, I need it as soon
as
> possible to fill my contingency tables and continue my work of
memory.
>
> endiantest.c: In function 'endian':
> endiantest.c:2:130: warning: implicit declaration of function
'putchar'
> [-Wimplicit-function-declaration]
> #define Order(x) fill((char *)&x, sizeof(x)); for (i=1;
i<=sizeof(x);
> i++) { c=((x>>(byte_size*(sizeof(x)-i)))&mask);
putchar(c==0 ?
> '?' : (char)c); } printf("\n");
>
> ^
> endiantest.c:17:2: note: in expansion of macro 'Order'
> Order(j);
> ^~~~~
> endiantest.c:2:165: warning: implicit declaration of function
'printf'
> [-Wimplicit-function-declaration]
> ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
> (char)c); } printf("\n");
>
>
^
> endiantest.c:17:2: note: in expansion of macro 'Order'
> Order(j);
> ^~~~~
> endiantest.c:2:165: warning: incompatible implicit declaration of
built-in
> function 'printf'
> ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
> (char)c); } printf("\n");
>
>
^
> endiantest.c:17:2: note: in expansion of macro 'Order'
> Order(j);
> ^~~~~
> endiantest.c:2:165: note: include '<stdio.h>' or provide a
declaration of
> 'printf'
> ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?' :
> (char)c); } printf("\n");
>
>
^
> endiantest.c:17:2: note: in expansion of macro 'Order'
> Order(j);
> ^~~~~
> endiantest.c: At top level:
> endiantest.c:31:1: warning: return type defaults to 'int' [-
Wimplicit-int]
> main()
> ^~~~
> irev.F:8:59: warning: missing terminating " character
> C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS "LITTLE-
> ^
> irev.F:9:11: warning: missing terminating " character
> C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE
BYTES
> ^
> irev.F:44:54: warning: missing terminating " character
> C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN
THEN
>
> Warm regards,
> Dorès.
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 03 06:09:04 2019
Hello Julie,
Thank you for you help.
I use BUFRLIB_v10.2.3.
I was able to compile preproc.sh. I had some warning at the end.
irev.F:8:59: warning: missing terminating " character
C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS "LITTLE-
^
irev.F:9:11: warning: missing terminating " character
C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE
BYTES
^
irev.F:44:54: warning: missing terminating " character
C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN THEN
But, I continued. In compiling gcc with* gcc -c -DUNDERSCORE *.c* , I
also
had warnings.
In file included from stseq.c:56:0:
stseq.c: In function 'stseq_':
bufrlib.h:51:19: warning: implicit declaration of function 'stntbi_';
did
you mean 'stntbi'? [-Wimplicit-function-declaration]
#define stntbi stntbi_
^
stseq.c:88:5: note: in expansion of macro 'stntbi'
stntbi( &nd, lun, adn, nemo, cseq, sizeof( adn ), 8, 55 );
^~~~~~
bufrlib.h:35:19: warning: implicit declaration of function 'icvidx_';
did
you mean 'icvidx'? [-Wimplicit-function-declaration]
#define icvidx icvidx_
^
stseq.c:104:21: note: in expansion of macro 'icvidx'
&mstabs.idefxy[icvidx(&ipt,&i0,&imxcd)],
And, I still compiler gfortran with *gfortran -c -DUNDERSCORE
-fno-second-underscore *.f *.F* where I had the errors below. Since
then, I
have been trying to solve them.
wrdlen.f:411:6:
ERRSTR = '=============== '
1
Error: Unclassifiable statement at (1)
wrdlen.f:420:6:
ERRSTR = ' BYTE ORDER IS '
1
Error: Unclassifiable statement at (1)
wrdlen.f:423:6:
ERRSTR = ' '
1
Error: Unclassifiable statement at (1)
wrdlen.f:426:6:
ERRSTR = '====================== VERSION: '
1
Error: Unclassifiable statement at (1)
wrdlen.f:434:66:
900 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH IS '
1
Error: Syntax error in WRITE statement at (1)
wrdlen.f:438:70:
901 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH
(",I4,"'
1
Error: Syntax error in WRITE statement at (1)
wrdlen.f:442:70:
902 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - BYTE ORDER CHECKING
MISTAKE'
1
Error: Syntax error in WRITE statement at (1)
wrdlen.f:446:68:
903 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - CAN''T DETERMINE MACHINE '
1
Error: Syntax error in WRITE statement at (1)
wrdlen.f:91:72:
10 IF(I.GE.65) GOTO 900
1
Error: Label 900 referenced at (1) is never defined
wrdlen.f:92:72:
IF(MOD(I,8).NE.0) GOTO 901
1
Error: Label 901 referenced at (1) is never defined
wrdlen.f:109:72:
20 IF(J.GT.NBYTW) GOTO 902
1
Error: Label 902 referenced at (1) is never defined
wrdlen.f:122:72:
GOTO 903
1
Error: Label 903 referenced at (1) is never defined
Best Regards
Dorès
Le mer. 2 oct. 2019 à 20:05, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> Hi Dorès.
>
> It sounds like you're having trouble installing the BUFRLIB library
that
> MET depends on. First, I'd like to ensure that you are compiling
> BUFRLIBv10-2-3 and not a later version of BUFRLIB. MET will upgrade
the
> version of BUFRLIB that it is using with our next release (METv9.0).
I
> have attached BUFRLIB_v10-2-3.tar.gz along with a
preproc.sh_v10.2.3
> script that you can use.
>
> You can simply run:
> cp preproc.sh_v10.2.3 preproc.sh
>
> You can follow the directions for compiling BUFRLIB in our online
tutorial
> under the "Compiling BUFRLIB" section of our Required Libraries page
to be
> sure that you are using the necessary compiler flags:
>
> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
>
> Pleas let us know if you have any questions.
>
> Thanks,
> Julie
>
>
>
>
> On Wed, Oct 2, 2019 at 8:02 AM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Wed Oct 02 08:02:43 2019: Request 92412 was acted upon.
> > Transaction: Ticket created by ngaminidas at gmail.com
> > Queue: met_help
> > Subject: Help
> > Owner: Nobody
> > Requestors: ngaminidas at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> >
> > Hello dear,
> >
> > I am writing because I need your help.
> > when I run the preproc.sh with command ./preproc.sh, I get these
errors.
> > What should I change in the preproc file before running.
> > It's been two weeks since I tried to run met. And, I need it as
soon as
> > possible to fill my contingency tables and continue my work of
memory.
> >
> > endiantest.c: In function 'endian':
> > endiantest.c:2:130: warning: implicit declaration of function
'putchar'
> > [-Wimplicit-function-declaration]
> > #define Order(x) fill((char *)&x, sizeof(x)); for (i=1;
i<=sizeof(x);
> > i++) { c=((x>>(byte_size*(sizeof(x)-i)))&mask);
putchar(c==0 ?
> > '?' : (char)c); } printf("\n");
> >
> > ^
> > endiantest.c:17:2: note: in expansion of macro 'Order'
> > Order(j);
> > ^~~~~
> > endiantest.c:2:165: warning: implicit declaration of function
'printf'
> > [-Wimplicit-function-declaration]
> > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?'
:
> > (char)c); } printf("\n");
> >
> >
^
> > endiantest.c:17:2: note: in expansion of macro 'Order'
> > Order(j);
> > ^~~~~
> > endiantest.c:2:165: warning: incompatible implicit declaration of
> built-in
> > function 'printf'
> > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?'
:
> > (char)c); } printf("\n");
> >
> >
^
> > endiantest.c:17:2: note: in expansion of macro 'Order'
> > Order(j);
> > ^~~~~
> > endiantest.c:2:165: note: include '<stdio.h>' or provide a
declaration of
> > 'printf'
> > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ? '?'
:
> > (char)c); } printf("\n");
> >
> >
^
> > endiantest.c:17:2: note: in expansion of macro 'Order'
> > Order(j);
> > ^~~~~
> > endiantest.c: At top level:
> > endiantest.c:31:1: warning: return type defaults to 'int'
> [-Wimplicit-int]
> > main()
> > ^~~~
> > irev.F:8:59: warning: missing terminating " character
> > C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS
"LITTLE-
> > ^
> > irev.F:9:11: warning: missing terminating " character
> > C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE
BYTES
> > ^
> > irev.F:44:54: warning: missing terminating " character
> > C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN
THEN
> >
> > Warm regards,
> > Dorès.
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Thu Oct 03 13:19:05 2019
Hi Dorès.
Thank you for this information. I am sorry to see that you are still
having difficulty.
Could you please start in a new shell, try the following directions
and see
if you are able to get a successful build? I just ran through these
steps
and was able to get a successful build. I hope that you will too.
Make a new directory to contain the BUFRLIB code (e.g. mkdir
/home/user/BURFLIB_v10.2.3)
Copy the BUFRLIB tarball to the new directory (e.g. cp BUFRLIB_v10-2-
3.tar
/home/user/BURFLIB_v10.2.3/)
Copy preproc.sh_v10.2.3 into the new directory (e.g. cp
preproc.sh_v10.2.3
/home/user/BURFLIB_v10.2.3/)
Unpack the tarball (e.g. cd /home/user/BURFLIB_v10.2.3; tar -xvf
BUFRLIB_v10-2-3.tar)
Set the FC and CC:
For csh:
setenv FC /usr/bin/gfortran (set to the location of your gfortran
executable, if you're unsure of its location, run "which gfortran")
setenv CC /usr/bin/gcc (set to the location of your gcc
executable, if
you're unsure of its location, run "which gcc")
For bash:
export FC=/usr/bin/gfortran (set to the location of your gfortran
executable, if you're unsure of its location, run "which gfortran")
export CC=/usr/bin/gcc (set to the location of your gcc
executable, if
you're unsure of its location, run "which gcc")
Then run:
./preproc.sh_v10.2.3
gcc -c -DUNDERSCORE *.c
gfortran -c -DUNDERSCORE -fno-second-underscore *.f *.F
ar crv libbufr.a *.o
After that, hopefully, you will have successfully built BUFRLIB.
Please let me know how it goes. Thank you!
Julie
On Thu, Oct 3, 2019 at 6:09 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello Julie,
> Thank you for you help.
> I use BUFRLIB_v10.2.3.
> I was able to compile preproc.sh. I had some warning at the end.
>
> irev.F:8:59: warning: missing terminating " character
> C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS "LITTLE-
> ^
> irev.F:9:11: warning: missing terminating " character
> C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE
BYTES
> ^
> irev.F:44:54: warning: missing terminating " character
> C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN
THEN
>
> But, I continued. In compiling gcc with* gcc -c -DUNDERSCORE *.c* ,
I also
> had warnings.
>
> In file included from stseq.c:56:0:
> stseq.c: In function 'stseq_':
> bufrlib.h:51:19: warning: implicit declaration of function
'stntbi_'; did
> you mean 'stntbi'? [-Wimplicit-function-declaration]
> #define stntbi stntbi_
> ^
> stseq.c:88:5: note: in expansion of macro 'stntbi'
> stntbi( &nd, lun, adn, nemo, cseq, sizeof( adn ), 8, 55 );
> ^~~~~~
> bufrlib.h:35:19: warning: implicit declaration of function
'icvidx_'; did
> you mean 'icvidx'? [-Wimplicit-function-declaration]
> #define icvidx icvidx_
> ^
> stseq.c:104:21: note: in expansion of macro 'icvidx'
> &mstabs.idefxy[icvidx(&ipt,&i0,&imxcd)],
>
> And, I still compiler gfortran with *gfortran -c -DUNDERSCORE
> -fno-second-underscore *.f *.F* where I had the errors below. Since
then, I
> have been trying to solve them.
>
> wrdlen.f:411:6:
>
> ERRSTR = '=============== '
> 1
> Error: Unclassifiable statement at (1)
> wrdlen.f:420:6:
>
> ERRSTR = ' BYTE ORDER IS '
> 1
> Error: Unclassifiable statement at (1)
> wrdlen.f:423:6:
>
> ERRSTR = ' '
> 1
> Error: Unclassifiable statement at (1)
> wrdlen.f:426:6:
>
> ERRSTR = '====================== VERSION: '
> 1
> Error: Unclassifiable statement at (1)
> wrdlen.f:434:66:
>
> 900 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH IS '
> 1
> Error: Syntax error in WRITE statement at (1)
> wrdlen.f:438:70:
>
> 901 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH
(",I4,"'
>
1
> Error: Syntax error in WRITE statement at (1)
> wrdlen.f:442:70:
>
> 902 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - BYTE ORDER CHECKING
MISTAKE'
>
1
> Error: Syntax error in WRITE statement at (1)
> wrdlen.f:446:68:
>
> 903 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - CAN''T DETERMINE MACHINE
'
>
1
> Error: Syntax error in WRITE statement at (1)
> wrdlen.f:91:72:
>
> 10 IF(I.GE.65) GOTO 900
>
1
> Error: Label 900 referenced at (1) is never defined
> wrdlen.f:92:72:
>
> IF(MOD(I,8).NE.0) GOTO 901
>
1
> Error: Label 901 referenced at (1) is never defined
> wrdlen.f:109:72:
>
> 20 IF(J.GT.NBYTW) GOTO 902
>
1
> Error: Label 902 referenced at (1) is never defined
> wrdlen.f:122:72:
>
> GOTO 903
>
1
> Error: Label 903 referenced at (1) is never defined
>
> Best Regards
> Dorès
>
> Le mer. 2 oct. 2019 à 20:05, Julie Prestopnik via RT
<met_help at ucar.edu> a
> écrit :
>
> > Hi Dorès.
> >
> > It sounds like you're having trouble installing the BUFRLIB
library that
> > MET depends on. First, I'd like to ensure that you are compiling
> > BUFRLIBv10-2-3 and not a later version of BUFRLIB. MET will
upgrade the
> > version of BUFRLIB that it is using with our next release
(METv9.0). I
> > have attached BUFRLIB_v10-2-3.tar.gz along with a
preproc.sh_v10.2.3
> > script that you can use.
> >
> > You can simply run:
> > cp preproc.sh_v10.2.3 preproc.sh
> >
> > You can follow the directions for compiling BUFRLIB in our online
> tutorial
> > under the "Compiling BUFRLIB" section of our Required Libraries
page to
> be
> > sure that you are using the necessary compiler flags:
> >
> >
> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
> >
> > Pleas let us know if you have any questions.
> >
> > Thanks,
> > Julie
> >
> >
> >
> >
> > On Wed, Oct 2, 2019 at 8:02 AM Das Dores Ngamini via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > Wed Oct 02 08:02:43 2019: Request 92412 was acted upon.
> > > Transaction: Ticket created by ngaminidas at gmail.com
> > > Queue: met_help
> > > Subject: Help
> > > Owner: Nobody
> > > Requestors: ngaminidas at gmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >
> > >
> > >
> > > Hello dear,
> > >
> > > I am writing because I need your help.
> > > when I run the preproc.sh with command ./preproc.sh, I get
these
> errors.
> > > What should I change in the preproc file before running.
> > > It's been two weeks since I tried to run met. And, I need it as
soon as
> > > possible to fill my contingency tables and continue my work of
memory.
> > >
> > > endiantest.c: In function 'endian':
> > > endiantest.c:2:130: warning: implicit declaration of function
'putchar'
> > > [-Wimplicit-function-declaration]
> > > #define Order(x) fill((char *)&x, sizeof(x)); for (i=1;
i<=sizeof(x);
> > > i++) { c=((x>>(byte_size*(sizeof(x)-i)))&mask);
putchar(c==0
> ?
> > > '?' : (char)c); } printf("\n");
> > >
> > > ^
> > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > Order(j);
> > > ^~~~~
> > > endiantest.c:2:165: warning: implicit declaration of function
'printf'
> > > [-Wimplicit-function-declaration]
> > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > (char)c); } printf("\n");
> > >
> > >
^
> > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > Order(j);
> > > ^~~~~
> > > endiantest.c:2:165: warning: incompatible implicit declaration
of
> > built-in
> > > function 'printf'
> > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > (char)c); } printf("\n");
> > >
> > >
^
> > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > Order(j);
> > > ^~~~~
> > > endiantest.c:2:165: note: include '<stdio.h>' or provide a
declaration
> of
> > > 'printf'
> > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > (char)c); } printf("\n");
> > >
> > >
^
> > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > Order(j);
> > > ^~~~~
> > > endiantest.c: At top level:
> > > endiantest.c:31:1: warning: return type defaults to 'int'
> > [-Wimplicit-int]
> > > main()
> > > ^~~~
> > > irev.F:8:59: warning: missing terminating " character
> > > C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS
"LITTLE-
> > > ^
> > > irev.F:9:11: warning: missing terminating " character
> > > C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING
THE BYTES
> > > ^
> > > irev.F:44:54: warning: missing terminating " character
> > > C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-
ENDIAN THEN
> > >
> > > Warm regards,
> > > Dorès.
> > >
> > >
> >
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Fri Oct 04 07:36:03 2019
Hello Julie,
Thank you for your help.
I was able to compiling BUFRLIB. Now when I try to compile MET with
commands
*make install >& make_install.log &*
*tail -f make_install.log*
the command *tail -f make_install.log *gives these errors.
make[3]: *** [libvx_nc_util_a-nc_var_info.o] Error 1
make[3]: Leaving directory
'/home/dores/Tutorial_Master/TP_Prevision/MET/met-
8.0/src/libcode/vx_nc_util'
Makefile:369: recipe for target 'install-recursive' failedthe
make[2]: *** [install-recursive] Error 1
make[2]: Leaving directory
'/home/dores/Tutorial_Master/TP_Prevision/MET/met-8.0/src/libcode'
Makefile:357: recipe for target 'install-recursive' failed
make[1]: *** [install-recursive] Error 1
make[1]: Leaving directory
'/home/dores/Tutorial_Master/TP_Prevision/MET/met-8.0/src'
Makefile:413: recipe for target 'install-recursive' failed
make: *** [install-recursive] Error 1
Attached make_install.log file.
Best Regards
Dores
Le jeu. 3 oct. 2019 à 20:19, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> Hi Dorès.
>
> Thank you for this information. I am sorry to see that you are
still
> having difficulty.
>
> Could you please start in a new shell, try the following directions
and see
> if you are able to get a successful build? I just ran through these
steps
> and was able to get a successful build. I hope that you will too.
>
> Make a new directory to contain the BUFRLIB code (e.g. mkdir
> /home/user/BURFLIB_v10.2.3)
> Copy the BUFRLIB tarball to the new directory (e.g. cp BUFRLIB_v10-
2-3.tar
> /home/user/BURFLIB_v10.2.3/)
> Copy preproc.sh_v10.2.3 into the new directory (e.g. cp
preproc.sh_v10.2.3
> /home/user/BURFLIB_v10.2.3/)
> Unpack the tarball (e.g. cd /home/user/BURFLIB_v10.2.3; tar -xvf
> BUFRLIB_v10-2-3.tar)
>
> Set the FC and CC:
> For csh:
> setenv FC /usr/bin/gfortran (set to the location of your
gfortran
> executable, if you're unsure of its location, run "which gfortran")
> setenv CC /usr/bin/gcc (set to the location of your gcc
executable, if
> you're unsure of its location, run "which gcc")
> For bash:
> export FC=/usr/bin/gfortran (set to the location of your
gfortran
> executable, if you're unsure of its location, run "which gfortran")
> export CC=/usr/bin/gcc (set to the location of your gcc
executable, if
> you're unsure of its location, run "which gcc")
>
> Then run:
> ./preproc.sh_v10.2.3
> gcc -c -DUNDERSCORE *.c
> gfortran -c -DUNDERSCORE -fno-second-underscore *.f *.F
> ar crv libbufr.a *.o
>
> After that, hopefully, you will have successfully built BUFRLIB.
>
> Please let me know how it goes. Thank you!
>
> Julie
>
> On Thu, Oct 3, 2019 at 6:09 AM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello Julie,
> > Thank you for you help.
> > I use BUFRLIB_v10.2.3.
> > I was able to compile preproc.sh. I had some warning at the end.
> >
> > irev.F:8:59: warning: missing terminating " character
> > C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS
"LITTLE-
> > ^
> > irev.F:9:11: warning: missing terminating " character
> > C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING THE
BYTES
> > ^
> > irev.F:44:54: warning: missing terminating " character
> > C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-ENDIAN
THEN
> >
> > But, I continued. In compiling gcc with* gcc -c -DUNDERSCORE *.c*
, I
> also
> > had warnings.
> >
> > In file included from stseq.c:56:0:
> > stseq.c: In function 'stseq_':
> > bufrlib.h:51:19: warning: implicit declaration of function
'stntbi_'; did
> > you mean 'stntbi'? [-Wimplicit-function-declaration]
> > #define stntbi stntbi_
> > ^
> > stseq.c:88:5: note: in expansion of macro 'stntbi'
> > stntbi( &nd, lun, adn, nemo, cseq, sizeof( adn ), 8, 55 );
> > ^~~~~~
> > bufrlib.h:35:19: warning: implicit declaration of function
'icvidx_'; did
> > you mean 'icvidx'? [-Wimplicit-function-declaration]
> > #define icvidx icvidx_
> > ^
> > stseq.c:104:21: note: in expansion of macro 'icvidx'
> > &mstabs.idefxy[icvidx(&ipt,&i0,&imxcd)],
> >
> > And, I still compiler gfortran with *gfortran -c -DUNDERSCORE
> > -fno-second-underscore *.f *.F* where I had the errors below.
Since
> then, I
> > have been trying to solve them.
> >
> > wrdlen.f:411:6:
> >
> > ERRSTR = '=============== '
> > 1
> > Error: Unclassifiable statement at (1)
> > wrdlen.f:420:6:
> >
> > ERRSTR = ' BYTE ORDER IS '
> > 1
> > Error: Unclassifiable statement at (1)
> > wrdlen.f:423:6:
> >
> > ERRSTR = ' '
> > 1
> > Error: Unclassifiable statement at (1)
> > wrdlen.f:426:6:
> >
> > ERRSTR = '====================== VERSION: '
> > 1
> > Error: Unclassifiable statement at (1)
> > wrdlen.f:434:66:
> >
> > 900 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH IS
'
> >
1
> > Error: Syntax error in WRITE statement at (1)
> > wrdlen.f:438:70:
> >
> > 901 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - MACHINE WORD LENGTH
(",I4,"'
> >
1
> > Error: Syntax error in WRITE statement at (1)
> > wrdlen.f:442:70:
> >
> > 902 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - BYTE ORDER CHECKING
MISTAKE'
> >
1
> > Error: Syntax error in WRITE statement at (1)
> > wrdlen.f:446:68:
> >
> > 903 WRITE(BORT_STR,'("BUFRLIB: WRDLEN - CAN''T DETERMINE
MACHINE '
> >
1
> > Error: Syntax error in WRITE statement at (1)
> > wrdlen.f:91:72:
> >
> > 10 IF(I.GE.65) GOTO 900
> >
1
> > Error: Label 900 referenced at (1) is never defined
> > wrdlen.f:92:72:
> >
> > IF(MOD(I,8).NE.0) GOTO 901
> >
1
> > Error: Label 901 referenced at (1) is never defined
> > wrdlen.f:109:72:
> >
> > 20 IF(J.GT.NBYTW) GOTO 902
> >
1
> > Error: Label 902 referenced at (1) is never defined
> > wrdlen.f:122:72:
> >
> > GOTO 903
> >
1
> > Error: Label 903 referenced at (1) is never defined
> >
> > Best Regards
> > Dorès
> >
> > Le mer. 2 oct. 2019 à 20:05, Julie Prestopnik via RT
<met_help at ucar.edu>
> a
> > écrit :
> >
> > > Hi Dorès.
> > >
> > > It sounds like you're having trouble installing the BUFRLIB
library
> that
> > > MET depends on. First, I'd like to ensure that you are
compiling
> > > BUFRLIBv10-2-3 and not a later version of BUFRLIB. MET will
upgrade
> the
> > > version of BUFRLIB that it is using with our next release
(METv9.0). I
> > > have attached BUFRLIB_v10-2-3.tar.gz along with a
preproc.sh_v10.2.3
> > > script that you can use.
> > >
> > > You can simply run:
> > > cp preproc.sh_v10.2.3 preproc.sh
> > >
> > > You can follow the directions for compiling BUFRLIB in our
online
> > tutorial
> > > under the "Compiling BUFRLIB" section of our Required Libraries
page to
> > be
> > > sure that you are using the necessary compiler flags:
> > >
> > >
> >
> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
> > >
> > > Pleas let us know if you have any questions.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > >
> > >
> > > On Wed, Oct 2, 2019 at 8:02 AM Das Dores Ngamini via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > >
> > > > Wed Oct 02 08:02:43 2019: Request 92412 was acted upon.
> > > > Transaction: Ticket created by ngaminidas at gmail.com
> > > > Queue: met_help
> > > > Subject: Help
> > > > Owner: Nobody
> > > > Requestors: ngaminidas at gmail.com
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >
> > > >
> > > >
> > > > Hello dear,
> > > >
> > > > I am writing because I need your help.
> > > > when I run the preproc.sh with command ./preproc.sh, I get
these
> > errors.
> > > > What should I change in the preproc file before running.
> > > > It's been two weeks since I tried to run met. And, I need it
as soon
> as
> > > > possible to fill my contingency tables and continue my work of
> memory.
> > > >
> > > > endiantest.c: In function 'endian':
> > > > endiantest.c:2:130: warning: implicit declaration of function
> 'putchar'
> > > > [-Wimplicit-function-declaration]
> > > > #define Order(x) fill((char *)&x, sizeof(x)); for (i=1;
> i<=sizeof(x);
> > > > i++) { c=((x>>(byte_size*(sizeof(x)-i)))&mask);
> putchar(c==0
> > ?
> > > > '?' : (char)c); } printf("\n");
> > > >
> > > > ^
> > > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > > Order(j);
> > > > ^~~~~
> > > > endiantest.c:2:165: warning: implicit declaration of function
> 'printf'
> > > > [-Wimplicit-function-declaration]
> > > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > > (char)c); } printf("\n");
> > > >
> > > >
> ^
> > > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > > Order(j);
> > > > ^~~~~
> > > > endiantest.c:2:165: warning: incompatible implicit declaration
of
> > > built-in
> > > > function 'printf'
> > > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > > (char)c); } printf("\n");
> > > >
> > > >
> ^
> > > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > > Order(j);
> > > > ^~~~~
> > > > endiantest.c:2:165: note: include '<stdio.h>' or provide a
> declaration
> > of
> > > > 'printf'
> > > > ll((char *)&x, sizeof(x)); for (i=1; i<=sizeof(x); i++) {
> > > > c=((x>>(byte_size*(sizeof(x)-i)))&mask); putchar(c==0 ?
'?' :
> > > > (char)c); } printf("\n");
> > > >
> > > >
> ^
> > > > endiantest.c:17:2: note: in expansion of macro 'Order'
> > > > Order(j);
> > > > ^~~~~
> > > > endiantest.c: At top level:
> > > > endiantest.c:31:1: warning: return type defaults to 'int'
> > > [-Wimplicit-int]
> > > > main()
> > > > ^~~~
> > > > irev.F:8:59: warning: missing terminating " character
> > > > C ABSTRACT: THIS FUNCTION WILL, WHEN THE LOCAL MACHINE IS
"LITTLE-
> > > > ^
> > > > irev.F:9:11: warning: missing terminating " character
> > > > C ENDIAN" (I.E., USES A RIGHT TO LEFT SCHEME FOR NUMBERING
THE
> BYTES
> > > > ^
> > > > irev.F:44:54: warning: missing terminating " character
> > > > C "BIG-ENDIAN" OR "LITTLE-ENDIAN", IF "BIG-
ENDIAN
> THEN
> > > >
> > > > Warm regards,
> > > > Dorès.
> > > >
> > > >
> > >
> > > --
> > > Julie Prestopnik
> > > Software Engineer
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > My working day may not be your working day. Please do not feel
obliged
> > to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Fri Oct 04 09:49:08 2019
I am glad to hear that you were able to get BUFRLIB installed.
Thank you for passing along the make_install.log file. I see the
following
problem:
> In file included from nc_var_info.cc:24:0:
> nc_utils.h:22:10: fatal error: netcdf: No such file or directory
> #include <netcdf>
>
The file, netcdf, is part of the NetCDF C++ library, which is required
in
addition to the NetCDF-C library. MET expects both of these libraries
to
be installed in the same location, as there is only one MET_NETCDF
variable
to set in the configuration of MET (see this page for more information
on
setting the environment variables necessary for MET:
https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/configure-met).
For more information, on compiling NetCDF for use with MET, please
take a
look at the "Compiling NetCDF" section of this webpage:
https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
Please also note that HDF5 is required for use with NetCDF4. There is
also
a section on that page for Compiling HDF5 in case you need that as
well.
Please let us know if you have any questions.
Thanks,
Julie
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Oct 07 03:04:39 2019
Hello Julie
Throughout the weekend, I tried to compile met. I used the same netcdf
as
during the wrf compilation. I always get the same mistakes.
I also compiled netcdf again and, I still get the errors.
Attached are these files.
Le ven. 4 oct. 2019 à 16:49, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> I am glad to hear that you were able to get BUFRLIB installed.
>
> Thank you for passing along the make_install.log file. I see the
following
> problem:
>
> > In file included from nc_var_info.cc:24:0:
> > nc_utils.h:22:10: fatal error: netcdf: No such file or directory
> > #include <netcdf>
> >
>
> The file, netcdf, is part of the NetCDF C++ library, which is
required in
> addition to the NetCDF-C library. MET expects both of these
libraries to
> be installed in the same location, as there is only one MET_NETCDF
variable
> to set in the configuration of MET (see this page for more
information on
> setting the environment variables necessary for MET:
>
> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/configure-met
> ).
>
>
> For more information, on compiling NetCDF for use with MET, please
take a
> look at the "Compiling NetCDF" section of this webpage:
>
> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
>
> Please also note that HDF5 is required for use with NetCDF4. There
is also
> a section on that page for Compiling HDF5 in case you need that as
well.
>
> Please let us know if you have any questions.
>
> Thanks,
> Julie
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Oct 07 03:10:51 2019
Please, can you offer me another way to fill out my contingency table
for
wrf forecasts? The filing deadline of our memories is close and my MET
still does not give.
Best Regards.
Dorès
Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello Julie
> Throughout the weekend, I tried to compile met. I used the same
netcdf as
> during the wrf compilation. I always get the same mistakes.
> I also compiled netcdf again and, I still get the errors.
> Attached are these files.
>
> Le ven. 4 oct. 2019 à 16:49, Julie Prestopnik via RT
<met_help at ucar.edu>
> a écrit :
>
>> I am glad to hear that you were able to get BUFRLIB installed.
>>
>> Thank you for passing along the make_install.log file. I see the
>> following
>> problem:
>>
>> > In file included from nc_var_info.cc:24:0:
>> > nc_utils.h:22:10: fatal error: netcdf: No such file or directory
>> > #include <netcdf>
>> >
>>
>> The file, netcdf, is part of the NetCDF C++ library, which is
required in
>> addition to the NetCDF-C library. MET expects both of these
libraries to
>> be installed in the same location, as there is only one MET_NETCDF
>> variable
>> to set in the configuration of MET (see this page for more
information on
>> setting the environment variables necessary for MET:
>>
>> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/configure-met
>> ).
>>
>>
>> For more information, on compiling NetCDF for use with MET, please
take a
>> look at the "Compiling NetCDF" section of this webpage:
>>
>> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
>>
>> Please also note that HDF5 is required for use with NetCDF4. There
is
>> also
>> a section on that page for Compiling HDF5 in case you need that as
well.
>>
>> Please let us know if you have any questions.
>>
>> Thanks,
>> Julie
>>
>> --
>> Julie Prestopnik
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Oct 07 03:20:43 2019
In my .bashrc, I export as:
export MET_NETCDFLIB=/usr/local/netcdf/lib
export MET_NETCDFLIB
export MET_NETCDFINC=/usr/local/netcdf/include
export MET_NETCDFINC
My apologies for the multiple mails. I'm confused. This is the third
week
that I'm trying to compile MET.
Cordially
Dorès
Le lun. 7 oct. 2019 à 10:10, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Please, can you offer me another way to fill out my contingency
table for
> wrf forecasts? The filing deadline of our memories is close and my
MET
> still does not give.
> Best Regards.
> Dorès
>
> Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
>> Hello Julie
>> Throughout the weekend, I tried to compile met. I used the same
netcdf
>> as during the wrf compilation. I always get the same mistakes.
>> I also compiled netcdf again and, I still get the errors.
>> Attached are these files.
>>
>> Le ven. 4 oct. 2019 à 16:49, Julie Prestopnik via RT
<met_help at ucar.edu>
>> a écrit :
>>
>>> I am glad to hear that you were able to get BUFRLIB installed.
>>>
>>> Thank you for passing along the make_install.log file. I see the
>>> following
>>> problem:
>>>
>>> > In file included from nc_var_info.cc:24:0:
>>> > nc_utils.h:22:10: fatal error: netcdf: No such file or directory
>>> > #include <netcdf>
>>> >
>>>
>>> The file, netcdf, is part of the NetCDF C++ library, which is
required in
>>> addition to the NetCDF-C library. MET expects both of these
libraries to
>>> be installed in the same location, as there is only one MET_NETCDF
>>> variable
>>> to set in the configuration of MET (see this page for more
information on
>>> setting the environment variables necessary for MET:
>>>
>>> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/configure-met
>>> ).
>>>
>>>
>>> For more information, on compiling NetCDF for use with MET, please
take a
>>> look at the "Compiling NetCDF" section of this webpage:
>>>
>>> https://dtcenter.org/met-online-tutorial-metv8-0/tutorial-
setup/compilation/required-libraries
>>>
>>> Please also note that HDF5 is required for use with NetCDF4.
There is
>>> also
>>> a section on that page for Compiling HDF5 in case you need that as
well.
>>>
>>> Please let us know if you have any questions.
>>>
>>> Thanks,
>>> Julie
>>>
>>> --
>>> Julie Prestopnik
>>> Software Engineer
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>> My working day may not be your working day. Please do not feel
obliged
>>> to
>>> reply to this email outside of your normal working hours.
>>>
>>>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Mon Oct 07 12:59:00 2019
Hi Dorès.
I'm so sorry to see that you are still having difficulty getting MET
installed. We have a few options:
1. The easiest way to make MET available would be using a Docker
container. If your sys admin is willing to install Docker on that
machine, then
getting MET is as simple as running:
docker pull dtcenter/met:8.1
If not, and many sys admins object to the use of Docker, compiling
it
from scratch is the other alternative.
2. Because you are having difficulty installing the external
libraries
MET needs from scratch, we do have an install script for MET and
its
external libraries that may be useful to you. This script may or
may not
work right away. Some systems have needed more work than others.
I will
attempt to help you as best as I can.
3. We can continue with trying to resolve problems as we have been
doing. I see that you have sent your make_install.log which
contains the
same error that it did previously. We can do some further
debugging here
if you'd like. For example, next, I would have you send me
listings of the
directory (using the "ls -l" command) where the header files and
the
library files live for the NetCDF files. I would also need you to
send me
the config.log file for MET as well.
Please let me know how you would like to proceed.
Thanks,
Julie
On Mon, Oct 7, 2019 at 3:10 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Please, can you offer me another way to fill out my contingency
table for
> wrf forecasts? The filing deadline of our memories is close and my
MET
> still does not give.
> Best Regards.
> Dorès
>
> Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
> > Hello Julie
> > Throughout the weekend, I tried to compile met. I used the same
netcdf as
> > during the wrf compilation. I always get the same mistakes.
> > I also compiled netcdf again and, I still get the errors.
> > Attached are these files.
> >
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Oct 08 02:51:35 2019
Hello Julie,
I'm so glad for the help you give me.
I will like to proceed by the solution 1. But, I don't know if my
system
administrator is willing to install Docker on my machine or not. My
machine
is DELL {LATITUDE | E5430, intel core i5, system linux, Debian,
kubuntu}.
I don't know if these informations are importantes.
I'm expecting to you.
Best Regards,
Dorès
Le lun. 7 oct. 2019 à 19:59, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> Hi Dorès.
>
> I'm so sorry to see that you are still having difficulty getting MET
> installed. We have a few options:
>
> 1. The easiest way to make MET available would be using a Docker
> container. If your sys admin is willing to install Docker on that
> machine, then
> getting MET is as simple as running:
> docker pull dtcenter/met:8.1
> If not, and many sys admins object to the use of Docker,
compiling it
> from scratch is the other alternative.
> 2. Because you are having difficulty installing the external
libraries
> MET needs from scratch, we do have an install script for MET and
its
> external libraries that may be useful to you. This script may or
may
> not
> work right away. Some systems have needed more work than others.
I
> will
> attempt to help you as best as I can.
> 3. We can continue with trying to resolve problems as we have
been
> doing. I see that you have sent your make_install.log which
contains
> the
> same error that it did previously. We can do some further
debugging
> here
> if you'd like. For example, next, I would have you send me
listings of
> the
> directory (using the "ls -l" command) where the header files and
the
> library files live for the NetCDF files. I would also need you
to send
> me
> the config.log file for MET as well.
>
> Please let me know how you would like to proceed.
>
> Thanks,
> Julie
>
>
> On Mon, Oct 7, 2019 at 3:10 AM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Please, can you offer me another way to fill out my contingency
table for
> > wrf forecasts? The filing deadline of our memories is close and my
MET
> > still does not give.
> > Best Regards.
> > Dorès
> >
> > Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> > > Hello Julie
> > > Throughout the weekend, I tried to compile met. I used the same
netcdf
> as
> > > during the wrf compilation. I always get the same mistakes.
> > > I also compiled netcdf again and, I still get the errors.
> > > Attached are these files.
> > >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Tue Oct 08 09:09:57 2019
Hi Dorès.
Please refer your system administrator to the following webpage, when
you
inquire about whether or not it is ok to have MET installed using
docker:
https://dtcenter.org/community-code/model-evaluation-tools-met/docker-
container-met-8-1
Please feel free to follow up with any questions you or your system
administrator have. If you end up being unable to use Docker, we can
proceed with option 2 or 3.
Julie
On Tue, Oct 8, 2019 at 2:52 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello Julie,
> I'm so glad for the help you give me.
> I will like to proceed by the solution 1. But, I don't know if my
system
> administrator is willing to install Docker on my machine or not. My
machine
> is DELL {LATITUDE | E5430, intel core i5, system linux, Debian,
kubuntu}.
> I don't know if these informations are importantes.
> I'm expecting to you.
> Best Regards,
> Dorès
>
> Le lun. 7 oct. 2019 à 19:59, Julie Prestopnik via RT
<met_help at ucar.edu> a
> écrit :
>
> > Hi Dorès.
> >
> > I'm so sorry to see that you are still having difficulty getting
MET
> > installed. We have a few options:
> >
> > 1. The easiest way to make MET available would be using a
Docker
> > container. If your sys admin is willing to install Docker on
that
> > machine, then
> > getting MET is as simple as running:
> > docker pull dtcenter/met:8.1
> > If not, and many sys admins object to the use of Docker,
compiling it
> > from scratch is the other alternative.
> > 2. Because you are having difficulty installing the external
libraries
> > MET needs from scratch, we do have an install script for MET
and its
> > external libraries that may be useful to you. This script may
or may
> > not
> > work right away. Some systems have needed more work than
others. I
> > will
> > attempt to help you as best as I can.
> > 3. We can continue with trying to resolve problems as we have
been
> > doing. I see that you have sent your make_install.log which
contains
> > the
> > same error that it did previously. We can do some further
debugging
> > here
> > if you'd like. For example, next, I would have you send me
listings
> of
> > the
> > directory (using the "ls -l" command) where the header files
and the
> > library files live for the NetCDF files. I would also need you
to
> send
> > me
> > the config.log file for MET as well.
> >
> > Please let me know how you would like to proceed.
> >
> > Thanks,
> > Julie
> >
> >
> > On Mon, Oct 7, 2019 at 3:10 AM Das Dores Ngamini via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >
> > > Please, can you offer me another way to fill out my contingency
table
> for
> > > wrf forecasts? The filing deadline of our memories is close and
my MET
> > > still does not give.
> > > Best Regards.
> > > Dorès
> > >
> > > Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> > > écrit :
> > >
> > > > Hello Julie
> > > > Throughout the weekend, I tried to compile met. I used the
same
> netcdf
> > as
> > > > during the wrf compilation. I always get the same mistakes.
> > > > I also compiled netcdf again and, I still get the errors.
> > > > Attached are these files.
> > > >
> > >
> >
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 10 22:31:24 2019
Hello Julie,
Execuss me for not writing earlier.
I tried the best I could to install Docker. So far, the first command
gives
me the errors. So I see that it is better to change soultion.
I would like us to try the second solution.
Please, can you send me your installation script for MET and its
libraries?
I would like to start again to be sure to do everything that is to be
done.
Best Regards
Dorès
Le mar. 8 oct. 2019 à 16:09, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> Hi Dorès.
>
> Please refer your system administrator to the following webpage,
when you
> inquire about whether or not it is ok to have MET installed using
docker:
>
> https://dtcenter.org/community-code/model-evaluation-tools-
met/docker-container-met-8-1
>
> Please feel free to follow up with any questions you or your system
> administrator have. If you end up being unable to use Docker, we
can
> proceed with option 2 or 3.
>
> Julie
>
> On Tue, Oct 8, 2019 at 2:52 AM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello Julie,
> > I'm so glad for the help you give me.
> > I will like to proceed by the solution 1. But, I don't know if my
system
> > administrator is willing to install Docker on my machine or not.
My
> machine
> > is DELL {LATITUDE | E5430, intel core i5, system linux, Debian,
kubuntu}.
> > I don't know if these informations are importantes.
> > I'm expecting to you.
> > Best Regards,
> > Dorès
> >
> > Le lun. 7 oct. 2019 à 19:59, Julie Prestopnik via RT
<met_help at ucar.edu>
> a
> > écrit :
> >
> > > Hi Dorès.
> > >
> > > I'm so sorry to see that you are still having difficulty getting
MET
> > > installed. We have a few options:
> > >
> > > 1. The easiest way to make MET available would be using a
Docker
> > > container. If your sys admin is willing to install Docker on
that
> > > machine, then
> > > getting MET is as simple as running:
> > > docker pull dtcenter/met:8.1
> > > If not, and many sys admins object to the use of Docker,
compiling
> it
> > > from scratch is the other alternative.
> > > 2. Because you are having difficulty installing the external
> libraries
> > > MET needs from scratch, we do have an install script for MET
and its
> > > external libraries that may be useful to you. This script
may or
> may
> > > not
> > > work right away. Some systems have needed more work than
others. I
> > > will
> > > attempt to help you as best as I can.
> > > 3. We can continue with trying to resolve problems as we have
been
> > > doing. I see that you have sent your make_install.log which
> contains
> > > the
> > > same error that it did previously. We can do some further
debugging
> > > here
> > > if you'd like. For example, next, I would have you send me
listings
> > of
> > > the
> > > directory (using the "ls -l" command) where the header files
and the
> > > library files live for the NetCDF files. I would also need
you to
> > send
> > > me
> > > the config.log file for MET as well.
> > >
> > > Please let me know how you would like to proceed.
> > >
> > > Thanks,
> > > Julie
> > >
> > >
> > > On Mon, Oct 7, 2019 at 3:10 AM Das Dores Ngamini via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> > > >
> > > > Please, can you offer me another way to fill out my
contingency table
> > for
> > > > wrf forecasts? The filing deadline of our memories is close
and my
> MET
> > > > still does not give.
> > > > Best Regards.
> > > > Dorès
> > > >
> > > > Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini
<ngaminidas at gmail.com
> >
> > a
> > > > écrit :
> > > >
> > > > > Hello Julie
> > > > > Throughout the weekend, I tried to compile met. I used the
same
> > netcdf
> > > as
> > > > > during the wrf compilation. I always get the same mistakes.
> > > > > I also compiled netcdf again and, I still get the errors.
> > > > > Attached are these files.
> > > > >
> > > >
> > >
> > > --
> > > Julie Prestopnik
> > > Software Engineer
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > My working day may not be your working day. Please do not feel
obliged
> > to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 10 22:32:20 2019
I use the bashrc.
Le ven. 11 oct. 2019 à 05:31, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello Julie,
> Execuss me for not writing earlier.
> I tried the best I could to install Docker. So far, the first
command
> gives me the errors. So I see that it is better to change soultion.
> I would like us to try the second solution.
> Please, can you send me your installation script for MET and its
libraries?
> I would like to start again to be sure to do everything that is to
be done.
> Best Regards
> Dorès
>
> Le mar. 8 oct. 2019 à 16:09, Julie Prestopnik via RT
<met_help at ucar.edu>
> a écrit :
>
>> Hi Dorès.
>>
>> Please refer your system administrator to the following webpage,
when you
>> inquire about whether or not it is ok to have MET installed using
docker:
>>
>> https://dtcenter.org/community-code/model-evaluation-tools-
met/docker-container-met-8-1
>>
>> Please feel free to follow up with any questions you or your system
>> administrator have. If you end up being unable to use Docker, we
can
>> proceed with option 2 or 3.
>>
>> Julie
>>
>> On Tue, Oct 8, 2019 at 2:52 AM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> >
>> > Hello Julie,
>> > I'm so glad for the help you give me.
>> > I will like to proceed by the solution 1. But, I don't know if my
system
>> > administrator is willing to install Docker on my machine or not.
My
>> machine
>> > is DELL {LATITUDE | E5430, intel core i5, system linux, Debian,
>> kubuntu}.
>> > I don't know if these informations are importantes.
>> > I'm expecting to you.
>> > Best Regards,
>> > Dorès
>> >
>> > Le lun. 7 oct. 2019 à 19:59, Julie Prestopnik via RT
<met_help at ucar.edu>
>> a
>> > écrit :
>> >
>> > > Hi Dorès.
>> > >
>> > > I'm so sorry to see that you are still having difficulty
getting MET
>> > > installed. We have a few options:
>> > >
>> > > 1. The easiest way to make MET available would be using a
Docker
>> > > container. If your sys admin is willing to install Docker on
that
>> > > machine, then
>> > > getting MET is as simple as running:
>> > > docker pull dtcenter/met:8.1
>> > > If not, and many sys admins object to the use of Docker,
compiling
>> it
>> > > from scratch is the other alternative.
>> > > 2. Because you are having difficulty installing the external
>> libraries
>> > > MET needs from scratch, we do have an install script for MET
and
>> its
>> > > external libraries that may be useful to you. This script
may or
>> may
>> > > not
>> > > work right away. Some systems have needed more work than
others.
>> I
>> > > will
>> > > attempt to help you as best as I can.
>> > > 3. We can continue with trying to resolve problems as we
have been
>> > > doing. I see that you have sent your make_install.log which
>> contains
>> > > the
>> > > same error that it did previously. We can do some further
>> debugging
>> > > here
>> > > if you'd like. For example, next, I would have you send me
>> listings
>> > of
>> > > the
>> > > directory (using the "ls -l" command) where the header files
and
>> the
>> > > library files live for the NetCDF files. I would also need
you to
>> > send
>> > > me
>> > > the config.log file for MET as well.
>> > >
>> > > Please let me know how you would like to proceed.
>> > >
>> > > Thanks,
>> > > Julie
>> > >
>> > >
>> > > On Mon, Oct 7, 2019 at 3:10 AM Das Dores Ngamini via RT <
>> > met_help at ucar.edu
>> > > >
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
>> > > >
>> > > > Please, can you offer me another way to fill out my
contingency
>> table
>> > for
>> > > > wrf forecasts? The filing deadline of our memories is close
and my
>> MET
>> > > > still does not give.
>> > > > Best Regards.
>> > > > Dorès
>> > > >
>> > > > Le lun. 7 oct. 2019 à 10:03, Das Dores Ngamini <
>> ngaminidas at gmail.com>
>> > a
>> > > > écrit :
>> > > >
>> > > > > Hello Julie
>> > > > > Throughout the weekend, I tried to compile met. I used the
same
>> > netcdf
>> > > as
>> > > > > during the wrf compilation. I always get the same mistakes.
>> > > > > I also compiled netcdf again and, I still get the errors.
>> > > > > Attached are these files.
>> > > > >
>> > > >
>> > >
>> > > --
>> > > Julie Prestopnik
>> > > Software Engineer
>> > > National Center for Atmospheric Research
>> > > Research Applications Laboratory
>> > > Phone: 303.497.8399
>> > > Email: jpresto at ucar.edu
>> > >
>> > > My working day may not be your working day. Please do not feel
>> obliged
>> > to
>> > > reply to this email outside of your normal working hours.
>> > >
>> > >
>> >
>> >
>>
>> --
>> Julie Prestopnik
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Fri Oct 11 09:31:33 2019
Hi Dorès.
I'm sorry to hear that you are having trouble with Docker.
You can find the script to help you install MET at this link, and I'll
put
instructions below:
https://dtcenter.org/community-code/model-evaluation-tools-
met/download#compile
This script may or may not work right away. Some systems have needed
more
work than others. To get started, decide where you would like to
install
MET. The following example will assume you're going to put it in
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1.
You'll need to download compile_MET_all.sh and tar_files.tar from the
link
above. You'll also need to download our latest MET release:
https://dtcenter.org/sites/default/files/community-code/met/met-
8.1.1.20190708.tar.gz
Put compile_MET_all.sh.tgz (and unpack it with "tar -zxf
compile_MET_all.sh.tgz
") and tar_files.tar in
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1
(or where ever you chose to put it). Unpack the tar file and move
met-8.1.1.20190708.tar.gz into the tar_files directory.
Then, you'll need to set up some environment variables as described in
the
link above.
For reference using this example, I would set the following:
export TEST_BASE=/home/dores/Tutorial_Master/TP_Prevision/MET//8.1
export COMPILER=gnu_6.3.0 (The format is "compiler" underscore
"version".
>From previous log files you sent to me, it looks like you are using
gcc/g++, so you'll want to specify "gnu" for the compiler. You can
find the
version by running "gcc --version".)
export MET_SUBDIR=${TEST_BASE}/
export MET_TARBALL=met-8.1.1.20190708.tar.gz
If you want to install the Python embedding functionality, please set
the
following variables as well. If you do not want to use the Python
embedding functionality in MET, do not set the following environment
variables:
export MET_PYTHON_CC=`python-config --cflags`
export MET_PYTHON_LD=`python-config --ldflags` (This may not work.
Run
python-config --ldflags on the command line and see if you get output
including "-L". If you don't, please let me know and I can walk you
through how to find this information.)
export PYTHON_MODULE_USE=/usrx/local/dev/modulefiles (Assuming you're
not
using modulefiles, it doesn't matter what you set this to, but it
needs to
be set to something otherwise MET won't configure for Python
embedding.
You could just set it to "python".).
If you're not using modules, the output of the script will say
something
about modules not being found and you can safely ignore that.
You may need to make the script executable (You can do that by running
"chmod 775 compile_MET_all.sh"), but then you can run it with
"./compile_MET_all.sh". For some people who have used this script,
they
have had their own laptops with hardly anything on it. They have
needed to
install the following packages using the following commands:
sudo apt-get update
sudo apt install python-dev
sudo apt-get install flex bison
sudo apt-get install libpixman-1-dev
sudo apt-get install libjpeg-dev
sudo apt-get install pkg-config
sudo apt-get install libpng-dev
sudo apt-get install unzip
If the script runs and starts installing the external libraries
successfully but then stops, there are constants which you can set to
0, so
that you won't have to wait for them to be installed again. In the
compile
script you'll see the following which you can modify if necessary:
COMPILE_GSL=1
COMPILE_BUFRLIB=1
COMPILE_ZLIB=1
COMPILE_LIBPNG=1
COMPILE_JASPER=1
COMPILE_G2CLIB=1
COMPILE_HDF=1
COMPILE_HDFEOS=1
COMPILE_NETCDF=1
COMPILE_FREETYPE=1
COMPILE_CAIRO=1
COMPILE_MET=1
Please let me know if you have any questions. I know this is a lot to
take
in, so don't hesitate to reach out with any questions.
Thanks,
Julie
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Fri Oct 11 17:18:40 2019
Hello Julie,
It is with overwhelming joy that I am writing to you at this moment.
Because thanks to you, I have the impression of having compiled MET
successfully.
I can not find the right words to tell you how much your help has been
of
undeniable benefit to me.
To express my gratitude, I would like, if you allow me to introduce
your
name in the thank you part of my master's thesis, because I will never
have
arrived without you.
I attach to this mail files so that you check, please, if everything
has
been done correctly.
Also, I do not yet know how to bring out my contingency table with
MET. I
will read the "user guide" to see if I find a solution. But, I would
like
you to guide me, please, if you can.
Best Regards
Dorès
Le ven. 11 oct. 2019 à 16:31, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> Hi Dorès.
>
> I'm sorry to hear that you are having trouble with Docker.
>
> You can find the script to help you install MET at this link, and
I'll put
> instructions below:
>
> https://dtcenter.org/community-code/model-evaluation-tools-
met/download#compile
>
> This script may or may not work right away. Some systems have
needed more
> work than others. To get started, decide where you would like to
install
> MET. The following example will assume you're going to put it in
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1.
>
> You'll need to download compile_MET_all.sh and tar_files.tar from
the link
> above. You'll also need to download our latest MET release:
>
> https://dtcenter.org/sites/default/files/community-code/met/met-
8.1.1.20190708.tar.gz
>
> Put compile_MET_all.sh.tgz (and unpack it with "tar -zxf
> compile_MET_all.sh.tgz
> ") and tar_files.tar in
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1
> (or where ever you chose to put it). Unpack the tar file and move
> met-8.1.1.20190708.tar.gz into the tar_files directory.
>
> Then, you'll need to set up some environment variables as described
in the
> link above.
>
> For reference using this example, I would set the following:
>
> export TEST_BASE=/home/dores/Tutorial_Master/TP_Prevision/MET//8.1
> export COMPILER=gnu_6.3.0 (The format is "compiler" underscore
"version".
> From previous log files you sent to me, it looks like you are using
> gcc/g++, so you'll want to specify "gnu" for the compiler. You can
find the
> version by running "gcc --version".)
>
> export MET_SUBDIR=${TEST_BASE}/
> export MET_TARBALL=met-8.1.1.20190708.tar.gz
>
> If you want to install the Python embedding functionality, please
set the
> following variables as well. If you do not want to use the Python
> embedding functionality in MET, do not set the following environment
> variables:
>
> export MET_PYTHON_CC=`python-config --cflags`
> export MET_PYTHON_LD=`python-config --ldflags` (This may not work.
Run
> python-config --ldflags on the command line and see if you get
output
> including "-L". If you don't, please let me know and I can walk you
> through how to find this information.)
> export PYTHON_MODULE_USE=/usrx/local/dev/modulefiles (Assuming
you're not
> using modulefiles, it doesn't matter what you set this to, but it
needs to
> be set to something otherwise MET won't configure for Python
embedding.
> You could just set it to "python".).
>
> If you're not using modules, the output of the script will say
something
> about modules not being found and you can safely ignore that.
>
> You may need to make the script executable (You can do that by
running
> "chmod 775 compile_MET_all.sh"), but then you can run it with
> "./compile_MET_all.sh". For some people who have used this script,
they
> have had their own laptops with hardly anything on it. They have
needed to
> install the following packages using the following commands:
>
> sudo apt-get update
> sudo apt install python-dev
> sudo apt-get install flex bison
> sudo apt-get install libpixman-1-dev
> sudo apt-get install libjpeg-dev
> sudo apt-get install pkg-config
> sudo apt-get install libpng-dev
> sudo apt-get install unzip
>
> If the script runs and starts installing the external libraries
> successfully but then stops, there are constants which you can set
to 0, so
> that you won't have to wait for them to be installed again. In the
compile
> script you'll see the following which you can modify if necessary:
>
> COMPILE_GSL=1
> COMPILE_BUFRLIB=1
> COMPILE_ZLIB=1
> COMPILE_LIBPNG=1
> COMPILE_JASPER=1
> COMPILE_G2CLIB=1
> COMPILE_HDF=1
> COMPILE_HDFEOS=1
> COMPILE_NETCDF=1
> COMPILE_FREETYPE=1
> COMPILE_CAIRO=1
> COMPILE_MET=1
>
> Please let me know if you have any questions. I know this is a lot
to take
> in, so don't hesitate to reach out with any questions.
>
> Thanks,
> Julie
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Help
From: Julie Prestopnik
Time: Mon Oct 14 09:42:51 2019
Hi Dorès.
This was a very nice message to receive this morning. I am so glad
that
you were able to get MET installed using the script! I took a look at
the
files that you sent and everything looks good to me as well.
Congratulations!
Regarding mentioning my name in your master's thesis, that is totally
fine
if that is what you would like to do, but certainly not necessary. I
hope
your master's thesis will go well!
I'll go ahead and close this ticket regarding the MET installation
issues.
Please feel free to start a new ticket with met_help at ucar.edu with any
questions you have regarding contingency tables. Our team will do our
best
to help you.
Kind regards,
Julie
On Fri, Oct 11, 2019 at 5:18 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello Julie,
> It is with overwhelming joy that I am writing to you at this moment.
> Because thanks to you, I have the impression of having compiled MET
> successfully.
> I can not find the right words to tell you how much your help has
been of
> undeniable benefit to me.
> To express my gratitude, I would like, if you allow me to introduce
your
> name in the thank you part of my master's thesis, because I will
never have
> arrived without you.
>
> I attach to this mail files so that you check, please, if everything
has
> been done correctly.
>
> Also, I do not yet know how to bring out my contingency table with
MET. I
> will read the "user guide" to see if I find a solution. But, I would
like
> you to guide me, please, if you can.
>
> Best Regards
> Dorès
>
> Le ven. 11 oct. 2019 à 16:31, Julie Prestopnik via RT
<met_help at ucar.edu>
> a
> écrit :
>
> > Hi Dorès.
> >
> > I'm sorry to hear that you are having trouble with Docker.
> >
> > You can find the script to help you install MET at this link, and
I'll
> put
> > instructions below:
> >
> >
> https://dtcenter.org/community-code/model-evaluation-tools-
met/download#compile
> >
> > This script may or may not work right away. Some systems have
needed
> more
> > work than others. To get started, decide where you would like to
install
> > MET. The following example will assume you're going to put it in
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1.
> >
> > You'll need to download compile_MET_all.sh and tar_files.tar from
the
> link
> > above. You'll also need to download our latest MET release:
> >
> >
> https://dtcenter.org/sites/default/files/community-code/met/met-
8.1.1.20190708.tar.gz
> >
> > Put compile_MET_all.sh.tgz (and unpack it with "tar -zxf
> > compile_MET_all.sh.tgz
> > ") and tar_files.tar in
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1
> > (or where ever you chose to put it). Unpack the tar file and move
> > met-8.1.1.20190708.tar.gz into the tar_files directory.
> >
> > Then, you'll need to set up some environment variables as
described in
> the
> > link above.
> >
> > For reference using this example, I would set the following:
> >
> > export TEST_BASE=/home/dores/Tutorial_Master/TP_Prevision/MET//8.1
> > export COMPILER=gnu_6.3.0 (The format is "compiler" underscore
> "version".
> > From previous log files you sent to me, it looks like you are
using
> > gcc/g++, so you'll want to specify "gnu" for the compiler. You can
find
> the
> > version by running "gcc --version".)
> >
> > export MET_SUBDIR=${TEST_BASE}/
> > export MET_TARBALL=met-8.1.1.20190708.tar.gz
> >
> > If you want to install the Python embedding functionality, please
set the
> > following variables as well. If you do not want to use the Python
> > embedding functionality in MET, do not set the following
environment
> > variables:
> >
> > export MET_PYTHON_CC=`python-config --cflags`
> > export MET_PYTHON_LD=`python-config --ldflags` (This may not work.
Run
> > python-config --ldflags on the command line and see if you get
output
> > including "-L". If you don't, please let me know and I can walk
you
> > through how to find this information.)
> > export PYTHON_MODULE_USE=/usrx/local/dev/modulefiles (Assuming
you're not
> > using modulefiles, it doesn't matter what you set this to, but it
needs
> to
> > be set to something otherwise MET won't configure for Python
embedding.
> > You could just set it to "python".).
> >
> > If you're not using modules, the output of the script will say
something
> > about modules not being found and you can safely ignore that.
> >
> > You may need to make the script executable (You can do that by
running
> > "chmod 775 compile_MET_all.sh"), but then you can run it with
> > "./compile_MET_all.sh". For some people who have used this
script, they
> > have had their own laptops with hardly anything on it. They have
needed
> to
> > install the following packages using the following commands:
> >
> > sudo apt-get update
> > sudo apt install python-dev
> > sudo apt-get install flex bison
> > sudo apt-get install libpixman-1-dev
> > sudo apt-get install libjpeg-dev
> > sudo apt-get install pkg-config
> > sudo apt-get install libpng-dev
> > sudo apt-get install unzip
> >
> > If the script runs and starts installing the external libraries
> > successfully but then stops, there are constants which you can set
to 0,
> so
> > that you won't have to wait for them to be installed again. In
the
> compile
> > script you'll see the following which you can modify if necessary:
> >
> > COMPILE_GSL=1
> > COMPILE_BUFRLIB=1
> > COMPILE_ZLIB=1
> > COMPILE_LIBPNG=1
> > COMPILE_JASPER=1
> > COMPILE_G2CLIB=1
> > COMPILE_HDF=1
> > COMPILE_HDFEOS=1
> > COMPILE_NETCDF=1
> > COMPILE_FREETYPE=1
> > COMPILE_CAIRO=1
> > COMPILE_MET=1
> >
> > Please let me know if you have any questions. I know this is a
lot to
> take
> > in, so don't hesitate to reach out with any questions.
> >
> > Thanks,
> > Julie
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 17 03:35:58 2019
Hello Julie.
I try to fill the contingency table with MET. I want to use
Point_Stat. My
forecast data are the outputs of WRF and my observations
data are ERAI. I want to fill the contingency table for "precipitable
water", "Relative Humidity" and "Wind vector". I read the
MET_Users_Guide.pdf, but dont know how to find the "Number of forecast
yes
and observation yes", "Number of forecast yes and observation no",
"Number
of forecast no and observation yes" and "Number of forecast no and
observation no". Please, may-you help-me to find these numbers?
Best Regards.
Dores
Le lun. 14 oct. 2019 à 16:42, Julie Prestopnik via RT
<met_help at ucar.edu> a
écrit :
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Thu Oct 17 09:19:09 2019
Hello Dores,
My name is John Halley Gotway. I work with Julie on providing support
for the MET software. She handed this ticket off to me. I see that
you have WRF output and would like to compare to ERA interim data.
It sounds like you need help getting up and running with the MET tools
on your data. In general, we recommend that users post-process their
WRF output files using the Unified Post-Processor (UPP). That tool
destaggers the WRF output in the horizontal and interpolates to
pressure levels in the vertical. If you are only interested in
surface variables that are unstaggered (e.g. mass-points and not wind
values), then you could process the raw WRF output directly. But if
you'd like to process winds or evaluate the vertical output of WRF,
then you'll need to post-process first.
If you'd like, you could post a sample WRF output file and the
verifying ERA interim file to our FTP site, and I can take a look and
make some specific suggestions. Instructions for sending us data can
be found here:
https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
Thanks,
John
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 17 19:33:11 2019
Hello John !
Thank you for your mail.
I try to send my data with FTP, but I dont know if they were send.
Attached these data.
Best Regards
Dores
ERAI_pv_r_u_v_w_variables.nc
<https://drive.google.com/file/d/1UMNY7vYnIfJh1F4OP-
V8ni8wSbYlia61/view?usp=drive_web>
ERAI_pw.nc
<https://drive.google.com/file/d/1eERxpCRzSQRPfJ2bG-
Iqbseqh0jbSiSF/view?usp=drive_web>
wrfout_25
<https://drive.google.com/file/d/1UJB4VHhOrDXD8gC6pkeU7CArrsiVSgU7/view?usp=drive_web>
wrfout_25_2.nc
<https://drive.google.com/file/d/1LxX0Hs8jLD-
DYAcJxUWkuJN9wNTawaYA/view?usp=drive_web>
Le jeu. 17 oct. 2019 à 16:19, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Hello Dores,
>
> My name is John Halley Gotway. I work with Julie on providing
support for
> the MET software. She handed this ticket off to me. I see that you
have
> WRF output and would like to compare to ERA interim data.
>
> It sounds like you need help getting up and running with the MET
tools on
> your data. In general, we recommend that users post-process their
WRF
> output files using the Unified Post-Processor (UPP). That tool
destaggers
> the WRF output in the horizontal and interpolates to pressure levels
in the
> vertical. If you are only interested in surface variables that are
> unstaggered (e.g. mass-points and not wind values), then you could
process
> the raw WRF output directly. But if you'd like to process winds or
> evaluate the vertical output of WRF, then you'll need to post-
process first.
>
> If you'd like, you could post a sample WRF output file and the
verifying
> ERA interim file to our FTP site, and I can take a look and make
some
> specific suggestions. Instructions for sending us data can be found
here:
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>
> Thanks,
> John
>
>
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Fri Oct 18 09:13:26 2019
I just took a look and see that this ftp directory is empty:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data
Please try again.
Thanks,
John
On Thu, Oct 17, 2019 at 7:34 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John !
> Thank you for your mail.
> I try to send my data with FTP, but I dont know if they were send.
> Attached these data.
> Best Regards
> Dores
> ERAI_pv_r_u_v_w_variables.nc
> <
> https://drive.google.com/file/d/1UMNY7vYnIfJh1F4OP-
V8ni8wSbYlia61/view?usp=drive_web
> >
> ERAI_pw.nc
> <
> https://drive.google.com/file/d/1eERxpCRzSQRPfJ2bG-
Iqbseqh0jbSiSF/view?usp=drive_web
> >
> wrfout_25
> <
>
https://drive.google.com/file/d/1UJB4VHhOrDXD8gC6pkeU7CArrsiVSgU7/view?usp=drive_web
> >
> wrfout_25_2.nc
> <
> https://drive.google.com/file/d/1LxX0Hs8jLD-
DYAcJxUWkuJN9wNTawaYA/view?usp=drive_web
> >
>
> Le jeu. 17 oct. 2019 à 16:19, John Halley Gotway via RT
<met_help at ucar.edu
> >
> a écrit :
>
> > Hello Dores,
> >
> > My name is John Halley Gotway. I work with Julie on providing
support
> for
> > the MET software. She handed this ticket off to me. I see that
you have
> > WRF output and would like to compare to ERA interim data.
> >
> > It sounds like you need help getting up and running with the MET
tools on
> > your data. In general, we recommend that users post-process their
WRF
> > output files using the Unified Post-Processor (UPP). That tool
> destaggers
> > the WRF output in the horizontal and interpolates to pressure
levels in
> the
> > vertical. If you are only interested in surface variables that
are
> > unstaggered (e.g. mass-points and not wind values), then you could
> process
> > the raw WRF output directly. But if you'd like to process winds
or
> > evaluate the vertical output of WRF, then you'll need to post-
process
> first.
> >
> > If you'd like, you could post a sample WRF output file and the
verifying
> > ERA interim file to our FTP site, and I can take a look and make
some
> > specific suggestions. Instructions for sending us data can be
found
> here:
> >
> >
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >
> > Thanks,
> > John
> >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sat Oct 19 05:42:53 2019
Hello John
I can't put file in FTP.
When I try to put file, I have :
- No such file or directory
Yet, these files exist.
Please, may-you use the files that I send by mail ?
Best regards
Dores
Le ven. 18 oct. 2019 à 16:13, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> I just took a look and see that this ftp directory is empty:
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data
>
> Please try again.
>
> Thanks,
> John
>
> On Thu, Oct 17, 2019 at 7:34 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John !
> > Thank you for your mail.
> > I try to send my data with FTP, but I dont know if they were send.
> > Attached these data.
> > Best Regards
> > Dores
> > ERAI_pv_r_u_v_w_variables.nc
> > <
> >
> https://drive.google.com/file/d/1UMNY7vYnIfJh1F4OP-
V8ni8wSbYlia61/view?usp=drive_web
> > >
> > ERAI_pw.nc
> > <
> >
> https://drive.google.com/file/d/1eERxpCRzSQRPfJ2bG-
Iqbseqh0jbSiSF/view?usp=drive_web
> > >
> > wrfout_25
> > <
> >
>
https://drive.google.com/file/d/1UJB4VHhOrDXD8gC6pkeU7CArrsiVSgU7/view?usp=drive_web
> > >
> > wrfout_25_2.nc
> > <
> >
> https://drive.google.com/file/d/1LxX0Hs8jLD-
DYAcJxUWkuJN9wNTawaYA/view?usp=drive_web
> > >
> >
> > Le jeu. 17 oct. 2019 à 16:19, John Halley Gotway via RT <
> met_help at ucar.edu
> > >
> > a écrit :
> >
> > > Hello Dores,
> > >
> > > My name is John Halley Gotway. I work with Julie on providing
support
> > for
> > > the MET software. She handed this ticket off to me. I see that
you
> have
> > > WRF output and would like to compare to ERA interim data.
> > >
> > > It sounds like you need help getting up and running with the MET
tools
> on
> > > your data. In general, we recommend that users post-process
their WRF
> > > output files using the Unified Post-Processor (UPP). That tool
> > destaggers
> > > the WRF output in the horizontal and interpolates to pressure
levels in
> > the
> > > vertical. If you are only interested in surface variables that
are
> > > unstaggered (e.g. mass-points and not wind values), then you
could
> > process
> > > the raw WRF output directly. But if you'd like to process winds
or
> > > evaluate the vertical output of WRF, then you'll need to post-
process
> > first.
> > >
> > > If you'd like, you could post a sample WRF output file and the
> verifying
> > > ERA interim file to our FTP site, and I can take a look and make
some
> > > specific suggestions. Instructions for sending us data can be
found
> > here:
> > >
> > >
> >
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > >
> > > Thanks,
> > > John
> > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Stephen Dowdy
Time: Tue Oct 22 08:46:43 2019
E-mail exchange i sent this morning prior to this ticket appearing.
On 10/21/19 2:12 PM, Das Dores Ngamini wrote:
> ftp> put
"file:///home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
<http://wrfout_25_2.nc>"
> local:
file:///home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
<http://wrfout_25_2.nc> remote:
file:///home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
<http://wrfout_25_2.nc>
> local:
file:///home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
<http://wrfout_25_2.nc>: No such file or directory
Dores,
thanks for the explanatory text from John Halley Gotway.
I think the issue here is that you are specifying full file paths on
your upload. this will attempt to create the same directory path on
our server.
You should only do something like:
put wrfout_25_2.nc
and not:
put
/home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
This will try to create a file on our server by the name:
/incoming/irap_met_help/dores_data/home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
and that entire path does not exist.
Some ftp clients have the ability to specify a new filename as a
second argument, like:
put
/home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
wrfout_25_2.nc
others interpret that as sending TWO files, and some ftp clients (e.g.
ncftp) use the '-z' flag, like:
put -z
/home/dores/Tutorial_Master/TP_Prevision/WRF_DATA/wrfout_25_2.nc
wrfout_25_2.nc
to specify renaming the file as the second argument on the server.
Hopefully that helps.
--stephen
------------------------------------------------
Subject: Help
From: Stephen Dowdy
Time: Tue Oct 22 08:50:44 2019
John,
I'm merging in a non MET FTP ticket from Dores into this ticket with
explanation of what i think the problem is (specifying full paths on
the files w/o telling the FTP server to rename to non-pathed filename.
If you want, it might be helpful to add something about that to your
Met Help FTP upload page.
thanks,
--stephen
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Tue Oct 22 13:49:39 2019
Dores,
Were you able to post any data to the ftp site? You could try sending
via
email but I worry that the data files will be too large to transfer
that
way.
Stephen is right... you need to put the files one by way. By way of
example, here are commands to create a file named hello_world.txt and
post
it to our ftp site.
cd /home/johnhg
echo "hello world" > hello_world.txt
ftp ftp.rap.ucar.edu
username = anonymous
password = "my email address"
cd incoming/irap/met_help/dores_data
put hello_world.txt
bye
And then checking the ftp via a web browser:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
I see that file now exists. Just be sure that you're in the directory
which contains the files you want to send before running ftp.
Thanks,
John
On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
>
> John,
>
> I'm merging in a non MET FTP ticket from Dores into this ticket with
> explanation of what i think the problem is (specifying full paths on
the
> files w/o telling the FTP server to rename to non-pathed filename.
>
> If you want, it might be helpful to add something about that to your
Met
> Help FTP upload page.
>
> thanks,
> --stephen
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 24 22:16:35 2019
Hello John,
I have already sent my data to my ftp site. In these files, I want to
extract the pw. There is another missing ERAI file. That one, I have
trouble sending it. It contains the relative humidity and wind data.
Please,
just tell me how to do it because I can not send this file. There are
two
wrfout files because my forecasts are made over 24 hours or more. My
raw
wrf outputs are in "HDF", and I can not send them. That's why I sent
those
in NetCDF. If I continue to wait for the other files to be sent, the
time
to deposit my memory will expire.
Thank you very much for helping me.
Yours sincerely.
Dores
Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> Were you able to post any data to the ftp site? You could try
sending via
> email but I worry that the data files will be too large to transfer
that
> way.
>
> Stephen is right... you need to put the files one by way. By way of
> example, here are commands to create a file named hello_world.txt
and post
> it to our ftp site.
>
> cd /home/johnhg
> echo "hello world" > hello_world.txt
> ftp ftp.rap.ucar.edu
> username = anonymous
> password = "my email address"
> cd incoming/irap/met_help/dores_data
> put hello_world.txt
> bye
>
> And then checking the ftp via a web browser:
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>
> I see that file now exists. Just be sure that you're in the
directory
> which contains the files you want to send before running ftp.
>
> Thanks,
> John
>
>
>
>
> On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> >
> > John,
> >
> > I'm merging in a non MET FTP ticket from Dores into this ticket
with
> > explanation of what i think the problem is (specifying full paths
on the
> > files w/o telling the FTP server to rename to non-pathed filename.
> >
> > If you want, it might be helpful to add something about that to
your Met
> > Help FTP upload page.
> >
> > thanks,
> > --stephen
> >
>
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Fri Oct 25 10:08:32 2019
Dores,
OK, great. Thanks for sending some sample data.
When getting started with new datasets in MET, I always start by
running
the plot_data_plane tool to make sure MET can read the data and place
it on
the earth correctly.
The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can easily
read
that:
*/usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
ERAI_pw_2018071900.ps **'name="tcw"; level="(2018071900,*,*)";' -v 4*
Next for the WRF output. When I try passing it to MET directly, I get
an
error message:
ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid data
file
However, since this is on a lat/lon grid, we can just tell MET to
interpret
it as being CF-compliant NetCDF, like this "file_type = NETCDF_NCCF;":
*/usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
<http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
<http://wrfout_pw_2018071900.ps> **'name="pw";
level="(2018071900,*,*)";
file_type=NETCDF_NCCF;' -v 4*
PNG versions of the resulting images are attached.
Looking at these images, we see that MET is able to read data from
them.
And I'll leave it to you to confirm that MET is placing them in the
right
spot on earth, but I assume it is.
Next, let's run Grid-Stat to compute statistics on them. I've set up
the
attached Grid-Stat config file to...
(1) Regrid the ERAI data to the model domain using the budget
interpolation
method
regrid = {
to_grid = FCST;
method = BUDGET;
width = 2;
vld_thresh = 0.5;
shape = SQUARE;
}
(2) Transfer the config options from the plot_data_plane command line
to
the "fcst" and "obs" dictionaries. For convenience, I defined the
time as
an environment variable named $VXTIME:
fcst = {
file_type = NETCDF_NCCF;
field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
}
obs = {
field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
}
(3) Compute stats over the FULL model domain.
mask = {
grid = [ "FULL" ];
poly = [];
}
(4) And just compute continuous stats.
output_flag = {
...
cnt = BOTH;
...
}
Finally, run Grid-Stat on the command line like this:
*mkdir -p out*
*setenv VXTIME "2018071900"*
*/usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<http://wrfout_19_2.nc>
ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
And that run successfully and creates output files:
DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V.stat
DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V_cnt.txt
DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V_pairs.nc
Looking in the "_cnt.txt" file for example, the RMSE value = 3.39378.
Hope this helps get you up and running with MET.
Thanks,
John Halley Gotway
On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John,
> I have already sent my data to my ftp site. In these files, I want
to
> extract the pw. There is another missing ERAI file. That one, I have
> trouble sending it. It contains the relative humidity and wind data.
> Please,
> just tell me how to do it because I can not send this file. There
are two
> wrfout files because my forecasts are made over 24 hours or more. My
raw
> wrf outputs are in "HDF", and I can not send them. That's why I sent
those
> in NetCDF. If I continue to wait for the other files to be sent, the
time
> to deposit my memory will expire.
> Thank you very much for helping me.
> Yours sincerely.
> Dores
>
> Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT
<met_help at ucar.edu
> >
> a écrit :
>
> > Dores,
> >
> > Were you able to post any data to the ftp site? You could try
sending
> via
> > email but I worry that the data files will be too large to
transfer that
> > way.
> >
> > Stephen is right... you need to put the files one by way. By way
of
> > example, here are commands to create a file named hello_world.txt
and
> post
> > it to our ftp site.
> >
> > cd /home/johnhg
> > echo "hello world" > hello_world.txt
> > ftp ftp.rap.ucar.edu
> > username = anonymous
> > password = "my email address"
> > cd incoming/irap/met_help/dores_data
> > put hello_world.txt
> > bye
> >
> > And then checking the ftp via a web browser:
> > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> >
> > I see that file now exists. Just be sure that you're in the
directory
> > which contains the files you want to send before running ftp.
> >
> > Thanks,
> > John
> >
> >
> >
> >
> > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >
> > >
> > > John,
> > >
> > > I'm merging in a non MET FTP ticket from Dores into this ticket
with
> > > explanation of what i think the problem is (specifying full
paths on
> the
> > > files w/o telling the FTP server to rename to non-pathed
filename.
> > >
> > > If you want, it might be helpful to add something about that to
your
> Met
> > > Help FTP upload page.
> > >
> > > thanks,
> > > --stephen
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Fri Oct 25 11:01:31 2019
Thank you very much.
Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> OK, great. Thanks for sending some sample data.
>
> When getting started with new datasets in MET, I always start by
running
> the plot_data_plane tool to make sure MET can read the data and
place it on
> the earth correctly.
>
> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can easily
read
> that:
>
> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> ERAI_pw_2018071900.ps **'name="tcw"; level="(2018071900,*,*)";' -v
4*
>
> Next for the WRF output. When I try passing it to MET directly, I
get an
> error message:
> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid data
file
>
> However, since this is on a lat/lon grid, we can just tell MET to
interpret
> it as being CF-compliant NetCDF, like this "file_type =
NETCDF_NCCF;":
>
> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> <http://wrfout_pw_2018071900.ps> **'name="pw";
level="(2018071900,*,*)";
> file_type=NETCDF_NCCF;' -v 4*
>
> PNG versions of the resulting images are attached.
>
> Looking at these images, we see that MET is able to read data from
them.
> And I'll leave it to you to confirm that MET is placing them in the
right
> spot on earth, but I assume it is.
>
> Next, let's run Grid-Stat to compute statistics on them. I've set
up the
> attached Grid-Stat config file to...
>
> (1) Regrid the ERAI data to the model domain using the budget
interpolation
> method
> regrid = {
> to_grid = FCST;
> method = BUDGET;
> width = 2;
> vld_thresh = 0.5;
> shape = SQUARE;
> }
>
> (2) Transfer the config options from the plot_data_plane command
line to
> the "fcst" and "obs" dictionaries. For convenience, I defined the
time as
> an environment variable named $VXTIME:
> fcst = {
> file_type = NETCDF_NCCF;
> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
> }
> obs = {
> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
> }
>
> (3) Compute stats over the FULL model domain.
> mask = {
> grid = [ "FULL" ];
> poly = [];
> }
>
> (4) And just compute continuous stats.
> output_flag = {
> ...
> cnt = BOTH;
> ...
> }
>
> Finally, run Grid-Stat on the command line like this:
>
> *mkdir -p out*
> *setenv VXTIME "2018071900"*
> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<http://wrfout_19_2.nc>
> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>
> And that run successfully and creates output files:
> DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V.stat
> DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V_cnt.txt
> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_pairs.nc
>
> Looking in the "_cnt.txt" file for example, the RMSE value =
3.39378.
>
> Hope this helps get you up and running with MET.
>
> Thanks,
> John Halley Gotway
>
>
> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John,
> > I have already sent my data to my ftp site. In these files, I want
to
> > extract the pw. There is another missing ERAI file. That one, I
have
> > trouble sending it. It contains the relative humidity and wind
data.
> > Please,
> > just tell me how to do it because I can not send this file. There
are two
> > wrfout files because my forecasts are made over 24 hours or more.
My raw
> > wrf outputs are in "HDF", and I can not send them. That's why I
sent
> those
> > in NetCDF. If I continue to wait for the other files to be sent,
the time
> > to deposit my memory will expire.
> > Thank you very much for helping me.
> > Yours sincerely.
> > Dores
> >
> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
> met_help at ucar.edu
> > >
> > a écrit :
> >
> > > Dores,
> > >
> > > Were you able to post any data to the ftp site? You could try
sending
> > via
> > > email but I worry that the data files will be too large to
transfer
> that
> > > way.
> > >
> > > Stephen is right... you need to put the files one by way. By
way of
> > > example, here are commands to create a file named
hello_world.txt and
> > post
> > > it to our ftp site.
> > >
> > > cd /home/johnhg
> > > echo "hello world" > hello_world.txt
> > > ftp ftp.rap.ucar.edu
> > > username = anonymous
> > > password = "my email address"
> > > cd incoming/irap/met_help/dores_data
> > > put hello_world.txt
> > > bye
> > >
> > > And then checking the ftp via a web browser:
> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > >
> > > I see that file now exists. Just be sure that you're in the
directory
> > > which contains the files you want to send before running ftp.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > >
> > >
> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> > > >
> > > >
> > > > John,
> > > >
> > > > I'm merging in a non MET FTP ticket from Dores into this
ticket with
> > > > explanation of what i think the problem is (specifying full
paths on
> > the
> > > > files w/o telling the FTP server to rename to non-pathed
filename.
> > > >
> > > > If you want, it might be helpful to add something about that
to your
> > Met
> > > > Help FTP upload page.
> > > >
> > > > thanks,
> > > > --stephen
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sun Oct 27 05:35:50 2019
Hello John,
I am still unable to pull out my contingency table (CTC) with MET. I
have
read your email, the user guide, the online tutorial, but I still do
not
understand how I should run.
I see the lines of code:
Use: grid_stat
fcst_file
obs_file
config_file
[-outdir path]
[-log file]
[-v level]
[-compress level]
And, I do not know where I have to write them.
I see your run command lines:
* mkdir -p out *
* setenv VXTIME "2018071900" *
* / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc <
http://wrfout_19_2.nc>
ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
"setenv" did not give, I had to install "getenv".
Command 'setenv' not found, did you mean:
command 'getenv' from snap getenv (0.2.0)
See 'snap info <snapname>' for additional versions.
But when I try to run, I have errors:
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $ getenv VXTIME "2018071900"
usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>] [-s
<source_dir>]
getenv: error: unrecognized arguments: VXTIME 2018071900
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc <http: // wrfout_19_2. n>
bash: syntax error near unexpected `newline '
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or directory
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
.nc
bash:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
Is a directory
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc <http: // wrfout_19_2. n>
bash: syntax error near unexpected `newline '
dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1 /
scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw -outdir out
-v 3
ERAI_pw.nc: command not found
Can you please, send me your execution script.
I may not be performing them properly. Please help me. I'm lost.
Best regards
Dores
Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Thank you very much.
>
> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> Dores,
>>
>> OK, great. Thanks for sending some sample data.
>>
>> When getting started with new datasets in MET, I always start by
running
>> the plot_data_plane tool to make sure MET can read the data and
place it
>> on
>> the earth correctly.
>>
>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can easily
read
>> that:
>>
>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
>> ERAI_pw_2018071900.ps **'name="tcw"; level="(2018071900,*,*)";' -v
4*
>>
>> Next for the WRF output. When I try passing it to MET directly, I
get an
>> error message:
>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid data
file
>>
>> However, since this is on a lat/lon grid, we can just tell MET to
>> interpret
>> it as being CF-compliant NetCDF, like this "file_type =
NETCDF_NCCF;":
>>
>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
>> <http://wrfout_pw_2018071900.ps> **'name="pw";
level="(2018071900,*,*)";
>> file_type=NETCDF_NCCF;' -v 4*
>>
>> PNG versions of the resulting images are attached.
>>
>> Looking at these images, we see that MET is able to read data from
them.
>> And I'll leave it to you to confirm that MET is placing them in the
right
>> spot on earth, but I assume it is.
>>
>> Next, let's run Grid-Stat to compute statistics on them. I've set
up the
>> attached Grid-Stat config file to...
>>
>> (1) Regrid the ERAI data to the model domain using the budget
>> interpolation
>> method
>> regrid = {
>> to_grid = FCST;
>> method = BUDGET;
>> width = 2;
>> vld_thresh = 0.5;
>> shape = SQUARE;
>> }
>>
>> (2) Transfer the config options from the plot_data_plane command
line to
>> the "fcst" and "obs" dictionaries. For convenience, I defined the
time as
>> an environment variable named $VXTIME:
>> fcst = {
>> file_type = NETCDF_NCCF;
>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
>> }
>> obs = {
>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
>> }
>>
>> (3) Compute stats over the FULL model domain.
>> mask = {
>> grid = [ "FULL" ];
>> poly = [];
>> }
>>
>> (4) And just compute continuous stats.
>> output_flag = {
>> ...
>> cnt = BOTH;
>> ...
>> }
>>
>> Finally, run Grid-Stat on the command line like this:
>>
>> *mkdir -p out*
>> *setenv VXTIME "2018071900"*
>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<http://wrfout_19_2.nc
>> >
>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>>
>> And that run successfully and creates output files:
>> DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V.stat
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_cnt.txt
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_pairs.nc
>>
>> Looking in the "_cnt.txt" file for example, the RMSE value =
3.39378.
>>
>> Hope this helps get you up and running with MET.
>>
>> Thanks,
>> John Halley Gotway
>>
>>
>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> >
>> > Hello John,
>> > I have already sent my data to my ftp site. In these files, I
want to
>> > extract the pw. There is another missing ERAI file. That one, I
have
>> > trouble sending it. It contains the relative humidity and wind
data.
>> > Please,
>> > just tell me how to do it because I can not send this file. There
are
>> two
>> > wrfout files because my forecasts are made over 24 hours or more.
My raw
>> > wrf outputs are in "HDF", and I can not send them. That's why I
sent
>> those
>> > in NetCDF. If I continue to wait for the other files to be sent,
the
>> time
>> > to deposit my memory will expire.
>> > Thank you very much for helping me.
>> > Yours sincerely.
>> > Dores
>> >
>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
>> met_help at ucar.edu
>> > >
>> > a écrit :
>> >
>> > > Dores,
>> > >
>> > > Were you able to post any data to the ftp site? You could try
sending
>> > via
>> > > email but I worry that the data files will be too large to
transfer
>> that
>> > > way.
>> > >
>> > > Stephen is right... you need to put the files one by way. By
way of
>> > > example, here are commands to create a file named
hello_world.txt and
>> > post
>> > > it to our ftp site.
>> > >
>> > > cd /home/johnhg
>> > > echo "hello world" > hello_world.txt
>> > > ftp ftp.rap.ucar.edu
>> > > username = anonymous
>> > > password = "my email address"
>> > > cd incoming/irap/met_help/dores_data
>> > > put hello_world.txt
>> > > bye
>> > >
>> > > And then checking the ftp via a web browser:
>> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>> > >
>> > > I see that file now exists. Just be sure that you're in the
directory
>> > > which contains the files you want to send before running ftp.
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > >
>> > >
>> > >
>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
>> > > >
>> > > >
>> > > > John,
>> > > >
>> > > > I'm merging in a non MET FTP ticket from Dores into this
ticket with
>> > > > explanation of what i think the problem is (specifying full
paths on
>> > the
>> > > > files w/o telling the FTP server to rename to non-pathed
filename.
>> > > >
>> > > > If you want, it might be helpful to add something about that
to your
>> > Met
>> > > > Help FTP upload page.
>> > > >
>> > > > thanks,
>> > > > --stephen
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sun Oct 27 09:38:59 2019
hello John,
Excuse me, I beg you, to bother you.
I created a symbolic link between my data and the pcp-combines
directory. I
used test_grid_stat.sh which I modified. I compile it, it did not
produce
anything. I tried the command lines you sent me and I get the errors I
sent
you. I really have no idea to get me out. I beg you, please, to help
me.
Attaching my test_grid_stat.sh file.
Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> I am still unable to pull out my contingency table (CTC) with MET. I
have
> read your email, the user guide, the online tutorial, but I still do
not
> understand how I should run.
> I see the lines of code:
>
> Use: grid_stat
> fcst_file
> obs_file
> config_file
> [-outdir path]
> [-log file]
> [-v level]
> [-compress level]
>
> And, I do not know where I have to write them.
> I see your run command lines:
>
> * mkdir -p out *
> * setenv VXTIME "2018071900" *
> * / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc <
> http://wrfout_19_2.nc>
> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
>
> "setenv" did not give, I had to install "getenv".
>
> Command 'setenv' not found, did you mean:
>
> command 'getenv' from snap getenv (0.2.0)
>
> See 'snap info <snapname>' for additional versions.
>
> But when I try to run, I have errors:
>
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $ getenv VXTIME "2018071900"
> usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>] [-s
> <source_dir>]
> getenv: error: unrecognized arguments: VXTIME 2018071900
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> wrfout_19_2.nc <http: // wrfout_19_2. n>
> bash: syntax error near unexpected `newline '
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> wrfout_19_2.nc
> bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or directory
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> .nc
> bash:
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> Is a directory
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> wrfout_19_2.nc <http: // wrfout_19_2. n>
> bash: syntax error near unexpected `newline '
> dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 / met-
8.1.1
> / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw -outdir
out -v 3
> ERAI_pw.nc: command not found
>
> Can you please, send me your execution script.
> I may not be performing them properly. Please help me. I'm lost.
>
> Best regards
> Dores
>
> Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
>> Thank you very much.
>>
>> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
>> met_help at ucar.edu> a écrit :
>>
>>> Dores,
>>>
>>> OK, great. Thanks for sending some sample data.
>>>
>>> When getting started with new datasets in MET, I always start by
running
>>> the plot_data_plane tool to make sure MET can read the data and
place it
>>> on
>>> the earth correctly.
>>>
>>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can
easily read
>>> that:
>>>
>>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
>>> ERAI_pw_2018071900.ps **'name="tcw"; level="(2018071900,*,*)";'
-v 4*
>>>
>>> Next for the WRF output. When I try passing it to MET directly, I
get an
>>> error message:
>>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid data
file
>>>
>>> However, since this is on a lat/lon grid, we can just tell MET to
>>> interpret
>>> it as being CF-compliant NetCDF, like this "file_type =
NETCDF_NCCF;":
>>>
>>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
>>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
>>> <http://wrfout_pw_2018071900.ps> **'name="pw";
level="(2018071900,*,*)";
>>> file_type=NETCDF_NCCF;' -v 4*
>>>
>>> PNG versions of the resulting images are attached.
>>>
>>> Looking at these images, we see that MET is able to read data from
them.
>>> And I'll leave it to you to confirm that MET is placing them in
the right
>>> spot on earth, but I assume it is.
>>>
>>> Next, let's run Grid-Stat to compute statistics on them. I've set
up the
>>> attached Grid-Stat config file to...
>>>
>>> (1) Regrid the ERAI data to the model domain using the budget
>>> interpolation
>>> method
>>> regrid = {
>>> to_grid = FCST;
>>> method = BUDGET;
>>> width = 2;
>>> vld_thresh = 0.5;
>>> shape = SQUARE;
>>> }
>>>
>>> (2) Transfer the config options from the plot_data_plane command
line to
>>> the "fcst" and "obs" dictionaries. For convenience, I defined the
time
>>> as
>>> an environment variable named $VXTIME:
>>> fcst = {
>>> file_type = NETCDF_NCCF;
>>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; }
];
>>> }
>>> obs = {
>>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; }
];
>>> }
>>>
>>> (3) Compute stats over the FULL model domain.
>>> mask = {
>>> grid = [ "FULL" ];
>>> poly = [];
>>> }
>>>
>>> (4) And just compute continuous stats.
>>> output_flag = {
>>> ...
>>> cnt = BOTH;
>>> ...
>>> }
>>>
>>> Finally, run Grid-Stat on the command line like this:
>>>
>>> *mkdir -p out*
>>> *setenv VXTIME "2018071900"*
>>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
>>> http://wrfout_19_2.nc>
>>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>>>
>>> And that run successfully and creates output files:
>>> DEBUG 1: Output file: out/grid_stat_000000L_20180719_000000V.stat
>>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_cnt.txt
>>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_pairs.nc
>>>
>>> Looking in the "_cnt.txt" file for example, the RMSE value =
3.39378.
>>>
>>> Hope this helps get you up and running with MET.
>>>
>>> Thanks,
>>> John Halley Gotway
>>>
>>>
>>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
>>> met_help at ucar.edu>
>>> wrote:
>>>
>>> >
>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>> >
>>> > Hello John,
>>> > I have already sent my data to my ftp site. In these files, I
want to
>>> > extract the pw. There is another missing ERAI file. That one, I
have
>>> > trouble sending it. It contains the relative humidity and wind
data.
>>> > Please,
>>> > just tell me how to do it because I can not send this file.
There are
>>> two
>>> > wrfout files because my forecasts are made over 24 hours or
more. My
>>> raw
>>> > wrf outputs are in "HDF", and I can not send them. That's why I
sent
>>> those
>>> > in NetCDF. If I continue to wait for the other files to be sent,
the
>>> time
>>> > to deposit my memory will expire.
>>> > Thank you very much for helping me.
>>> > Yours sincerely.
>>> > Dores
>>> >
>>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
>>> met_help at ucar.edu
>>> > >
>>> > a écrit :
>>> >
>>> > > Dores,
>>> > >
>>> > > Were you able to post any data to the ftp site? You could try
>>> sending
>>> > via
>>> > > email but I worry that the data files will be too large to
transfer
>>> that
>>> > > way.
>>> > >
>>> > > Stephen is right... you need to put the files one by way. By
way of
>>> > > example, here are commands to create a file named
hello_world.txt and
>>> > post
>>> > > it to our ftp site.
>>> > >
>>> > > cd /home/johnhg
>>> > > echo "hello world" > hello_world.txt
>>> > > ftp ftp.rap.ucar.edu
>>> > > username = anonymous
>>> > > password = "my email address"
>>> > > cd incoming/irap/met_help/dores_data
>>> > > put hello_world.txt
>>> > > bye
>>> > >
>>> > > And then checking the ftp via a web browser:
>>> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>>> > >
>>> > > I see that file now exists. Just be sure that you're in the
>>> directory
>>> > > which contains the files you want to send before running ftp.
>>> > >
>>> > > Thanks,
>>> > > John
>>> > >
>>> > >
>>> > >
>>> > >
>>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
>>> met_help at ucar.edu>
>>> > > wrote:
>>> > >
>>> > > >
>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>> > > >
>>> > > >
>>> > > > John,
>>> > > >
>>> > > > I'm merging in a non MET FTP ticket from Dores into this
ticket
>>> with
>>> > > > explanation of what i think the problem is (specifying full
paths
>>> on
>>> > the
>>> > > > files w/o telling the FTP server to rename to non-pathed
filename.
>>> > > >
>>> > > > If you want, it might be helpful to add something about that
to
>>> your
>>> > Met
>>> > > > Help FTP upload page.
>>> > > >
>>> > > > thanks,
>>> > > > --stephen
>>> > > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Mon Oct 28 12:10:10 2019
Das,
Good news. It is very easy to configure Grid-Stat to compute 2x2
contingency tables. We just need to edit the config file to...
(1) Define the categorical thresholds that should be applied
(cat_thresh =
[ >20, >30, >40, >50 ];)
(2) Turn on the CTC and CTS output line types (ctc = BOTH; cts =
BOTH;)
You can of course change those thresholds however you'd like. Here
are
more commands to illustrate this:
# Pull sample data from ftp site
wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
GridStatConfig_pw
# Create output directory and run Grid-Stat
mkdir -p out
export VXTIME=2018071900
/usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
GridStatConfig_pw -outdir out -v 3
Then take a look at the output files:
out/grid_stat_000000L_20180719_000000V_ctc.txt
The _ctc.txt file contains the counts for the 2x2 contingency table
for
each of the 4 thresholds we specified.
Hope this helps get you going.
Thanks,
John
On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
> hello John,
> Excuse me, I beg you, to bother you.
> I created a symbolic link between my data and the pcp-combines
directory. I
> used test_grid_stat.sh which I modified. I compile it, it did not
produce
> anything. I tried the command lines you sent me and I get the errors
I sent
> you. I really have no idea to get me out. I beg you, please, to help
me.
> Attaching my test_grid_stat.sh file.
>
> Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
> > Hello John,
> > I am still unable to pull out my contingency table (CTC) with MET.
I have
> > read your email, the user guide, the online tutorial, but I still
do not
> > understand how I should run.
> > I see the lines of code:
> >
> > Use: grid_stat
> > fcst_file
> > obs_file
> > config_file
> > [-outdir path]
> > [-log file]
> > [-v level]
> > [-compress level]
> >
> > And, I do not know where I have to write them.
> > I see your run command lines:
> >
> > * mkdir -p out *
> > * setenv VXTIME "2018071900" *
> > * / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc <
> > http://wrfout_19_2.nc>
> > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> >
> > "setenv" did not give, I had to install "getenv".
> >
> > Command 'setenv' not found, did you mean:
> >
> > command 'getenv' from snap getenv (0.2.0)
> >
> > See 'snap info <snapname>' for additional versions.
> >
> > But when I try to run, I have errors:
> >
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>] [-s
> > <source_dir>]
> > getenv: error: unrecognized arguments: VXTIME 2018071900
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > bash: syntax error near unexpected `newline '
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > wrfout_19_2.nc
> > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or
directory
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > .nc
> > bash:
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > Is a directory
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > bash: syntax error near unexpected `newline '
> > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
met-8.1.1
> > / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw -outdir
out
> -v 3
> > ERAI_pw.nc: command not found
> >
> > Can you please, send me your execution script.
> > I may not be performing them properly. Please help me. I'm lost.
> >
> > Best regards
> > Dores
> >
> > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> >> Thank you very much.
> >>
> >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
> >> met_help at ucar.edu> a écrit :
> >>
> >>> Dores,
> >>>
> >>> OK, great. Thanks for sending some sample data.
> >>>
> >>> When getting started with new datasets in MET, I always start by
> running
> >>> the plot_data_plane tool to make sure MET can read the data and
place
> it
> >>> on
> >>> the earth correctly.
> >>>
> >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can
easily
> read
> >>> that:
> >>>
> >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> >>> ERAI_pw_2018071900.ps **'name="tcw"; level="(2018071900,*,*)";'
-v 4*
> >>>
> >>> Next for the WRF output. When I try passing it to MET directly,
I get
> an
> >>> error message:
> >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid
data
> file
> >>>
> >>> However, since this is on a lat/lon grid, we can just tell MET
to
> >>> interpret
> >>> it as being CF-compliant NetCDF, like this "file_type =
NETCDF_NCCF;":
> >>>
> >>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
> >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> level="(2018071900,*,*)";
> >>> file_type=NETCDF_NCCF;' -v 4*
> >>>
> >>> PNG versions of the resulting images are attached.
> >>>
> >>> Looking at these images, we see that MET is able to read data
from
> them.
> >>> And I'll leave it to you to confirm that MET is placing them in
the
> right
> >>> spot on earth, but I assume it is.
> >>>
> >>> Next, let's run Grid-Stat to compute statistics on them. I've
set up
> the
> >>> attached Grid-Stat config file to...
> >>>
> >>> (1) Regrid the ERAI data to the model domain using the budget
> >>> interpolation
> >>> method
> >>> regrid = {
> >>> to_grid = FCST;
> >>> method = BUDGET;
> >>> width = 2;
> >>> vld_thresh = 0.5;
> >>> shape = SQUARE;
> >>> }
> >>>
> >>> (2) Transfer the config options from the plot_data_plane command
line
> to
> >>> the "fcst" and "obs" dictionaries. For convenience, I defined
the time
> >>> as
> >>> an environment variable named $VXTIME:
> >>> fcst = {
> >>> file_type = NETCDF_NCCF;
> >>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; }
];
> >>> }
> >>> obs = {
> >>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; }
];
> >>> }
> >>>
> >>> (3) Compute stats over the FULL model domain.
> >>> mask = {
> >>> grid = [ "FULL" ];
> >>> poly = [];
> >>> }
> >>>
> >>> (4) And just compute continuous stats.
> >>> output_flag = {
> >>> ...
> >>> cnt = BOTH;
> >>> ...
> >>> }
> >>>
> >>> Finally, run Grid-Stat on the command line like this:
> >>>
> >>> *mkdir -p out*
> >>> *setenv VXTIME "2018071900"*
> >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> >>> http://wrfout_19_2.nc>
> >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> >>>
> >>> And that run successfully and creates output files:
> >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V.stat
> >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_cnt.txt
> >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_pairs.nc
> >>>
> >>> Looking in the "_cnt.txt" file for example, the RMSE value =
3.39378.
> >>>
> >>> Hope this helps get you up and running with MET.
> >>>
> >>> Thanks,
> >>> John Halley Gotway
> >>>
> >>>
> >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
> >>> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>> >
> >>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> >>> >
> >>> > Hello John,
> >>> > I have already sent my data to my ftp site. In these files, I
want to
> >>> > extract the pw. There is another missing ERAI file. That one,
I have
> >>> > trouble sending it. It contains the relative humidity and wind
data.
> >>> > Please,
> >>> > just tell me how to do it because I can not send this file.
There are
> >>> two
> >>> > wrfout files because my forecasts are made over 24 hours or
more. My
> >>> raw
> >>> > wrf outputs are in "HDF", and I can not send them. That's why
I sent
> >>> those
> >>> > in NetCDF. If I continue to wait for the other files to be
sent, the
> >>> time
> >>> > to deposit my memory will expire.
> >>> > Thank you very much for helping me.
> >>> > Yours sincerely.
> >>> > Dores
> >>> >
> >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
> >>> met_help at ucar.edu
> >>> > >
> >>> > a écrit :
> >>> >
> >>> > > Dores,
> >>> > >
> >>> > > Were you able to post any data to the ftp site? You could
try
> >>> sending
> >>> > via
> >>> > > email but I worry that the data files will be too large to
transfer
> >>> that
> >>> > > way.
> >>> > >
> >>> > > Stephen is right... you need to put the files one by way.
By way
> of
> >>> > > example, here are commands to create a file named
hello_world.txt
> and
> >>> > post
> >>> > > it to our ftp site.
> >>> > >
> >>> > > cd /home/johnhg
> >>> > > echo "hello world" > hello_world.txt
> >>> > > ftp ftp.rap.ucar.edu
> >>> > > username = anonymous
> >>> > > password = "my email address"
> >>> > > cd incoming/irap/met_help/dores_data
> >>> > > put hello_world.txt
> >>> > > bye
> >>> > >
> >>> > > And then checking the ftp via a web browser:
> >>> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> >>> > >
> >>> > > I see that file now exists. Just be sure that you're in the
> >>> directory
> >>> > > which contains the files you want to send before running
ftp.
> >>> > >
> >>> > > Thanks,
> >>> > > John
> >>> > >
> >>> > >
> >>> > >
> >>> > >
> >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
> >>> met_help at ucar.edu>
> >>> > > wrote:
> >>> > >
> >>> > > >
> >>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >>> > > >
> >>> > > >
> >>> > > > John,
> >>> > > >
> >>> > > > I'm merging in a non MET FTP ticket from Dores into this
ticket
> >>> with
> >>> > > > explanation of what i think the problem is (specifying
full paths
> >>> on
> >>> > the
> >>> > > > files w/o telling the FTP server to rename to non-pathed
> filename.
> >>> > > >
> >>> > > > If you want, it might be helpful to add something about
that to
> >>> your
> >>> > Met
> >>> > > > Help FTP upload page.
> >>> > > >
> >>> > > > thanks,
> >>> > > > --stephen
> >>> > > >
> >>> > >
> >>> > >
> >>> >
> >>> >
> >>>
> >>>
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Oct 28 13:44:58 2019
Hello John,
Excuse me for not understanding. I would like to interpolate on the
grid
points in order to also have the "RMSE" and the "Pearson correlation
coefficient" in addition to the contingency table. For this fact, I
put
ctc, cts and cnt at BOTH.
But, my problem remains the same: how do I execute my grid-stat and in
what
directory. In fact, I would like to know which files to use, where to
put
these files and how to handle them. For the moment, I have created a
symbolic link between the directory containing my data and the
directory
pcp-combines. I put my GridStatConfig_pw in the config directory and
also
in bin. I modify the test_grid_stat.sh and I left it in the examples
directory. When I run in bin following the command you sent me, I have
these errors.
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_19_2.nc ERAI_pw.nc
*** Model Evaluation Tools (METV8.1.1) ***
Usage: grid_stat
fcst_file
obs_file
config_file
[-outdir path]
[-log file]
[-v level]
[-compress level]
where "fcst_file" is a gridded forecast file containing the
field(s) to be verified (required).
"obs_file" is a gridded observation file containing
the
verifying field(s) (required).
"config_file" is a GridStatConfig file containing the
desired configuration settings (required).
"-outdir path" overrides the default output directory
(.)
(optional).
"-log file" outputs log messages to the specified file
(optional).
"-v level" overrides the default level of logging (2)
(optional).
"-compress level" overrides the compression level of
NetCDF
variable (0) (optional).
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
Here is my test_grid_stat.sh file
Cordially Dores.
Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Das,
>
> Good news. It is very easy to configure Grid-Stat to compute 2x2
> contingency tables. We just need to edit the config file to...
> (1) Define the categorical thresholds that should be applied
(cat_thresh =
> [ >20, >30, >40, >50 ];)
> (2) Turn on the CTC and CTS output line types (ctc = BOTH; cts =
BOTH;)
>
> You can of course change those thresholds however you'd like. Here
are
> more commands to illustrate this:
>
> # Pull sample data from ftp site
> wget
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> wget
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> GridStatConfig_pw
>
> # Create output directory and run Grid-Stat
> mkdir -p out
> export VXTIME=2018071900
> /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
> GridStatConfig_pw -outdir out -v 3
>
> Then take a look at the output files:
> out/grid_stat_000000L_20180719_000000V_ctc.txt
>
> The _ctc.txt file contains the counts for the 2x2 contingency table
for
> each of the 4 thresholds we specified.
>
> Hope this helps get you going.
>
> Thanks,
> John
>
>
> On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> > hello John,
> > Excuse me, I beg you, to bother you.
> > I created a symbolic link between my data and the pcp-combines
> directory. I
> > used test_grid_stat.sh which I modified. I compile it, it did not
produce
> > anything. I tried the command lines you sent me and I get the
errors I
> sent
> > you. I really have no idea to get me out. I beg you, please, to
help me.
> > Attaching my test_grid_stat.sh file.
> >
> > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> > > Hello John,
> > > I am still unable to pull out my contingency table (CTC) with
MET. I
> have
> > > read your email, the user guide, the online tutorial, but I
still do
> not
> > > understand how I should run.
> > > I see the lines of code:
> > >
> > > Use: grid_stat
> > > fcst_file
> > > obs_file
> > > config_file
> > > [-outdir path]
> > > [-log file]
> > > [-v level]
> > > [-compress level]
> > >
> > > And, I do not know where I have to write them.
> > > I see your run command lines:
> > >
> > > * mkdir -p out *
> > > * setenv VXTIME "2018071900" *
> > > * / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc <
> > > http://wrfout_19_2.nc>
> > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > >
> > > "setenv" did not give, I had to install "getenv".
> > >
> > > Command 'setenv' not found, did you mean:
> > >
> > > command 'getenv' from snap getenv (0.2.0)
> > >
> > > See 'snap info <snapname>' for additional versions.
> > >
> > > But when I try to run, I have errors:
> > >
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>] [-s
> > > <source_dir>]
> > > getenv: error: unrecognized arguments: VXTIME 2018071900
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > bash: syntax error near unexpected `newline '
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > > wrfout_19_2.nc
> > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or
directory
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > .nc
> > > bash:
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > Is a directory
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $ /usr/local/met-8.1.1/bin/grid_stat
> > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > bash: syntax error near unexpected `newline '
> > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1 /
> met-8.1.1
> > > / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw
-outdir out
> > -v 3
> > > ERAI_pw.nc: command not found
> > >
> > > Can you please, send me your execution script.
> > > I may not be performing them properly. Please help me. I'm lost.
> > >
> > > Best regards
> > > Dores
> > >
> > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> > > écrit :
> > >
> > >> Thank you very much.
> > >>
> > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
> > >> met_help at ucar.edu> a écrit :
> > >>
> > >>> Dores,
> > >>>
> > >>> OK, great. Thanks for sending some sample data.
> > >>>
> > >>> When getting started with new datasets in MET, I always start
by
> > running
> > >>> the plot_data_plane tool to make sure MET can read the data
and place
> > it
> > >>> on
> > >>> the earth correctly.
> > >>>
> > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can
easily
> > read
> > >>> that:
> > >>>
> > >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> > >>> ERAI_pw_2018071900.ps **'name="tcw";
level="(2018071900,*,*)";' -v
> 4*
> > >>>
> > >>> Next for the WRF output. When I try passing it to MET
directly, I
> get
> > an
> > >>> error message:
> > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a valid
data
> > file
> > >>>
> > >>> However, since this is on a lat/lon grid, we can just tell MET
to
> > >>> interpret
> > >>> it as being CF-compliant NetCDF, like this "file_type =
> NETCDF_NCCF;":
> > >>>
> > >>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
> > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > level="(2018071900,*,*)";
> > >>> file_type=NETCDF_NCCF;' -v 4*
> > >>>
> > >>> PNG versions of the resulting images are attached.
> > >>>
> > >>> Looking at these images, we see that MET is able to read data
from
> > them.
> > >>> And I'll leave it to you to confirm that MET is placing them
in the
> > right
> > >>> spot on earth, but I assume it is.
> > >>>
> > >>> Next, let's run Grid-Stat to compute statistics on them. I've
set up
> > the
> > >>> attached Grid-Stat config file to...
> > >>>
> > >>> (1) Regrid the ERAI data to the model domain using the budget
> > >>> interpolation
> > >>> method
> > >>> regrid = {
> > >>> to_grid = FCST;
> > >>> method = BUDGET;
> > >>> width = 2;
> > >>> vld_thresh = 0.5;
> > >>> shape = SQUARE;
> > >>> }
> > >>>
> > >>> (2) Transfer the config options from the plot_data_plane
command line
> > to
> > >>> the "fcst" and "obs" dictionaries. For convenience, I defined
the
> time
> > >>> as
> > >>> an environment variable named $VXTIME:
> > >>> fcst = {
> > >>> file_type = NETCDF_NCCF;
> > >>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ];
} ];
> > >>> }
> > >>> obs = {
> > >>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ];
} ];
> > >>> }
> > >>>
> > >>> (3) Compute stats over the FULL model domain.
> > >>> mask = {
> > >>> grid = [ "FULL" ];
> > >>> poly = [];
> > >>> }
> > >>>
> > >>> (4) And just compute continuous stats.
> > >>> output_flag = {
> > >>> ...
> > >>> cnt = BOTH;
> > >>> ...
> > >>> }
> > >>>
> > >>> Finally, run Grid-Stat on the command line like this:
> > >>>
> > >>> *mkdir -p out*
> > >>> *setenv VXTIME "2018071900"*
> > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > >>> http://wrfout_19_2.nc>
> > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > >>>
> > >>> And that run successfully and creates output files:
> > >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V.stat
> > >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_cnt.txt
> > >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V_pairs.nc
> > >>>
> > >>> Looking in the "_cnt.txt" file for example, the RMSE value =
3.39378.
> > >>>
> > >>> Hope this helps get you up and running with MET.
> > >>>
> > >>> Thanks,
> > >>> John Halley Gotway
> > >>>
> > >>>
> > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
> > >>> met_help at ucar.edu>
> > >>> wrote:
> > >>>
> > >>> >
> > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >>> >
> > >>> > Hello John,
> > >>> > I have already sent my data to my ftp site. In these files,
I want
> to
> > >>> > extract the pw. There is another missing ERAI file. That
one, I
> have
> > >>> > trouble sending it. It contains the relative humidity and
wind
> data.
> > >>> > Please,
> > >>> > just tell me how to do it because I can not send this file.
There
> are
> > >>> two
> > >>> > wrfout files because my forecasts are made over 24 hours or
more.
> My
> > >>> raw
> > >>> > wrf outputs are in "HDF", and I can not send them. That's
why I
> sent
> > >>> those
> > >>> > in NetCDF. If I continue to wait for the other files to be
sent,
> the
> > >>> time
> > >>> > to deposit my memory will expire.
> > >>> > Thank you very much for helping me.
> > >>> > Yours sincerely.
> > >>> > Dores
> > >>> >
> > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
> > >>> met_help at ucar.edu
> > >>> > >
> > >>> > a écrit :
> > >>> >
> > >>> > > Dores,
> > >>> > >
> > >>> > > Were you able to post any data to the ftp site? You could
try
> > >>> sending
> > >>> > via
> > >>> > > email but I worry that the data files will be too large to
> transfer
> > >>> that
> > >>> > > way.
> > >>> > >
> > >>> > > Stephen is right... you need to put the files one by way.
By way
> > of
> > >>> > > example, here are commands to create a file named
hello_world.txt
> > and
> > >>> > post
> > >>> > > it to our ftp site.
> > >>> > >
> > >>> > > cd /home/johnhg
> > >>> > > echo "hello world" > hello_world.txt
> > >>> > > ftp ftp.rap.ucar.edu
> > >>> > > username = anonymous
> > >>> > > password = "my email address"
> > >>> > > cd incoming/irap/met_help/dores_data
> > >>> > > put hello_world.txt
> > >>> > > bye
> > >>> > >
> > >>> > > And then checking the ftp via a web browser:
> > >>> > > ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > >>> > >
> > >>> > > I see that file now exists. Just be sure that you're in
the
> > >>> directory
> > >>> > > which contains the files you want to send before running
ftp.
> > >>> > >
> > >>> > > Thanks,
> > >>> > > John
> > >>> > >
> > >>> > >
> > >>> > >
> > >>> > >
> > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
> > >>> met_help at ucar.edu>
> > >>> > > wrote:
> > >>> > >
> > >>> > > >
> > >>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >
> > >>> > > >
> > >>> > > >
> > >>> > > > John,
> > >>> > > >
> > >>> > > > I'm merging in a non MET FTP ticket from Dores into this
ticket
> > >>> with
> > >>> > > > explanation of what i think the problem is (specifying
full
> paths
> > >>> on
> > >>> > the
> > >>> > > > files w/o telling the FTP server to rename to non-pathed
> > filename.
> > >>> > > >
> > >>> > > > If you want, it might be helpful to add something about
that to
> > >>> your
> > >>> > Met
> > >>> > > > Help FTP upload page.
> > >>> > > >
> > >>> > > > thanks,
> > >>> > > > --stephen
> > >>> > > >
> > >>> > >
> > >>> > >
> > >>> >
> > >>> >
> > >>>
> > >>>
> >
> >
>
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Mon Oct 28 14:18:26 2019
Dores,
It looks like you're running Grid-Stat in this way:
*dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_statwrfout_19_2.nc
<http://wrfout_19_2.nc/> ERAI_pw.nc*
And Grid-Stat is printing out the usage statement to indicate that you
have
provided the correct input arguments.
Grid-Stat has 3 required arguments on the command line:
(1) the path to the forecast file
(2) the path to the observation file
(3) the path the grid_stat configuration file
You have provided the first 2 but not the 3rd. Please try running
grid_stat will all 3 required arguments:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
And there is no requirement for the directory structure to be used.
You
can either provide the full absolute path the the input files, or the
relative path. If these files are all in your current working
directory,
you just list the filenames.
John
On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John,
> Excuse me for not understanding. I would like to interpolate on the
grid
> points in order to also have the "RMSE" and the "Pearson correlation
> coefficient" in addition to the contingency table. For this fact, I
put
> ctc, cts and cnt at BOTH.
> But, my problem remains the same: how do I execute my grid-stat and
in what
> directory. In fact, I would like to know which files to use, where
to put
> these files and how to handle them. For the moment, I have created a
> symbolic link between the directory containing my data and the
directory
> pcp-combines. I put my GridStatConfig_pw in the config directory and
also
> in bin. I modify the test_grid_stat.sh and I left it in the examples
> directory. When I run in bin following the command you sent me, I
have
> these errors.
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_19_2.nc ERAI_pw.nc
>
> *** Model Evaluation Tools (METV8.1.1) ***
>
> Usage: grid_stat
> fcst_file
> obs_file
> config_file
> [-outdir path]
> [-log file]
> [-v level]
> [-compress level]
>
> where "fcst_file" is a gridded forecast file containing
the
> field(s) to be verified (required).
> "obs_file" is a gridded observation file containing
the
> verifying field(s) (required).
> "config_file" is a GridStatConfig file containing
the
> desired configuration settings (required).
> "-outdir path" overrides the default output
directory (.)
> (optional).
> "-log file" outputs log messages to the specified
file
> (optional).
> "-v level" overrides the default level of logging
(2)
> (optional).
> "-compress level" overrides the compression level of
NetCDF
> variable (0) (optional).
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>
> Here is my test_grid_stat.sh file
> Cordially Dores.
>
> Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT
<met_help at ucar.edu
> >
> a écrit :
>
> > Das,
> >
> > Good news. It is very easy to configure Grid-Stat to compute 2x2
> > contingency tables. We just need to edit the config file to...
> > (1) Define the categorical thresholds that should be applied
(cat_thresh
> =
> > [ >20, >30, >40, >50 ];)
> > (2) Turn on the CTC and CTS output line types (ctc = BOTH; cts =
BOTH;)
> >
> > You can of course change those thresholds however you'd like.
Here are
> > more commands to illustrate this:
> >
> > # Pull sample data from ftp site
> > wget
> >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > wget
> >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > GridStatConfig_pw
> >
> > # Create output directory and run Grid-Stat
> > mkdir -p out
> > export VXTIME=2018071900
> > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
> > GridStatConfig_pw -outdir out -v 3
> >
> > Then take a look at the output files:
> > out/grid_stat_000000L_20180719_000000V_ctc.txt
> >
> > The _ctc.txt file contains the counts for the 2x2 contingency
table for
> > each of the 4 thresholds we specified.
> >
> > Hope this helps get you going.
> >
> > Thanks,
> > John
> >
> >
> > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > hello John,
> > > Excuse me, I beg you, to bother you.
> > > I created a symbolic link between my data and the pcp-combines
> > directory. I
> > > used test_grid_stat.sh which I modified. I compile it, it did
not
> produce
> > > anything. I tried the command lines you sent me and I get the
errors I
> > sent
> > > you. I really have no idea to get me out. I beg you, please, to
help
> me.
> > > Attaching my test_grid_stat.sh file.
> > >
> > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> > > écrit :
> > >
> > > > Hello John,
> > > > I am still unable to pull out my contingency table (CTC) with
MET. I
> > have
> > > > read your email, the user guide, the online tutorial, but I
still do
> > not
> > > > understand how I should run.
> > > > I see the lines of code:
> > > >
> > > > Use: grid_stat
> > > > fcst_file
> > > > obs_file
> > > > config_file
> > > > [-outdir path]
> > > > [-log file]
> > > > [-v level]
> > > > [-compress level]
> > > >
> > > > And, I do not know where I have to write them.
> > > > I see your run command lines:
> > > >
> > > > * mkdir -p out *
> > > > * setenv VXTIME "2018071900" *
> > > > * / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc <
> > > > http://wrfout_19_2.nc>
> > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > > >
> > > > "setenv" did not give, I had to install "getenv".
> > > >
> > > > Command 'setenv' not found, did you mean:
> > > >
> > > > command 'getenv' from snap getenv (0.2.0)
> > > >
> > > > See 'snap info <snapname>' for additional versions.
> > > >
> > > > But when I try to run, I have errors:
> > > >
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>] [-s
> > > > <source_dir>]
> > > > getenv: error: unrecognized arguments: VXTIME 2018071900
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > bash: syntax error near unexpected `newline '
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > wrfout_19_2.nc
> > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or
directory
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > > .nc
> > > > bash:
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > > Is a directory
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > bash: syntax error near unexpected `newline '
> > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET / 8.1
/
> > met-8.1.1
> > > > / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw
-outdir
> out
> > > -v 3
> > > > ERAI_pw.nc: command not found
> > > >
> > > > Can you please, send me your execution script.
> > > > I may not be performing them properly. Please help me. I'm
lost.
> > > >
> > > > Best regards
> > > > Dores
> > > >
> > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> ngaminidas at gmail.com>
> > a
> > > > écrit :
> > > >
> > > >> Thank you very much.
> > > >>
> > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
> > > >> met_help at ucar.edu> a écrit :
> > > >>
> > > >>> Dores,
> > > >>>
> > > >>> OK, great. Thanks for sending some sample data.
> > > >>>
> > > >>> When getting started with new datasets in MET, I always
start by
> > > running
> > > >>> the plot_data_plane tool to make sure MET can read the data
and
> place
> > > it
> > > >>> on
> > > >>> the earth correctly.
> > > >>>
> > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET can
easily
> > > read
> > > >>> that:
> > > >>>
> > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> > > >>> ERAI_pw_2018071900.ps **'name="tcw";
level="(2018071900,*,*)";' -v
> > 4*
> > > >>>
> > > >>> Next for the WRF output. When I try passing it to MET
directly, I
> > get
> > > an
> > > >>> error message:
> > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a
valid data
> > > file
> > > >>>
> > > >>> However, since this is on a lat/lon grid, we can just tell
MET to
> > > >>> interpret
> > > >>> it as being CF-compliant NetCDF, like this "file_type =
> > NETCDF_NCCF;":
> > > >>>
> > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
> > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > > level="(2018071900,*,*)";
> > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > >>>
> > > >>> PNG versions of the resulting images are attached.
> > > >>>
> > > >>> Looking at these images, we see that MET is able to read
data from
> > > them.
> > > >>> And I'll leave it to you to confirm that MET is placing them
in the
> > > right
> > > >>> spot on earth, but I assume it is.
> > > >>>
> > > >>> Next, let's run Grid-Stat to compute statistics on them.
I've set
> up
> > > the
> > > >>> attached Grid-Stat config file to...
> > > >>>
> > > >>> (1) Regrid the ERAI data to the model domain using the
budget
> > > >>> interpolation
> > > >>> method
> > > >>> regrid = {
> > > >>> to_grid = FCST;
> > > >>> method = BUDGET;
> > > >>> width = 2;
> > > >>> vld_thresh = 0.5;
> > > >>> shape = SQUARE;
> > > >>> }
> > > >>>
> > > >>> (2) Transfer the config options from the plot_data_plane
command
> line
> > > to
> > > >>> the "fcst" and "obs" dictionaries. For convenience, I
defined the
> > time
> > > >>> as
> > > >>> an environment variable named $VXTIME:
> > > >>> fcst = {
> > > >>> file_type = NETCDF_NCCF;
> > > >>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)"
]; } ];
> > > >>> }
> > > >>> obs = {
> > > >>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)"
]; } ];
> > > >>> }
> > > >>>
> > > >>> (3) Compute stats over the FULL model domain.
> > > >>> mask = {
> > > >>> grid = [ "FULL" ];
> > > >>> poly = [];
> > > >>> }
> > > >>>
> > > >>> (4) And just compute continuous stats.
> > > >>> output_flag = {
> > > >>> ...
> > > >>> cnt = BOTH;
> > > >>> ...
> > > >>> }
> > > >>>
> > > >>> Finally, run Grid-Stat on the command line like this:
> > > >>>
> > > >>> *mkdir -p out*
> > > >>> *setenv VXTIME "2018071900"*
> > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > > >>> http://wrfout_19_2.nc>
> > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > > >>>
> > > >>> And that run successfully and creates output files:
> > > >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V.stat
> > > >>> DEBUG 1: Output file:
> out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > >>> DEBUG 1: Output file:
> out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > >>>
> > > >>> Looking in the "_cnt.txt" file for example, the RMSE value =
> 3.39378.
> > > >>>
> > > >>> Hope this helps get you up and running with MET.
> > > >>>
> > > >>> Thanks,
> > > >>> John Halley Gotway
> > > >>>
> > > >>>
> > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT <
> > > >>> met_help at ucar.edu>
> > > >>> wrote:
> > > >>>
> > > >>> >
> > > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > > >>> >
> > > >>> > Hello John,
> > > >>> > I have already sent my data to my ftp site. In these
files, I
> want
> > to
> > > >>> > extract the pw. There is another missing ERAI file. That
one, I
> > have
> > > >>> > trouble sending it. It contains the relative humidity and
wind
> > data.
> > > >>> > Please,
> > > >>> > just tell me how to do it because I can not send this
file. There
> > are
> > > >>> two
> > > >>> > wrfout files because my forecasts are made over 24 hours
or more.
> > My
> > > >>> raw
> > > >>> > wrf outputs are in "HDF", and I can not send them. That's
why I
> > sent
> > > >>> those
> > > >>> > in NetCDF. If I continue to wait for the other files to be
sent,
> > the
> > > >>> time
> > > >>> > to deposit my memory will expire.
> > > >>> > Thank you very much for helping me.
> > > >>> > Yours sincerely.
> > > >>> > Dores
> > > >>> >
> > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT <
> > > >>> met_help at ucar.edu
> > > >>> > >
> > > >>> > a écrit :
> > > >>> >
> > > >>> > > Dores,
> > > >>> > >
> > > >>> > > Were you able to post any data to the ftp site? You
could try
> > > >>> sending
> > > >>> > via
> > > >>> > > email but I worry that the data files will be too large
to
> > transfer
> > > >>> that
> > > >>> > > way.
> > > >>> > >
> > > >>> > > Stephen is right... you need to put the files one by
way. By
> way
> > > of
> > > >>> > > example, here are commands to create a file named
> hello_world.txt
> > > and
> > > >>> > post
> > > >>> > > it to our ftp site.
> > > >>> > >
> > > >>> > > cd /home/johnhg
> > > >>> > > echo "hello world" > hello_world.txt
> > > >>> > > ftp ftp.rap.ucar.edu
> > > >>> > > username = anonymous
> > > >>> > > password = "my email address"
> > > >>> > > cd incoming/irap/met_help/dores_data
> > > >>> > > put hello_world.txt
> > > >>> > > bye
> > > >>> > >
> > > >>> > > And then checking the ftp via a web browser:
> > > >>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > >>> > >
> > > >>> > > I see that file now exists. Just be sure that you're in
the
> > > >>> directory
> > > >>> > > which contains the files you want to send before running
ftp.
> > > >>> > >
> > > >>> > > Thanks,
> > > >>> > > John
> > > >>> > >
> > > >>> > >
> > > >>> > >
> > > >>> > >
> > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
> > > >>> met_help at ucar.edu>
> > > >>> > > wrote:
> > > >>> > >
> > > >>> > > >
> > > >>> > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >
> > > >>> > > >
> > > >>> > > >
> > > >>> > > > John,
> > > >>> > > >
> > > >>> > > > I'm merging in a non MET FTP ticket from Dores into
this
> ticket
> > > >>> with
> > > >>> > > > explanation of what i think the problem is (specifying
full
> > paths
> > > >>> on
> > > >>> > the
> > > >>> > > > files w/o telling the FTP server to rename to non-
pathed
> > > filename.
> > > >>> > > >
> > > >>> > > > If you want, it might be helpful to add something
about that
> to
> > > >>> your
> > > >>> > Met
> > > >>> > > > Help FTP upload page.
> > > >>> > > >
> > > >>> > > > thanks,
> > > >>> > > > --stephen
> > > >>> > > >
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>> >
> > > >>>
> > > >>>
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Oct 29 01:36:45 2019
Hello John,
Thanks a lot for your help.
I can already see something interesting. But, I have another problem.
I
would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END OBS_LEAD
OBS_VALID_BEG OBS_VALID_END". I do not know where to find them and how
to
take them into account when running. I predict 24 hours to 144 hours
(0 to
6 days). Please help me.
Thank you in advance.
Dorès
Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> It looks like you're running Grid-Stat in this way:
>
>
>
> *dores at dores
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> grid_statwrfout_19_2.nc
> <http://wrfout_19_2.nc/> ERAI_pw.nc*
>
> And Grid-Stat is printing out the usage statement to indicate that
you have
> provided the correct input arguments.
>
> Grid-Stat has 3 required arguments on the command line:
> (1) the path to the forecast file
> (2) the path to the observation file
> (3) the path the grid_stat configuration file
>
> You have provided the first 2 but not the 3rd. Please try running
> grid_stat will all 3 required arguments:
>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>
> And there is no requirement for the directory structure to be used.
You
> can either provide the full absolute path the the input files, or
the
> relative path. If these files are all in your current working
directory,
> you just list the filenames.
>
> John
>
> On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John,
> > Excuse me for not understanding. I would like to interpolate on
the grid
> > points in order to also have the "RMSE" and the "Pearson
correlation
> > coefficient" in addition to the contingency table. For this fact,
I put
> > ctc, cts and cnt at BOTH.
> > But, my problem remains the same: how do I execute my grid-stat
and in
> what
> > directory. In fact, I would like to know which files to use, where
to put
> > these files and how to handle them. For the moment, I have created
a
> > symbolic link between the directory containing my data and the
directory
> > pcp-combines. I put my GridStatConfig_pw in the config directory
and also
> > in bin. I modify the test_grid_stat.sh and I left it in the
examples
> > directory. When I run in bin following the command you sent me, I
have
> > these errors.
> >
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > wrfout_19_2.nc ERAI_pw.nc
> >
> > *** Model Evaluation Tools (METV8.1.1) ***
> >
> > Usage: grid_stat
> > fcst_file
> > obs_file
> > config_file
> > [-outdir path]
> > [-log file]
> > [-v level]
> > [-compress level]
> >
> > where "fcst_file" is a gridded forecast file containing
the
> > field(s) to be verified (required).
> > "obs_file" is a gridded observation file
containing the
> > verifying field(s) (required).
> > "config_file" is a GridStatConfig file containing
the
> > desired configuration settings (required).
> > "-outdir path" overrides the default output
directory (.)
> > (optional).
> > "-log file" outputs log messages to the specified
file
> > (optional).
> > "-v level" overrides the default level of logging
(2)
> > (optional).
> > "-compress level" overrides the compression level
of
> NetCDF
> > variable (0) (optional).
> >
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >
> > Here is my test_grid_stat.sh file
> > Cordially Dores.
> >
> > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
> met_help at ucar.edu
> > >
> > a écrit :
> >
> > > Das,
> > >
> > > Good news. It is very easy to configure Grid-Stat to compute
2x2
> > > contingency tables. We just need to edit the config file to...
> > > (1) Define the categorical thresholds that should be applied
> (cat_thresh
> > =
> > > [ >20, >30, >40, >50 ];)
> > > (2) Turn on the CTC and CTS output line types (ctc = BOTH; cts =
BOTH;)
> > >
> > > You can of course change those thresholds however you'd like.
Here are
> > > more commands to illustrate this:
> > >
> > > # Pull sample data from ftp site
> > > wget
> > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > wget
> > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > wget
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > > GridStatConfig_pw
> > >
> > > # Create output directory and run Grid-Stat
> > > mkdir -p out
> > > export VXTIME=2018071900
> > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
> > > GridStatConfig_pw -outdir out -v 3
> > >
> > > Then take a look at the output files:
> > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > >
> > > The _ctc.txt file contains the counts for the 2x2 contingency
table for
> > > each of the 4 thresholds we specified.
> > >
> > > Hope this helps get you going.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > hello John,
> > > > Excuse me, I beg you, to bother you.
> > > > I created a symbolic link between my data and the pcp-combines
> > > directory. I
> > > > used test_grid_stat.sh which I modified. I compile it, it did
not
> > produce
> > > > anything. I tried the command lines you sent me and I get the
errors
> I
> > > sent
> > > > you. I really have no idea to get me out. I beg you, please,
to help
> > me.
> > > > Attaching my test_grid_stat.sh file.
> > > >
> > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
> ngaminidas at gmail.com>
> > a
> > > > écrit :
> > > >
> > > > > Hello John,
> > > > > I am still unable to pull out my contingency table (CTC)
with MET.
> I
> > > have
> > > > > read your email, the user guide, the online tutorial, but I
still
> do
> > > not
> > > > > understand how I should run.
> > > > > I see the lines of code:
> > > > >
> > > > > Use: grid_stat
> > > > > fcst_file
> > > > > obs_file
> > > > > config_file
> > > > > [-outdir path]
> > > > > [-log file]
> > > > > [-v level]
> > > > > [-compress level]
> > > > >
> > > > > And, I do not know where I have to write them.
> > > > > I see your run command lines:
> > > > >
> > > > > * mkdir -p out *
> > > > > * setenv VXTIME "2018071900" *
> > > > > * / usr / local / met-8.1.1 / bin / grid_stat wrfout_19_2.nc
<
> > > > > http://wrfout_19_2.nc>
> > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > > > >
> > > > > "setenv" did not give, I had to install "getenv".
> > > > >
> > > > > Command 'setenv' not found, did you mean:
> > > > >
> > > > > command 'getenv' from snap getenv (0.2.0)
> > > > >
> > > > > See 'snap info <snapname>' for additional versions.
> > > > >
> > > > > But when I try to run, I have errors:
> > > > >
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>]
[-s
> > > > > <source_dir>]
> > > > > getenv: error: unrecognized arguments: VXTIME 2018071900
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > bash: syntax error near unexpected `newline '
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > wrfout_19_2.nc
> > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or
directory
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > > > .nc
> > > > > bash:
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > > > Is a directory
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > bash: syntax error near unexpected `newline '
> > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > met-8.1.1
> > > > > / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw
-outdir
> > out
> > > > -v 3
> > > > > ERAI_pw.nc: command not found
> > > > >
> > > > > Can you please, send me your execution script.
> > > > > I may not be performing them properly. Please help me. I'm
lost.
> > > > >
> > > > > Best regards
> > > > > Dores
> > > > >
> > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> > ngaminidas at gmail.com>
> > > a
> > > > > écrit :
> > > > >
> > > > >> Thank you very much.
> > > > >>
> > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
> > > > >> met_help at ucar.edu> a écrit :
> > > > >>
> > > > >>> Dores,
> > > > >>>
> > > > >>> OK, great. Thanks for sending some sample data.
> > > > >>>
> > > > >>> When getting started with new datasets in MET, I always
start by
> > > > running
> > > > >>> the plot_data_plane tool to make sure MET can read the
data and
> > place
> > > > it
> > > > >>> on
> > > > >>> the earth correctly.
> > > > >>>
> > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET
can
> easily
> > > > read
> > > > >>> that:
> > > > >>>
> > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
level="(2018071900,*,*)";'
> -v
> > > 4*
> > > > >>>
> > > > >>> Next for the WRF output. When I try passing it to MET
directly,
> I
> > > get
> > > > an
> > > > >>> error message:
> > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a
valid
> data
> > > > file
> > > > >>>
> > > > >>> However, since this is on a lat/lon grid, we can just tell
MET to
> > > > >>> interpret
> > > > >>> it as being CF-compliant NetCDF, like this "file_type =
> > > NETCDF_NCCF;":
> > > > >>>
> > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **wrfout_19_2.nc
> > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > > > level="(2018071900,*,*)";
> > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > > >>>
> > > > >>> PNG versions of the resulting images are attached.
> > > > >>>
> > > > >>> Looking at these images, we see that MET is able to read
data
> from
> > > > them.
> > > > >>> And I'll leave it to you to confirm that MET is placing
them in
> the
> > > > right
> > > > >>> spot on earth, but I assume it is.
> > > > >>>
> > > > >>> Next, let's run Grid-Stat to compute statistics on them.
I've
> set
> > up
> > > > the
> > > > >>> attached Grid-Stat config file to...
> > > > >>>
> > > > >>> (1) Regrid the ERAI data to the model domain using the
budget
> > > > >>> interpolation
> > > > >>> method
> > > > >>> regrid = {
> > > > >>> to_grid = FCST;
> > > > >>> method = BUDGET;
> > > > >>> width = 2;
> > > > >>> vld_thresh = 0.5;
> > > > >>> shape = SQUARE;
> > > > >>> }
> > > > >>>
> > > > >>> (2) Transfer the config options from the plot_data_plane
command
> > line
> > > > to
> > > > >>> the "fcst" and "obs" dictionaries. For convenience, I
defined
> the
> > > time
> > > > >>> as
> > > > >>> an environment variable named $VXTIME:
> > > > >>> fcst = {
> > > > >>> file_type = NETCDF_NCCF;
> > > > >>> field = [ { name = "pw"; level= [
"(${VXTIME},*,*)" ]; }
> ];
> > > > >>> }
> > > > >>> obs = {
> > > > >>> field = [ { name = "tcw"; level= [
"(${VXTIME},*,*)" ]; }
> ];
> > > > >>> }
> > > > >>>
> > > > >>> (3) Compute stats over the FULL model domain.
> > > > >>> mask = {
> > > > >>> grid = [ "FULL" ];
> > > > >>> poly = [];
> > > > >>> }
> > > > >>>
> > > > >>> (4) And just compute continuous stats.
> > > > >>> output_flag = {
> > > > >>> ...
> > > > >>> cnt = BOTH;
> > > > >>> ...
> > > > >>> }
> > > > >>>
> > > > >>> Finally, run Grid-Stat on the command line like this:
> > > > >>>
> > > > >>> *mkdir -p out*
> > > > >>> *setenv VXTIME "2018071900"*
> > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > > > >>> http://wrfout_19_2.nc>
> > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > > > >>>
> > > > >>> And that run successfully and creates output files:
> > > > >>> DEBUG 1: Output file:
out/grid_stat_000000L_20180719_000000V.stat
> > > > >>> DEBUG 1: Output file:
> > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > > >>> DEBUG 1: Output file:
> > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > > >>>
> > > > >>> Looking in the "_cnt.txt" file for example, the RMSE value
=
> > 3.39378.
> > > > >>>
> > > > >>> Hope this helps get you up and running with MET.
> > > > >>>
> > > > >>> Thanks,
> > > > >>> John Halley Gotway
> > > > >>>
> > > > >>>
> > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via RT
<
> > > > >>> met_help at ucar.edu>
> > > > >>> wrote:
> > > > >>>
> > > > >>> >
> > > > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >
> > > > >>> >
> > > > >>> > Hello John,
> > > > >>> > I have already sent my data to my ftp site. In these
files, I
> > want
> > > to
> > > > >>> > extract the pw. There is another missing ERAI file. That
one, I
> > > have
> > > > >>> > trouble sending it. It contains the relative humidity
and wind
> > > data.
> > > > >>> > Please,
> > > > >>> > just tell me how to do it because I can not send this
file.
> There
> > > are
> > > > >>> two
> > > > >>> > wrfout files because my forecasts are made over 24 hours
or
> more.
> > > My
> > > > >>> raw
> > > > >>> > wrf outputs are in "HDF", and I can not send them.
That's why I
> > > sent
> > > > >>> those
> > > > >>> > in NetCDF. If I continue to wait for the other files to
be
> sent,
> > > the
> > > > >>> time
> > > > >>> > to deposit my memory will expire.
> > > > >>> > Thank you very much for helping me.
> > > > >>> > Yours sincerely.
> > > > >>> > Dores
> > > > >>> >
> > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via RT
<
> > > > >>> met_help at ucar.edu
> > > > >>> > >
> > > > >>> > a écrit :
> > > > >>> >
> > > > >>> > > Dores,
> > > > >>> > >
> > > > >>> > > Were you able to post any data to the ftp site? You
could
> try
> > > > >>> sending
> > > > >>> > via
> > > > >>> > > email but I worry that the data files will be too
large to
> > > transfer
> > > > >>> that
> > > > >>> > > way.
> > > > >>> > >
> > > > >>> > > Stephen is right... you need to put the files one by
way. By
> > way
> > > > of
> > > > >>> > > example, here are commands to create a file named
> > hello_world.txt
> > > > and
> > > > >>> > post
> > > > >>> > > it to our ftp site.
> > > > >>> > >
> > > > >>> > > cd /home/johnhg
> > > > >>> > > echo "hello world" > hello_world.txt
> > > > >>> > > ftp ftp.rap.ucar.edu
> > > > >>> > > username = anonymous
> > > > >>> > > password = "my email address"
> > > > >>> > > cd incoming/irap/met_help/dores_data
> > > > >>> > > put hello_world.txt
> > > > >>> > > bye
> > > > >>> > >
> > > > >>> > > And then checking the ftp via a web browser:
> > > > >>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > > >>> > >
> > > > >>> > > I see that file now exists. Just be sure that you're
in the
> > > > >>> directory
> > > > >>> > > which contains the files you want to send before
running ftp.
> > > > >>> > >
> > > > >>> > > Thanks,
> > > > >>> > > John
> > > > >>> > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT <
> > > > >>> met_help at ucar.edu>
> > > > >>> > > wrote:
> > > > >>> > >
> > > > >>> > > >
> > > > >>> > > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > >
> > > > >>> > > >
> > > > >>> > > >
> > > > >>> > > > John,
> > > > >>> > > >
> > > > >>> > > > I'm merging in a non MET FTP ticket from Dores into
this
> > ticket
> > > > >>> with
> > > > >>> > > > explanation of what i think the problem is
(specifying full
> > > paths
> > > > >>> on
> > > > >>> > the
> > > > >>> > > > files w/o telling the FTP server to rename to non-
pathed
> > > > filename.
> > > > >>> > > >
> > > > >>> > > > If you want, it might be helpful to add something
about
> that
> > to
> > > > >>> your
> > > > >>> > Met
> > > > >>> > > > Help FTP upload page.
> > > > >>> > > >
> > > > >>> > > > thanks,
> > > > >>> > > > --stephen
> > > > >>> > > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> >
> > > > >>> >
> > > > >>>
> > > > >>>
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Tue Oct 29 09:45:48 2019
Dores,
Each time Grid-Stat or Point-Stat is run, the timing information is
extracted from the metadata of the data files. And that timing
information
is written to the header columns of the output files. There is, in
general, no easy way of modifying the timing information of the data
you're
processing.
And I don't really understand why you would want to change that timing
info.
We actually do have a development issue defined that would enable this
in
the future, but that work has not been done yet.
https://github.com/NCAR/MET/issues/1020
Thanks,
John
On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John,
> Thanks a lot for your help.
> I can already see something interesting. But, I have another
problem. I
> would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> OBS_VALID_BEG OBS_VALID_END". I do not know where to find them and
how to
> take them into account when running. I predict 24 hours to 144 hours
(0 to
> 6 days). Please help me.
>
> Thank you in advance.
>
> Dorès
>
>
> Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT
<met_help at ucar.edu
> >
> a écrit :
>
> > Dores,
> >
> > It looks like you're running Grid-Stat in this way:
> >
> >
> >
> > *dores at dores
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > grid_statwrfout_19_2.nc
> > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> >
> > And Grid-Stat is printing out the usage statement to indicate that
you
> have
> > provided the correct input arguments.
> >
> > Grid-Stat has 3 required arguments on the command line:
> > (1) the path to the forecast file
> > (2) the path to the observation file
> > (3) the path the grid_stat configuration file
> >
> > You have provided the first 2 but not the 3rd. Please try running
> > grid_stat will all 3 required arguments:
> >
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> >
> > And there is no requirement for the directory structure to be
used. You
> > can either provide the full absolute path the the input files, or
the
> > relative path. If these files are all in your current working
directory,
> > you just list the filenames.
> >
> > John
> >
> > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >
> > > Hello John,
> > > Excuse me for not understanding. I would like to interpolate on
the
> grid
> > > points in order to also have the "RMSE" and the "Pearson
correlation
> > > coefficient" in addition to the contingency table. For this
fact, I put
> > > ctc, cts and cnt at BOTH.
> > > But, my problem remains the same: how do I execute my grid-stat
and in
> > what
> > > directory. In fact, I would like to know which files to use,
where to
> put
> > > these files and how to handle them. For the moment, I have
created a
> > > symbolic link between the directory containing my data and the
> directory
> > > pcp-combines. I put my GridStatConfig_pw in the config directory
and
> also
> > > in bin. I modify the test_grid_stat.sh and I left it in the
examples
> > > directory. When I run in bin following the command you sent me,
I have
> > > these errors.
> > >
> > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > wrfout_19_2.nc ERAI_pw.nc
> > >
> > > *** Model Evaluation Tools (METV8.1.1) ***
> > >
> > > Usage: grid_stat
> > > fcst_file
> > > obs_file
> > > config_file
> > > [-outdir path]
> > > [-log file]
> > > [-v level]
> > > [-compress level]
> > >
> > > where "fcst_file" is a gridded forecast file
containing the
> > > field(s) to be verified (required).
> > > "obs_file" is a gridded observation file
containing the
> > > verifying field(s) (required).
> > > "config_file" is a GridStatConfig file
containing the
> > > desired configuration settings (required).
> > > "-outdir path" overrides the default output
directory
> (.)
> > > (optional).
> > > "-log file" outputs log messages to the
specified file
> > > (optional).
> > > "-v level" overrides the default level of
logging (2)
> > > (optional).
> > > "-compress level" overrides the compression
level of
> > NetCDF
> > > variable (0) (optional).
> > >
> > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >
> > > Here is my test_grid_stat.sh file
> > > Cordially Dores.
> > >
> > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
> > met_help at ucar.edu
> > > >
> > > a écrit :
> > >
> > > > Das,
> > > >
> > > > Good news. It is very easy to configure Grid-Stat to compute
2x2
> > > > contingency tables. We just need to edit the config file
to...
> > > > (1) Define the categorical thresholds that should be applied
> > (cat_thresh
> > > =
> > > > [ >20, >30, >40, >50 ];)
> > > > (2) Turn on the CTC and CTS output line types (ctc = BOTH; cts
=
> BOTH;)
> > > >
> > > > You can of course change those thresholds however you'd like.
Here
> are
> > > > more commands to illustrate this:
> > > >
> > > > # Pull sample data from ftp site
> > > > wget
> > > >
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > > wget
> > > >
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > > wget
> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > > > GridStatConfig_pw
> > > >
> > > > # Create output directory and run Grid-Stat
> > > > mkdir -p out
> > > > export VXTIME=2018071900
> > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
> > > > GridStatConfig_pw -outdir out -v 3
> > > >
> > > > Then take a look at the output files:
> > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > > >
> > > > The _ctc.txt file contains the counts for the 2x2 contingency
table
> for
> > > > each of the 4 thresholds we specified.
> > > >
> > > > Hope this helps get you going.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > hello John,
> > > > > Excuse me, I beg you, to bother you.
> > > > > I created a symbolic link between my data and the pcp-
combines
> > > > directory. I
> > > > > used test_grid_stat.sh which I modified. I compile it, it
did not
> > > produce
> > > > > anything. I tried the command lines you sent me and I get
the
> errors
> > I
> > > > sent
> > > > > you. I really have no idea to get me out. I beg you, please,
to
> help
> > > me.
> > > > > Attaching my test_grid_stat.sh file.
> > > > >
> > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
> > ngaminidas at gmail.com>
> > > a
> > > > > écrit :
> > > > >
> > > > > > Hello John,
> > > > > > I am still unable to pull out my contingency table (CTC)
with
> MET.
> > I
> > > > have
> > > > > > read your email, the user guide, the online tutorial, but
I still
> > do
> > > > not
> > > > > > understand how I should run.
> > > > > > I see the lines of code:
> > > > > >
> > > > > > Use: grid_stat
> > > > > > fcst_file
> > > > > > obs_file
> > > > > > config_file
> > > > > > [-outdir path]
> > > > > > [-log file]
> > > > > > [-v level]
> > > > > > [-compress level]
> > > > > >
> > > > > > And, I do not know where I have to write them.
> > > > > > I see your run command lines:
> > > > > >
> > > > > > * mkdir -p out *
> > > > > > * setenv VXTIME "2018071900" *
> > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
wrfout_19_2.nc <
> > > > > > http://wrfout_19_2.nc>
> > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > > > > >
> > > > > > "setenv" did not give, I had to install "getenv".
> > > > > >
> > > > > > Command 'setenv' not found, did you mean:
> > > > > >
> > > > > > command 'getenv' from snap getenv (0.2.0)
> > > > > >
> > > > > > See 'snap info <snapname>' for additional versions.
> > > > > >
> > > > > > But when I try to run, I have errors:
> > > > > >
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o <project_name>]
[-s
> > > > > > <source_dir>]
> > > > > > getenv: error: unrecognized arguments: VXTIME 2018071900
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > > bash: syntax error near unexpected `newline '
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > > wrfout_19_2.nc
> > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file or
> directory
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > > > > .nc
> > > > > > bash:
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > > > > Is a directory
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $ /usr/local/met-
8.1.1/bin/grid_stat
> > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > > bash: syntax error near unexpected `newline '
> > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET /
8.1 /
> > > > met-8.1.1
> > > > > > / scripts / examples / exem $ ERAI_pw.nc GridStatConfig_pw
> -outdir
> > > out
> > > > > -v 3
> > > > > > ERAI_pw.nc: command not found
> > > > > >
> > > > > > Can you please, send me your execution script.
> > > > > > I may not be performing them properly. Please help me. I'm
lost.
> > > > > >
> > > > > > Best regards
> > > > > > Dores
> > > > > >
> > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> > > ngaminidas at gmail.com>
> > > > a
> > > > > > écrit :
> > > > > >
> > > > > >> Thank you very much.
> > > > > >>
> > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT <
> > > > > >> met_help at ucar.edu> a écrit :
> > > > > >>
> > > > > >>> Dores,
> > > > > >>>
> > > > > >>> OK, great. Thanks for sending some sample data.
> > > > > >>>
> > > > > >>> When getting started with new datasets in MET, I always
start
> by
> > > > > running
> > > > > >>> the plot_data_plane tool to make sure MET can read the
data and
> > > place
> > > > > it
> > > > > >>> on
> > > > > >>> the earth correctly.
> > > > > >>>
> > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and MET
can
> > easily
> > > > > read
> > > > > >>> that:
> > > > > >>>
> > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> level="(2018071900,*,*)";'
> > -v
> > > > 4*
> > > > > >>>
> > > > > >>> Next for the WRF output. When I try passing it to MET
> directly,
> > I
> > > > get
> > > > > an
> > > > > >>> error message:
> > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not a
valid
> > data
> > > > > file
> > > > > >>>
> > > > > >>> However, since this is on a lat/lon grid, we can just
tell MET
> to
> > > > > >>> interpret
> > > > > >>> it as being CF-compliant NetCDF, like this "file_type =
> > > > NETCDF_NCCF;":
> > > > > >>>
> > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**wrfout_19_2.nc
> > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > > > > level="(2018071900,*,*)";
> > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > > > >>>
> > > > > >>> PNG versions of the resulting images are attached.
> > > > > >>>
> > > > > >>> Looking at these images, we see that MET is able to read
data
> > from
> > > > > them.
> > > > > >>> And I'll leave it to you to confirm that MET is placing
them in
> > the
> > > > > right
> > > > > >>> spot on earth, but I assume it is.
> > > > > >>>
> > > > > >>> Next, let's run Grid-Stat to compute statistics on them.
I've
> > set
> > > up
> > > > > the
> > > > > >>> attached Grid-Stat config file to...
> > > > > >>>
> > > > > >>> (1) Regrid the ERAI data to the model domain using the
budget
> > > > > >>> interpolation
> > > > > >>> method
> > > > > >>> regrid = {
> > > > > >>> to_grid = FCST;
> > > > > >>> method = BUDGET;
> > > > > >>> width = 2;
> > > > > >>> vld_thresh = 0.5;
> > > > > >>> shape = SQUARE;
> > > > > >>> }
> > > > > >>>
> > > > > >>> (2) Transfer the config options from the plot_data_plane
> command
> > > line
> > > > > to
> > > > > >>> the "fcst" and "obs" dictionaries. For convenience, I
defined
> > the
> > > > time
> > > > > >>> as
> > > > > >>> an environment variable named $VXTIME:
> > > > > >>> fcst = {
> > > > > >>> file_type = NETCDF_NCCF;
> > > > > >>> field = [ { name = "pw"; level= [
"(${VXTIME},*,*)" ];
> }
> > ];
> > > > > >>> }
> > > > > >>> obs = {
> > > > > >>> field = [ { name = "tcw"; level= [
"(${VXTIME},*,*)" ];
> }
> > ];
> > > > > >>> }
> > > > > >>>
> > > > > >>> (3) Compute stats over the FULL model domain.
> > > > > >>> mask = {
> > > > > >>> grid = [ "FULL" ];
> > > > > >>> poly = [];
> > > > > >>> }
> > > > > >>>
> > > > > >>> (4) And just compute continuous stats.
> > > > > >>> output_flag = {
> > > > > >>> ...
> > > > > >>> cnt = BOTH;
> > > > > >>> ...
> > > > > >>> }
> > > > > >>>
> > > > > >>> Finally, run Grid-Stat on the command line like this:
> > > > > >>>
> > > > > >>> *mkdir -p out*
> > > > > >>> *setenv VXTIME "2018071900"*
> > > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > > > > >>> http://wrfout_19_2.nc>
> > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > > > > >>>
> > > > > >>> And that run successfully and creates output files:
> > > > > >>> DEBUG 1: Output file:
> out/grid_stat_000000L_20180719_000000V.stat
> > > > > >>> DEBUG 1: Output file:
> > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > > > >>> DEBUG 1: Output file:
> > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > > > >>>
> > > > > >>> Looking in the "_cnt.txt" file for example, the RMSE
value =
> > > 3.39378.
> > > > > >>>
> > > > > >>> Hope this helps get you up and running with MET.
> > > > > >>>
> > > > > >>> Thanks,
> > > > > >>> John Halley Gotway
> > > > > >>>
> > > > > >>>
> > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via
RT <
> > > > > >>> met_help at ucar.edu>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>> >
> > > > > >>> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >
> > > > > >>> >
> > > > > >>> > Hello John,
> > > > > >>> > I have already sent my data to my ftp site. In these
files, I
> > > want
> > > > to
> > > > > >>> > extract the pw. There is another missing ERAI file.
That
> one, I
> > > > have
> > > > > >>> > trouble sending it. It contains the relative humidity
and
> wind
> > > > data.
> > > > > >>> > Please,
> > > > > >>> > just tell me how to do it because I can not send this
file.
> > There
> > > > are
> > > > > >>> two
> > > > > >>> > wrfout files because my forecasts are made over 24
hours or
> > more.
> > > > My
> > > > > >>> raw
> > > > > >>> > wrf outputs are in "HDF", and I can not send them.
That's
> why I
> > > > sent
> > > > > >>> those
> > > > > >>> > in NetCDF. If I continue to wait for the other files
to be
> > sent,
> > > > the
> > > > > >>> time
> > > > > >>> > to deposit my memory will expire.
> > > > > >>> > Thank you very much for helping me.
> > > > > >>> > Yours sincerely.
> > > > > >>> > Dores
> > > > > >>> >
> > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via
RT <
> > > > > >>> met_help at ucar.edu
> > > > > >>> > >
> > > > > >>> > a écrit :
> > > > > >>> >
> > > > > >>> > > Dores,
> > > > > >>> > >
> > > > > >>> > > Were you able to post any data to the ftp site? You
could
> > try
> > > > > >>> sending
> > > > > >>> > via
> > > > > >>> > > email but I worry that the data files will be too
large to
> > > > transfer
> > > > > >>> that
> > > > > >>> > > way.
> > > > > >>> > >
> > > > > >>> > > Stephen is right... you need to put the files one by
way.
> By
> > > way
> > > > > of
> > > > > >>> > > example, here are commands to create a file named
> > > hello_world.txt
> > > > > and
> > > > > >>> > post
> > > > > >>> > > it to our ftp site.
> > > > > >>> > >
> > > > > >>> > > cd /home/johnhg
> > > > > >>> > > echo "hello world" > hello_world.txt
> > > > > >>> > > ftp ftp.rap.ucar.edu
> > > > > >>> > > username = anonymous
> > > > > >>> > > password = "my email address"
> > > > > >>> > > cd incoming/irap/met_help/dores_data
> > > > > >>> > > put hello_world.txt
> > > > > >>> > > bye
> > > > > >>> > >
> > > > > >>> > > And then checking the ftp via a web browser:
> > > > > >>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > > > >>> > >
> > > > > >>> > > I see that file now exists. Just be sure that
you're in
> the
> > > > > >>> directory
> > > > > >>> > > which contains the files you want to send before
running
> ftp.
> > > > > >>> > >
> > > > > >>> > > Thanks,
> > > > > >>> > > John
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via RT
<
> > > > > >>> met_help at ucar.edu>
> > > > > >>> > > wrote:
> > > > > >>> > >
> > > > > >>> > > >
> > > > > >>> > > > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > > >
> > > > > >>> > > >
> > > > > >>> > > >
> > > > > >>> > > > John,
> > > > > >>> > > >
> > > > > >>> > > > I'm merging in a non MET FTP ticket from Dores
into this
> > > ticket
> > > > > >>> with
> > > > > >>> > > > explanation of what i think the problem is
(specifying
> full
> > > > paths
> > > > > >>> on
> > > > > >>> > the
> > > > > >>> > > > files w/o telling the FTP server to rename to non-
pathed
> > > > > filename.
> > > > > >>> > > >
> > > > > >>> > > > If you want, it might be helpful to add something
about
> > that
> > > to
> > > > > >>> your
> > > > > >>> > Met
> > > > > >>> > > > Help FTP upload page.
> > > > > >>> > > >
> > > > > >>> > > > thanks,
> > > > > >>> > > > --stephen
> > > > > >>> > > >
> > > > > >>> > >
> > > > > >>> > >
> > > > > >>> >
> > > > > >>> >
> > > > > >>>
> > > > > >>>
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Oct 29 13:53:31 2019
Hello John,
FCST_VALID_BEG = 20180719_000000
FCST_VALID_END = 20180719_000000
It is the same for OBS.
I want to have
FCST_VALID_BEG = 20180719_000000
FCST_VALID_END = 20180726_000000
My another problem is how to cite MET.
Cordially
Dorès
Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> Each time Grid-Stat or Point-Stat is run, the timing information is
> extracted from the metadata of the data files. And that timing
information
> is written to the header columns of the output files. There is, in
> general, no easy way of modifying the timing information of the data
you're
> processing.
>
> And I don't really understand why you would want to change that
timing
> info.
>
> We actually do have a development issue defined that would enable
this in
> the future, but that work has not been done yet.
> https://github.com/NCAR/MET/issues/1020
>
> Thanks,
> John
>
> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John,
> > Thanks a lot for your help.
> > I can already see something interesting. But, I have another
problem. I
> > would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find them and
how to
> > take them into account when running. I predict 24 hours to 144
hours (0
> to
> > 6 days). Please help me.
> >
> > Thank you in advance.
> >
> > Dorès
> >
> >
> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
> met_help at ucar.edu
> > >
> > a écrit :
> >
> > > Dores,
> > >
> > > It looks like you're running Grid-Stat in this way:
> > >
> > >
> > >
> > > *dores at dores
> > >
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > > grid_statwrfout_19_2.nc
> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> > >
> > > And Grid-Stat is printing out the usage statement to indicate
that you
> > have
> > > provided the correct input arguments.
> > >
> > > Grid-Stat has 3 required arguments on the command line:
> > > (1) the path to the forecast file
> > > (2) the path to the observation file
> > > (3) the path the grid_stat configuration file
> > >
> > > You have provided the first 2 but not the 3rd. Please try
running
> > > grid_stat will all 3 required arguments:
> > >
> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> > >
> > > And there is no requirement for the directory structure to be
used.
> You
> > > can either provide the full absolute path the the input files,
or the
> > > relative path. If these files are all in your current working
> directory,
> > > you just list the filenames.
> > >
> > > John
> > >
> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> > > >
> > > > Hello John,
> > > > Excuse me for not understanding. I would like to interpolate
on the
> > grid
> > > > points in order to also have the "RMSE" and the "Pearson
correlation
> > > > coefficient" in addition to the contingency table. For this
fact, I
> put
> > > > ctc, cts and cnt at BOTH.
> > > > But, my problem remains the same: how do I execute my grid-
stat and
> in
> > > what
> > > > directory. In fact, I would like to know which files to use,
where to
> > put
> > > > these files and how to handle them. For the moment, I have
created a
> > > > symbolic link between the directory containing my data and the
> > directory
> > > > pcp-combines. I put my GridStatConfig_pw in the config
directory and
> > also
> > > > in bin. I modify the test_grid_stat.sh and I left it in the
examples
> > > > directory. When I run in bin following the command you sent
me, I
> have
> > > > these errors.
> > > >
> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > > wrfout_19_2.nc ERAI_pw.nc
> > > >
> > > > *** Model Evaluation Tools (METV8.1.1) ***
> > > >
> > > > Usage: grid_stat
> > > > fcst_file
> > > > obs_file
> > > > config_file
> > > > [-outdir path]
> > > > [-log file]
> > > > [-v level]
> > > > [-compress level]
> > > >
> > > > where "fcst_file" is a gridded forecast file
containing the
> > > > field(s) to be verified (required).
> > > > "obs_file" is a gridded observation file
containing
> the
> > > > verifying field(s) (required).
> > > > "config_file" is a GridStatConfig file
containing the
> > > > desired configuration settings (required).
> > > > "-outdir path" overrides the default output
directory
> > (.)
> > > > (optional).
> > > > "-log file" outputs log messages to the
specified
> file
> > > > (optional).
> > > > "-v level" overrides the default level of
logging (2)
> > > > (optional).
> > > > "-compress level" overrides the compression
level of
> > > NetCDF
> > > > variable (0) (optional).
> > > >
> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >
> > > > Here is my test_grid_stat.sh file
> > > > Cordially Dores.
> > > >
> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
> > > met_help at ucar.edu
> > > > >
> > > > a écrit :
> > > >
> > > > > Das,
> > > > >
> > > > > Good news. It is very easy to configure Grid-Stat to
compute 2x2
> > > > > contingency tables. We just need to edit the config file
to...
> > > > > (1) Define the categorical thresholds that should be applied
> > > (cat_thresh
> > > > =
> > > > > [ >20, >30, >40, >50 ];)
> > > > > (2) Turn on the CTC and CTS output line types (ctc = BOTH;
cts =
> > BOTH;)
> > > > >
> > > > > You can of course change those thresholds however you'd
like. Here
> > are
> > > > > more commands to illustrate this:
> > > > >
> > > > > # Pull sample data from ftp site
> > > > > wget
> > > > >
> > > > >
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > > > wget
> > > > >
> > > > >
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > > > wget
> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > > > > GridStatConfig_pw
> > > > >
> > > > > # Create output directory and run Grid-Stat
> > > > > mkdir -p out
> > > > > export VXTIME=2018071900
> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc ERAI_pw.nc
> > > > > GridStatConfig_pw -outdir out -v 3
> > > > >
> > > > > Then take a look at the output files:
> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > > > >
> > > > > The _ctc.txt file contains the counts for the 2x2
contingency table
> > for
> > > > > each of the 4 thresholds we specified.
> > > > >
> > > > > Hope this helps get you going.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > >
> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
> > > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > hello John,
> > > > > > Excuse me, I beg you, to bother you.
> > > > > > I created a symbolic link between my data and the pcp-
combines
> > > > > directory. I
> > > > > > used test_grid_stat.sh which I modified. I compile it, it
did not
> > > > produce
> > > > > > anything. I tried the command lines you sent me and I get
the
> > errors
> > > I
> > > > > sent
> > > > > > you. I really have no idea to get me out. I beg you,
please, to
> > help
> > > > me.
> > > > > > Attaching my test_grid_stat.sh file.
> > > > > >
> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
> > > ngaminidas at gmail.com>
> > > > a
> > > > > > écrit :
> > > > > >
> > > > > > > Hello John,
> > > > > > > I am still unable to pull out my contingency table (CTC)
with
> > MET.
> > > I
> > > > > have
> > > > > > > read your email, the user guide, the online tutorial,
but I
> still
> > > do
> > > > > not
> > > > > > > understand how I should run.
> > > > > > > I see the lines of code:
> > > > > > >
> > > > > > > Use: grid_stat
> > > > > > > fcst_file
> > > > > > > obs_file
> > > > > > > config_file
> > > > > > > [-outdir path]
> > > > > > > [-log file]
> > > > > > > [-v level]
> > > > > > > [-compress level]
> > > > > > >
> > > > > > > And, I do not know where I have to write them.
> > > > > > > I see your run command lines:
> > > > > > >
> > > > > > > * mkdir -p out *
> > > > > > > * setenv VXTIME "2018071900" *
> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
wrfout_19_2.nc <
> > > > > > > http://wrfout_19_2.nc>
> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > > > > > >
> > > > > > > "setenv" did not give, I had to install "getenv".
> > > > > > >
> > > > > > > Command 'setenv' not found, did you mean:
> > > > > > >
> > > > > > > command 'getenv' from snap getenv (0.2.0)
> > > > > > >
> > > > > > > See 'snap info <snapname>' for additional versions.
> > > > > > >
> > > > > > > But when I try to run, I have errors:
> > > > > > >
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $ getenv VXTIME "2018071900"
> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
<project_name>] [-s
> > > > > > > <source_dir>]
> > > > > > > getenv: error: unrecognized arguments: VXTIME 2018071900
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $
> /usr/local/met-8.1.1/bin/grid_stat
> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > > > bash: syntax error near unexpected `newline '
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $
> /usr/local/met-8.1.1/bin/grid_stat
> > > > > > > wrfout_19_2.nc
> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file
or
> > directory
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > > > > > .nc
> > > > > > > bash:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > > > > > Is a directory
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $
> /usr/local/met-8.1.1/bin/grid_stat
> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > > > > bash: syntax error near unexpected `newline '
> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1 /
> > > > > met-8.1.1
> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
GridStatConfig_pw
> > -outdir
> > > > out
> > > > > > -v 3
> > > > > > > ERAI_pw.nc: command not found
> > > > > > >
> > > > > > > Can you please, send me your execution script.
> > > > > > > I may not be performing them properly. Please help me.
I'm
> lost.
> > > > > > >
> > > > > > > Best regards
> > > > > > > Dores
> > > > > > >
> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> > > > ngaminidas at gmail.com>
> > > > > a
> > > > > > > écrit :
> > > > > > >
> > > > > > >> Thank you very much.
> > > > > > >>
> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via RT
<
> > > > > > >> met_help at ucar.edu> a écrit :
> > > > > > >>
> > > > > > >>> Dores,
> > > > > > >>>
> > > > > > >>> OK, great. Thanks for sending some sample data.
> > > > > > >>>
> > > > > > >>> When getting started with new datasets in MET, I
always start
> > by
> > > > > > running
> > > > > > >>> the plot_data_plane tool to make sure MET can read the
data
> and
> > > > place
> > > > > > it
> > > > > > >>> on
> > > > > > >>> the earth correctly.
> > > > > > >>>
> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and
MET can
> > > easily
> > > > > > read
> > > > > > >>> that:
> > > > > > >>>
> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **ERAI_pw.nc
> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> > level="(2018071900,*,*)";'
> > > -v
> > > > > 4*
> > > > > > >>>
> > > > > > >>> Next for the WRF output. When I try passing it to MET
> > directly,
> > > I
> > > > > get
> > > > > > an
> > > > > > >>> error message:
> > > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not
a
> valid
> > > data
> > > > > > file
> > > > > > >>>
> > > > > > >>> However, since this is on a lat/lon grid, we can just
tell
> MET
> > to
> > > > > > >>> interpret
> > > > > > >>> it as being CF-compliant NetCDF, like this "file_type
=
> > > > > NETCDF_NCCF;":
> > > > > > >>>
> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**wrfout_19_2.nc
> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > > > > > level="(2018071900,*,*)";
> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > > > > >>>
> > > > > > >>> PNG versions of the resulting images are attached.
> > > > > > >>>
> > > > > > >>> Looking at these images, we see that MET is able to
read data
> > > from
> > > > > > them.
> > > > > > >>> And I'll leave it to you to confirm that MET is
placing them
> in
> > > the
> > > > > > right
> > > > > > >>> spot on earth, but I assume it is.
> > > > > > >>>
> > > > > > >>> Next, let's run Grid-Stat to compute statistics on
them.
> I've
> > > set
> > > > up
> > > > > > the
> > > > > > >>> attached Grid-Stat config file to...
> > > > > > >>>
> > > > > > >>> (1) Regrid the ERAI data to the model domain using the
budget
> > > > > > >>> interpolation
> > > > > > >>> method
> > > > > > >>> regrid = {
> > > > > > >>> to_grid = FCST;
> > > > > > >>> method = BUDGET;
> > > > > > >>> width = 2;
> > > > > > >>> vld_thresh = 0.5;
> > > > > > >>> shape = SQUARE;
> > > > > > >>> }
> > > > > > >>>
> > > > > > >>> (2) Transfer the config options from the
plot_data_plane
> > command
> > > > line
> > > > > > to
> > > > > > >>> the "fcst" and "obs" dictionaries. For convenience, I
> defined
> > > the
> > > > > time
> > > > > > >>> as
> > > > > > >>> an environment variable named $VXTIME:
> > > > > > >>> fcst = {
> > > > > > >>> file_type = NETCDF_NCCF;
> > > > > > >>> field = [ { name = "pw"; level= [
"(${VXTIME},*,*)"
> ];
> > }
> > > ];
> > > > > > >>> }
> > > > > > >>> obs = {
> > > > > > >>> field = [ { name = "tcw"; level= [
"(${VXTIME},*,*)"
> ];
> > }
> > > ];
> > > > > > >>> }
> > > > > > >>>
> > > > > > >>> (3) Compute stats over the FULL model domain.
> > > > > > >>> mask = {
> > > > > > >>> grid = [ "FULL" ];
> > > > > > >>> poly = [];
> > > > > > >>> }
> > > > > > >>>
> > > > > > >>> (4) And just compute continuous stats.
> > > > > > >>> output_flag = {
> > > > > > >>> ...
> > > > > > >>> cnt = BOTH;
> > > > > > >>> ...
> > > > > > >>> }
> > > > > > >>>
> > > > > > >>> Finally, run Grid-Stat on the command line like this:
> > > > > > >>>
> > > > > > >>> *mkdir -p out*
> > > > > > >>> *setenv VXTIME "2018071900"*
> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > > > > > >>> http://wrfout_19_2.nc>
> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > > > > > >>>
> > > > > > >>> And that run successfully and creates output files:
> > > > > > >>> DEBUG 1: Output file:
> > out/grid_stat_000000L_20180719_000000V.stat
> > > > > > >>> DEBUG 1: Output file:
> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > > > > >>> DEBUG 1: Output file:
> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > > > > >>>
> > > > > > >>> Looking in the "_cnt.txt" file for example, the RMSE
value =
> > > > 3.39378.
> > > > > > >>>
> > > > > > >>> Hope this helps get you up and running with MET.
> > > > > > >>>
> > > > > > >>> Thanks,
> > > > > > >>> John Halley Gotway
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini via
RT <
> > > > > > >>> met_help at ucar.edu>
> > > > > > >>> wrote:
> > > > > > >>>
> > > > > > >>> >
> > > > > > >>> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > >
> > > > > > >>> >
> > > > > > >>> > Hello John,
> > > > > > >>> > I have already sent my data to my ftp site. In these
> files, I
> > > > want
> > > > > to
> > > > > > >>> > extract the pw. There is another missing ERAI file.
That
> > one, I
> > > > > have
> > > > > > >>> > trouble sending it. It contains the relative
humidity and
> > wind
> > > > > data.
> > > > > > >>> > Please,
> > > > > > >>> > just tell me how to do it because I can not send
this file.
> > > There
> > > > > are
> > > > > > >>> two
> > > > > > >>> > wrfout files because my forecasts are made over 24
hours or
> > > more.
> > > > > My
> > > > > > >>> raw
> > > > > > >>> > wrf outputs are in "HDF", and I can not send them.
That's
> > why I
> > > > > sent
> > > > > > >>> those
> > > > > > >>> > in NetCDF. If I continue to wait for the other files
to be
> > > sent,
> > > > > the
> > > > > > >>> time
> > > > > > >>> > to deposit my memory will expire.
> > > > > > >>> > Thank you very much for helping me.
> > > > > > >>> > Yours sincerely.
> > > > > > >>> > Dores
> > > > > > >>> >
> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway via
RT <
> > > > > > >>> met_help at ucar.edu
> > > > > > >>> > >
> > > > > > >>> > a écrit :
> > > > > > >>> >
> > > > > > >>> > > Dores,
> > > > > > >>> > >
> > > > > > >>> > > Were you able to post any data to the ftp site?
You
> could
> > > try
> > > > > > >>> sending
> > > > > > >>> > via
> > > > > > >>> > > email but I worry that the data files will be too
large
> to
> > > > > transfer
> > > > > > >>> that
> > > > > > >>> > > way.
> > > > > > >>> > >
> > > > > > >>> > > Stephen is right... you need to put the files one
by way.
> > By
> > > > way
> > > > > > of
> > > > > > >>> > > example, here are commands to create a file named
> > > > hello_world.txt
> > > > > > and
> > > > > > >>> > post
> > > > > > >>> > > it to our ftp site.
> > > > > > >>> > >
> > > > > > >>> > > cd /home/johnhg
> > > > > > >>> > > echo "hello world" > hello_world.txt
> > > > > > >>> > > ftp ftp.rap.ucar.edu
> > > > > > >>> > > username = anonymous
> > > > > > >>> > > password = "my email address"
> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> > > > > > >>> > > put hello_world.txt
> > > > > > >>> > > bye
> > > > > > >>> > >
> > > > > > >>> > > And then checking the ftp via a web browser:
> > > > > > >>> > >
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > > > > >>> > >
> > > > > > >>> > > I see that file now exists. Just be sure that
you're in
> > the
> > > > > > >>> directory
> > > > > > >>> > > which contains the files you want to send before
running
> > ftp.
> > > > > > >>> > >
> > > > > > >>> > > Thanks,
> > > > > > >>> > > John
> > > > > > >>> > >
> > > > > > >>> > >
> > > > > > >>> > >
> > > > > > >>> > >
> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via
RT <
> > > > > > >>> met_help at ucar.edu>
> > > > > > >>> > > wrote:
> > > > > > >>> > >
> > > > > > >>> > > >
> > > > > > >>> > > > <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > > > >
> > > > > > >>> > > >
> > > > > > >>> > > >
> > > > > > >>> > > > John,
> > > > > > >>> > > >
> > > > > > >>> > > > I'm merging in a non MET FTP ticket from Dores
into
> this
> > > > ticket
> > > > > > >>> with
> > > > > > >>> > > > explanation of what i think the problem is
(specifying
> > full
> > > > > paths
> > > > > > >>> on
> > > > > > >>> > the
> > > > > > >>> > > > files w/o telling the FTP server to rename to
> non-pathed
> > > > > > filename.
> > > > > > >>> > > >
> > > > > > >>> > > > If you want, it might be helpful to add
something about
> > > that
> > > > to
> > > > > > >>> your
> > > > > > >>> > Met
> > > > > > >>> > > > Help FTP upload page.
> > > > > > >>> > > >
> > > > > > >>> > > > thanks,
> > > > > > >>> > > > --stephen
> > > > > > >>> > > >
> > > > > > >>> > >
> > > > > > >>> > >
> > > > > > >>> >
> > > > > > >>> >
> > > > > > >>>
> > > > > > >>>
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Oct 29 14:25:21 2019
Hello John,
Another problem that I have now is I am not able to run another wrfout
with
the same command. What should I change? I have several wrfout files
that I
want to fill the CTC.
Here the error that I have.
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
DEBUG 1: Default Config File:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_pw
ERROR :
ERROR : MetNcCFDataFile::open(const char *) -> unable to open NetCDF
file "
wrfout_20_2.nc"
ERROR :
ERROR :
ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error opening
file
"wrfout_20_2.nc"
ERROR :
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
Best regards
Dorès
Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> FCST_VALID_BEG = 20180719_000000
> FCST_VALID_END = 20180719_000000
> It is the same for OBS.
> I want to have
> FCST_VALID_BEG = 20180719_000000
> FCST_VALID_END = 20180726_000000
>
> My another problem is how to cite MET.
>
> Cordially
> Dorès
>
> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> Dores,
>>
>> Each time Grid-Stat or Point-Stat is run, the timing information is
>> extracted from the metadata of the data files. And that timing
>> information
>> is written to the header columns of the output files. There is, in
>> general, no easy way of modifying the timing information of the
data
>> you're
>> processing.
>>
>> And I don't really understand why you would want to change that
timing
>> info.
>>
>> We actually do have a development issue defined that would enable
this in
>> the future, but that work has not been done yet.
>> https://github.com/NCAR/MET/issues/1020
>>
>> Thanks,
>> John
>>
>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> >
>> > Hello John,
>> > Thanks a lot for your help.
>> > I can already see something interesting. But, I have another
problem. I
>> > would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find them
and how
>> to
>> > take them into account when running. I predict 24 hours to 144
hours (0
>> to
>> > 6 days). Please help me.
>> >
>> > Thank you in advance.
>> >
>> > Dorès
>> >
>> >
>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
>> met_help at ucar.edu
>> > >
>> > a écrit :
>> >
>> > > Dores,
>> > >
>> > > It looks like you're running Grid-Stat in this way:
>> > >
>> > >
>> > >
>> > > *dores at dores
>> > >
>> >
>>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
>> > > grid_statwrfout_19_2.nc
>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
>> > >
>> > > And Grid-Stat is printing out the usage statement to indicate
that you
>> > have
>> > > provided the correct input arguments.
>> > >
>> > > Grid-Stat has 3 required arguments on the command line:
>> > > (1) the path to the forecast file
>> > > (2) the path to the observation file
>> > > (3) the path the grid_stat configuration file
>> > >
>> > > You have provided the first 2 but not the 3rd. Please try
running
>> > > grid_stat will all 3 required arguments:
>> > >
>> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>> > >
>> > > And there is no requirement for the directory structure to be
used.
>> You
>> > > can either provide the full absolute path the the input files,
or the
>> > > relative path. If these files are all in your current working
>> directory,
>> > > you just list the filenames.
>> > >
>> > > John
>> > >
>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
>> > > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
>> > > >
>> > > > Hello John,
>> > > > Excuse me for not understanding. I would like to interpolate
on the
>> > grid
>> > > > points in order to also have the "RMSE" and the "Pearson
correlation
>> > > > coefficient" in addition to the contingency table. For this
fact, I
>> put
>> > > > ctc, cts and cnt at BOTH.
>> > > > But, my problem remains the same: how do I execute my grid-
stat and
>> in
>> > > what
>> > > > directory. In fact, I would like to know which files to use,
where
>> to
>> > put
>> > > > these files and how to handle them. For the moment, I have
created a
>> > > > symbolic link between the directory containing my data and
the
>> > directory
>> > > > pcp-combines. I put my GridStatConfig_pw in the config
directory and
>> > also
>> > > > in bin. I modify the test_grid_stat.sh and I left it in the
examples
>> > > > directory. When I run in bin following the command you sent
me, I
>> have
>> > > > these errors.
>> > > >
>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > > wrfout_19_2.nc ERAI_pw.nc
>> > > >
>> > > > *** Model Evaluation Tools (METV8.1.1) ***
>> > > >
>> > > > Usage: grid_stat
>> > > > fcst_file
>> > > > obs_file
>> > > > config_file
>> > > > [-outdir path]
>> > > > [-log file]
>> > > > [-v level]
>> > > > [-compress level]
>> > > >
>> > > > where "fcst_file" is a gridded forecast file
containing
>> the
>> > > > field(s) to be verified (required).
>> > > > "obs_file" is a gridded observation file
containing
>> the
>> > > > verifying field(s) (required).
>> > > > "config_file" is a GridStatConfig file
containing
>> the
>> > > > desired configuration settings (required).
>> > > > "-outdir path" overrides the default output
>> directory
>> > (.)
>> > > > (optional).
>> > > > "-log file" outputs log messages to the
specified
>> file
>> > > > (optional).
>> > > > "-v level" overrides the default level of
logging
>> (2)
>> > > > (optional).
>> > > > "-compress level" overrides the compression
level of
>> > > NetCDF
>> > > > variable (0) (optional).
>> > > >
>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > >
>> > > > Here is my test_grid_stat.sh file
>> > > > Cordially Dores.
>> > > >
>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
>> > > met_help at ucar.edu
>> > > > >
>> > > > a écrit :
>> > > >
>> > > > > Das,
>> > > > >
>> > > > > Good news. It is very easy to configure Grid-Stat to
compute 2x2
>> > > > > contingency tables. We just need to edit the config file
to...
>> > > > > (1) Define the categorical thresholds that should be
applied
>> > > (cat_thresh
>> > > > =
>> > > > > [ >20, >30, >40, >50 ];)
>> > > > > (2) Turn on the CTC and CTS output line types (ctc = BOTH;
cts =
>> > BOTH;)
>> > > > >
>> > > > > You can of course change those thresholds however you'd
like.
>> Here
>> > are
>> > > > > more commands to illustrate this:
>> > > > >
>> > > > > # Pull sample data from ftp site
>> > > > > wget
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>> > > > > wget
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>> > > > > wget
>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
>> > > > > GridStatConfig_pw
>> > > > >
>> > > > > # Create output directory and run Grid-Stat
>> > > > > mkdir -p out
>> > > > > export VXTIME=2018071900
>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
ERAI_pw.nc
>> > > > > GridStatConfig_pw -outdir out -v 3
>> > > > >
>> > > > > Then take a look at the output files:
>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
>> > > > >
>> > > > > The _ctc.txt file contains the counts for the 2x2
contingency
>> table
>> > for
>> > > > > each of the 4 thresholds we specified.
>> > > > >
>> > > > > Hope this helps get you going.
>> > > > >
>> > > > > Thanks,
>> > > > > John
>> > > > >
>> > > > >
>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
>> > > > > met_help at ucar.edu>
>> > > > > wrote:
>> > > > >
>> > > > > > hello John,
>> > > > > > Excuse me, I beg you, to bother you.
>> > > > > > I created a symbolic link between my data and the pcp-
combines
>> > > > > directory. I
>> > > > > > used test_grid_stat.sh which I modified. I compile it, it
did
>> not
>> > > > produce
>> > > > > > anything. I tried the command lines you sent me and I get
the
>> > errors
>> > > I
>> > > > > sent
>> > > > > > you. I really have no idea to get me out. I beg you,
please, to
>> > help
>> > > > me.
>> > > > > > Attaching my test_grid_stat.sh file.
>> > > > > >
>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
>> > > ngaminidas at gmail.com>
>> > > > a
>> > > > > > écrit :
>> > > > > >
>> > > > > > > Hello John,
>> > > > > > > I am still unable to pull out my contingency table
(CTC) with
>> > MET.
>> > > I
>> > > > > have
>> > > > > > > read your email, the user guide, the online tutorial,
but I
>> still
>> > > do
>> > > > > not
>> > > > > > > understand how I should run.
>> > > > > > > I see the lines of code:
>> > > > > > >
>> > > > > > > Use: grid_stat
>> > > > > > > fcst_file
>> > > > > > > obs_file
>> > > > > > > config_file
>> > > > > > > [-outdir path]
>> > > > > > > [-log file]
>> > > > > > > [-v level]
>> > > > > > > [-compress level]
>> > > > > > >
>> > > > > > > And, I do not know where I have to write them.
>> > > > > > > I see your run command lines:
>> > > > > > >
>> > > > > > > * mkdir -p out *
>> > > > > > > * setenv VXTIME "2018071900" *
>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
wrfout_19_2.nc
>> <
>> > > > > > > http://wrfout_19_2.nc>
>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
>> > > > > > >
>> > > > > > > "setenv" did not give, I had to install "getenv".
>> > > > > > >
>> > > > > > > Command 'setenv' not found, did you mean:
>> > > > > > >
>> > > > > > > command 'getenv' from snap getenv (0.2.0)
>> > > > > > >
>> > > > > > > See 'snap info <snapname>' for additional versions.
>> > > > > > >
>> > > > > > > But when I try to run, I have errors:
>> > > > > > >
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $ getenv VXTIME
"2018071900"
>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
<project_name>] [-s
>> > > > > > > <source_dir>]
>> > > > > > > getenv: error: unrecognized arguments: VXTIME
2018071900
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $
>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>> > > > > > > bash: syntax error near unexpected `newline '
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $
>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > > > > wrfout_19_2.nc
>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file
or
>> > directory
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
>> > > > > > > .nc
>> > > > > > > bash:
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
>> > > > > > > Is a directory
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $
>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>> > > > > > > bash: syntax error near unexpected `newline '
>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision / MET
/ 8.1
>> /
>> > > > > met-8.1.1
>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
GridStatConfig_pw
>> > -outdir
>> > > > out
>> > > > > > -v 3
>> > > > > > > ERAI_pw.nc: command not found
>> > > > > > >
>> > > > > > > Can you please, send me your execution script.
>> > > > > > > I may not be performing them properly. Please help me.
I'm
>> lost.
>> > > > > > >
>> > > > > > > Best regards
>> > > > > > > Dores
>> > > > > > >
>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
>> > > > ngaminidas at gmail.com>
>> > > > > a
>> > > > > > > écrit :
>> > > > > > >
>> > > > > > >> Thank you very much.
>> > > > > > >>
>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via
RT <
>> > > > > > >> met_help at ucar.edu> a écrit :
>> > > > > > >>
>> > > > > > >>> Dores,
>> > > > > > >>>
>> > > > > > >>> OK, great. Thanks for sending some sample data.
>> > > > > > >>>
>> > > > > > >>> When getting started with new datasets in MET, I
always
>> start
>> > by
>> > > > > > running
>> > > > > > >>> the plot_data_plane tool to make sure MET can read
the data
>> and
>> > > > place
>> > > > > > it
>> > > > > > >>> on
>> > > > > > >>> the earth correctly.
>> > > > > > >>>
>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and
MET can
>> > > easily
>> > > > > > read
>> > > > > > >>> that:
>> > > > > > >>>
>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**ERAI_pw.nc
>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
>> > level="(2018071900,*,*)";'
>> > > -v
>> > > > > 4*
>> > > > > > >>>
>> > > > > > >>> Next for the WRF output. When I try passing it to
MET
>> > directly,
>> > > I
>> > > > > get
>> > > > > > an
>> > > > > > >>> error message:
>> > > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc" not
a
>> valid
>> > > data
>> > > > > > file
>> > > > > > >>>
>> > > > > > >>> However, since this is on a lat/lon grid, we can just
tell
>> MET
>> > to
>> > > > > > >>> interpret
>> > > > > > >>> it as being CF-compliant NetCDF, like this "file_type
=
>> > > > > NETCDF_NCCF;":
>> > > > > > >>>
>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**wrfout_19_2.nc
>> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
>> > > > > > level="(2018071900,*,*)";
>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
>> > > > > > >>>
>> > > > > > >>> PNG versions of the resulting images are attached.
>> > > > > > >>>
>> > > > > > >>> Looking at these images, we see that MET is able to
read
>> data
>> > > from
>> > > > > > them.
>> > > > > > >>> And I'll leave it to you to confirm that MET is
placing
>> them in
>> > > the
>> > > > > > right
>> > > > > > >>> spot on earth, but I assume it is.
>> > > > > > >>>
>> > > > > > >>> Next, let's run Grid-Stat to compute statistics on
them.
>> I've
>> > > set
>> > > > up
>> > > > > > the
>> > > > > > >>> attached Grid-Stat config file to...
>> > > > > > >>>
>> > > > > > >>> (1) Regrid the ERAI data to the model domain using
the
>> budget
>> > > > > > >>> interpolation
>> > > > > > >>> method
>> > > > > > >>> regrid = {
>> > > > > > >>> to_grid = FCST;
>> > > > > > >>> method = BUDGET;
>> > > > > > >>> width = 2;
>> > > > > > >>> vld_thresh = 0.5;
>> > > > > > >>> shape = SQUARE;
>> > > > > > >>> }
>> > > > > > >>>
>> > > > > > >>> (2) Transfer the config options from the
plot_data_plane
>> > command
>> > > > line
>> > > > > > to
>> > > > > > >>> the "fcst" and "obs" dictionaries. For convenience,
I
>> defined
>> > > the
>> > > > > time
>> > > > > > >>> as
>> > > > > > >>> an environment variable named $VXTIME:
>> > > > > > >>> fcst = {
>> > > > > > >>> file_type = NETCDF_NCCF;
>> > > > > > >>> field = [ { name = "pw"; level= [
"(${VXTIME},*,*)"
>> ];
>> > }
>> > > ];
>> > > > > > >>> }
>> > > > > > >>> obs = {
>> > > > > > >>> field = [ { name = "tcw"; level= [
"(${VXTIME},*,*)"
>> ];
>> > }
>> > > ];
>> > > > > > >>> }
>> > > > > > >>>
>> > > > > > >>> (3) Compute stats over the FULL model domain.
>> > > > > > >>> mask = {
>> > > > > > >>> grid = [ "FULL" ];
>> > > > > > >>> poly = [];
>> > > > > > >>> }
>> > > > > > >>>
>> > > > > > >>> (4) And just compute continuous stats.
>> > > > > > >>> output_flag = {
>> > > > > > >>> ...
>> > > > > > >>> cnt = BOTH;
>> > > > > > >>> ...
>> > > > > > >>> }
>> > > > > > >>>
>> > > > > > >>> Finally, run Grid-Stat on the command line like this:
>> > > > > > >>>
>> > > > > > >>> *mkdir -p out*
>> > > > > > >>> *setenv VXTIME "2018071900"*
>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
>> > > > > > >>> http://wrfout_19_2.nc>
>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>> > > > > > >>>
>> > > > > > >>> And that run successfully and creates output files:
>> > > > > > >>> DEBUG 1: Output file:
>> > out/grid_stat_000000L_20180719_000000V.stat
>> > > > > > >>> DEBUG 1: Output file:
>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
>> > > > > > >>> DEBUG 1: Output file:
>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
>> > > > > > >>>
>> > > > > > >>> Looking in the "_cnt.txt" file for example, the RMSE
value =
>> > > > 3.39378.
>> > > > > > >>>
>> > > > > > >>> Hope this helps get you up and running with MET.
>> > > > > > >>>
>> > > > > > >>> Thanks,
>> > > > > > >>> John Halley Gotway
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini
via RT <
>> > > > > > >>> met_help at ucar.edu>
>> > > > > > >>> wrote:
>> > > > > > >>>
>> > > > > > >>> >
>> > > > > > >>> > <URL:
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > > >
>> > > > > > >>> >
>> > > > > > >>> > Hello John,
>> > > > > > >>> > I have already sent my data to my ftp site. In
these
>> files, I
>> > > > want
>> > > > > to
>> > > > > > >>> > extract the pw. There is another missing ERAI file.
That
>> > one, I
>> > > > > have
>> > > > > > >>> > trouble sending it. It contains the relative
humidity and
>> > wind
>> > > > > data.
>> > > > > > >>> > Please,
>> > > > > > >>> > just tell me how to do it because I can not send
this
>> file.
>> > > There
>> > > > > are
>> > > > > > >>> two
>> > > > > > >>> > wrfout files because my forecasts are made over 24
hours
>> or
>> > > more.
>> > > > > My
>> > > > > > >>> raw
>> > > > > > >>> > wrf outputs are in "HDF", and I can not send them.
That's
>> > why I
>> > > > > sent
>> > > > > > >>> those
>> > > > > > >>> > in NetCDF. If I continue to wait for the other
files to be
>> > > sent,
>> > > > > the
>> > > > > > >>> time
>> > > > > > >>> > to deposit my memory will expire.
>> > > > > > >>> > Thank you very much for helping me.
>> > > > > > >>> > Yours sincerely.
>> > > > > > >>> > Dores
>> > > > > > >>> >
>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway
via RT <
>> > > > > > >>> met_help at ucar.edu
>> > > > > > >>> > >
>> > > > > > >>> > a écrit :
>> > > > > > >>> >
>> > > > > > >>> > > Dores,
>> > > > > > >>> > >
>> > > > > > >>> > > Were you able to post any data to the ftp site?
You
>> could
>> > > try
>> > > > > > >>> sending
>> > > > > > >>> > via
>> > > > > > >>> > > email but I worry that the data files will be too
large
>> to
>> > > > > transfer
>> > > > > > >>> that
>> > > > > > >>> > > way.
>> > > > > > >>> > >
>> > > > > > >>> > > Stephen is right... you need to put the files one
by
>> way.
>> > By
>> > > > way
>> > > > > > of
>> > > > > > >>> > > example, here are commands to create a file named
>> > > > hello_world.txt
>> > > > > > and
>> > > > > > >>> > post
>> > > > > > >>> > > it to our ftp site.
>> > > > > > >>> > >
>> > > > > > >>> > > cd /home/johnhg
>> > > > > > >>> > > echo "hello world" > hello_world.txt
>> > > > > > >>> > > ftp ftp.rap.ucar.edu
>> > > > > > >>> > > username = anonymous
>> > > > > > >>> > > password = "my email address"
>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
>> > > > > > >>> > > put hello_world.txt
>> > > > > > >>> > > bye
>> > > > > > >>> > >
>> > > > > > >>> > > And then checking the ftp via a web browser:
>> > > > > > >>> > >
>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>> > > > > > >>> > >
>> > > > > > >>> > > I see that file now exists. Just be sure that
you're in
>> > the
>> > > > > > >>> directory
>> > > > > > >>> > > which contains the files you want to send before
running
>> > ftp.
>> > > > > > >>> > >
>> > > > > > >>> > > Thanks,
>> > > > > > >>> > > John
>> > > > > > >>> > >
>> > > > > > >>> > >
>> > > > > > >>> > >
>> > > > > > >>> > >
>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy via
RT <
>> > > > > > >>> met_help at ucar.edu>
>> > > > > > >>> > > wrote:
>> > > > > > >>> > >
>> > > > > > >>> > > >
>> > > > > > >>> > > > <URL:
>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > > > > >
>> > > > > > >>> > > >
>> > > > > > >>> > > >
>> > > > > > >>> > > > John,
>> > > > > > >>> > > >
>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from Dores
into
>> this
>> > > > ticket
>> > > > > > >>> with
>> > > > > > >>> > > > explanation of what i think the problem is
(specifying
>> > full
>> > > > > paths
>> > > > > > >>> on
>> > > > > > >>> > the
>> > > > > > >>> > > > files w/o telling the FTP server to rename to
>> non-pathed
>> > > > > > filename.
>> > > > > > >>> > > >
>> > > > > > >>> > > > If you want, it might be helpful to add
something
>> about
>> > > that
>> > > > to
>> > > > > > >>> your
>> > > > > > >>> > Met
>> > > > > > >>> > > > Help FTP upload page.
>> > > > > > >>> > > >
>> > > > > > >>> > > > thanks,
>> > > > > > >>> > > > --stephen
>> > > > > > >>> > > >
>> > > > > > >>> > >
>> > > > > > >>> > >
>> > > > > > >>> >
>> > > > > > >>> >
>> > > > > > >>>
>> > > > > > >>>
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Oct 29 14:39:35 2019
Hello John,
I use the same config file and the same test_grid_stat.sh file.
Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> Another problem that I have now is I am not able to run another
wrfout
> with the same command. What should I change? I have several wrfout
files
> that I want to fill the CTC.
> Here the error that I have.
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> DEBUG 1: Default Config File:
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_pw
> ERROR :
> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF file
> "wrfout_20_2.nc"
> ERROR :
> ERROR :
> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> file "wrfout_20_2.nc"
> ERROR :
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>
> Best regards
> Dorès
>
> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
>> Hello John,
>> FCST_VALID_BEG = 20180719_000000
>> FCST_VALID_END = 20180719_000000
>> It is the same for OBS.
>> I want to have
>> FCST_VALID_BEG = 20180719_000000
>> FCST_VALID_END = 20180726_000000
>>
>> My another problem is how to cite MET.
>>
>> Cordially
>> Dorès
>>
>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
>> met_help at ucar.edu> a écrit :
>>
>>> Dores,
>>>
>>> Each time Grid-Stat or Point-Stat is run, the timing information
is
>>> extracted from the metadata of the data files. And that timing
>>> information
>>> is written to the header columns of the output files. There is,
in
>>> general, no easy way of modifying the timing information of the
data
>>> you're
>>> processing.
>>>
>>> And I don't really understand why you would want to change that
timing
>>> info.
>>>
>>> We actually do have a development issue defined that would enable
this in
>>> the future, but that work has not been done yet.
>>> https://github.com/NCAR/MET/issues/1020
>>>
>>> Thanks,
>>> John
>>>
>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
>>> met_help at ucar.edu>
>>> wrote:
>>>
>>> >
>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>> >
>>> > Hello John,
>>> > Thanks a lot for your help.
>>> > I can already see something interesting. But, I have another
problem. I
>>> > would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find them
and how
>>> to
>>> > take them into account when running. I predict 24 hours to 144
hours
>>> (0 to
>>> > 6 days). Please help me.
>>> >
>>> > Thank you in advance.
>>> >
>>> > Dorès
>>> >
>>> >
>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
>>> met_help at ucar.edu
>>> > >
>>> > a écrit :
>>> >
>>> > > Dores,
>>> > >
>>> > > It looks like you're running Grid-Stat in this way:
>>> > >
>>> > >
>>> > >
>>> > > *dores at dores
>>> > >
>>> >
>>>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
>>> > > grid_statwrfout_19_2.nc
>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
>>> > >
>>> > > And Grid-Stat is printing out the usage statement to indicate
that
>>> you
>>> > have
>>> > > provided the correct input arguments.
>>> > >
>>> > > Grid-Stat has 3 required arguments on the command line:
>>> > > (1) the path to the forecast file
>>> > > (2) the path to the observation file
>>> > > (3) the path the grid_stat configuration file
>>> > >
>>> > > You have provided the first 2 but not the 3rd. Please try
running
>>> > > grid_stat will all 3 required arguments:
>>> > >
>>> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>>> > >
>>> > > And there is no requirement for the directory structure to be
used.
>>> You
>>> > > can either provide the full absolute path the the input files,
or the
>>> > > relative path. If these files are all in your current working
>>> directory,
>>> > > you just list the filenames.
>>> > >
>>> > > John
>>> > >
>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
>>> > > met_help at ucar.edu>
>>> > > wrote:
>>> > >
>>> > > >
>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>> > > >
>>> > > > Hello John,
>>> > > > Excuse me for not understanding. I would like to interpolate
on the
>>> > grid
>>> > > > points in order to also have the "RMSE" and the "Pearson
>>> correlation
>>> > > > coefficient" in addition to the contingency table. For this
fact,
>>> I put
>>> > > > ctc, cts and cnt at BOTH.
>>> > > > But, my problem remains the same: how do I execute my grid-
stat
>>> and in
>>> > > what
>>> > > > directory. In fact, I would like to know which files to use,
where
>>> to
>>> > put
>>> > > > these files and how to handle them. For the moment, I have
created
>>> a
>>> > > > symbolic link between the directory containing my data and
the
>>> > directory
>>> > > > pcp-combines. I put my GridStatConfig_pw in the config
directory
>>> and
>>> > also
>>> > > > in bin. I modify the test_grid_stat.sh and I left it in the
>>> examples
>>> > > > directory. When I run in bin following the command you sent
me, I
>>> have
>>> > > > these errors.
>>> > > >
>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>>> > > > wrfout_19_2.nc ERAI_pw.nc
>>> > > >
>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
>>> > > >
>>> > > > Usage: grid_stat
>>> > > > fcst_file
>>> > > > obs_file
>>> > > > config_file
>>> > > > [-outdir path]
>>> > > > [-log file]
>>> > > > [-v level]
>>> > > > [-compress level]
>>> > > >
>>> > > > where "fcst_file" is a gridded forecast file
containing
>>> the
>>> > > > field(s) to be verified (required).
>>> > > > "obs_file" is a gridded observation file
>>> containing the
>>> > > > verifying field(s) (required).
>>> > > > "config_file" is a GridStatConfig file
containing
>>> the
>>> > > > desired configuration settings (required).
>>> > > > "-outdir path" overrides the default output
>>> directory
>>> > (.)
>>> > > > (optional).
>>> > > > "-log file" outputs log messages to the
specified
>>> file
>>> > > > (optional).
>>> > > > "-v level" overrides the default level of
logging
>>> (2)
>>> > > > (optional).
>>> > > > "-compress level" overrides the compression
level
>>> of
>>> > > NetCDF
>>> > > > variable (0) (optional).
>>> > > >
>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>>> > > >
>>> > > > Here is my test_grid_stat.sh file
>>> > > > Cordially Dores.
>>> > > >
>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
>>> > > met_help at ucar.edu
>>> > > > >
>>> > > > a écrit :
>>> > > >
>>> > > > > Das,
>>> > > > >
>>> > > > > Good news. It is very easy to configure Grid-Stat to
compute 2x2
>>> > > > > contingency tables. We just need to edit the config file
to...
>>> > > > > (1) Define the categorical thresholds that should be
applied
>>> > > (cat_thresh
>>> > > > =
>>> > > > > [ >20, >30, >40, >50 ];)
>>> > > > > (2) Turn on the CTC and CTS output line types (ctc = BOTH;
cts =
>>> > BOTH;)
>>> > > > >
>>> > > > > You can of course change those thresholds however you'd
like.
>>> Here
>>> > are
>>> > > > > more commands to illustrate this:
>>> > > > >
>>> > > > > # Pull sample data from ftp site
>>> > > > > wget
>>> > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>>> > > > > wget
>>> > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>>> > > > > wget
>>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
>>> > > > > GridStatConfig_pw
>>> > > > >
>>> > > > > # Create output directory and run Grid-Stat
>>> > > > > mkdir -p out
>>> > > > > export VXTIME=2018071900
>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
ERAI_pw.nc
>>> > > > > GridStatConfig_pw -outdir out -v 3
>>> > > > >
>>> > > > > Then take a look at the output files:
>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
>>> > > > >
>>> > > > > The _ctc.txt file contains the counts for the 2x2
contingency
>>> table
>>> > for
>>> > > > > each of the 4 thresholds we specified.
>>> > > > >
>>> > > > > Hope this helps get you going.
>>> > > > >
>>> > > > > Thanks,
>>> > > > > John
>>> > > > >
>>> > > > >
>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT <
>>> > > > > met_help at ucar.edu>
>>> > > > > wrote:
>>> > > > >
>>> > > > > > hello John,
>>> > > > > > Excuse me, I beg you, to bother you.
>>> > > > > > I created a symbolic link between my data and the pcp-
combines
>>> > > > > directory. I
>>> > > > > > used test_grid_stat.sh which I modified. I compile it,
it did
>>> not
>>> > > > produce
>>> > > > > > anything. I tried the command lines you sent me and I
get the
>>> > errors
>>> > > I
>>> > > > > sent
>>> > > > > > you. I really have no idea to get me out. I beg you,
please, to
>>> > help
>>> > > > me.
>>> > > > > > Attaching my test_grid_stat.sh file.
>>> > > > > >
>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
>>> > > ngaminidas at gmail.com>
>>> > > > a
>>> > > > > > écrit :
>>> > > > > >
>>> > > > > > > Hello John,
>>> > > > > > > I am still unable to pull out my contingency table
(CTC) with
>>> > MET.
>>> > > I
>>> > > > > have
>>> > > > > > > read your email, the user guide, the online tutorial,
but I
>>> still
>>> > > do
>>> > > > > not
>>> > > > > > > understand how I should run.
>>> > > > > > > I see the lines of code:
>>> > > > > > >
>>> > > > > > > Use: grid_stat
>>> > > > > > > fcst_file
>>> > > > > > > obs_file
>>> > > > > > > config_file
>>> > > > > > > [-outdir path]
>>> > > > > > > [-log file]
>>> > > > > > > [-v level]
>>> > > > > > > [-compress level]
>>> > > > > > >
>>> > > > > > > And, I do not know where I have to write them.
>>> > > > > > > I see your run command lines:
>>> > > > > > >
>>> > > > > > > * mkdir -p out *
>>> > > > > > > * setenv VXTIME "2018071900" *
>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
wrfout_19_2.nc
>>> <
>>> > > > > > > http://wrfout_19_2.nc>
>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
>>> > > > > > >
>>> > > > > > > "setenv" did not give, I had to install "getenv".
>>> > > > > > >
>>> > > > > > > Command 'setenv' not found, did you mean:
>>> > > > > > >
>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
>>> > > > > > >
>>> > > > > > > See 'snap info <snapname>' for additional versions.
>>> > > > > > >
>>> > > > > > > But when I try to run, I have errors:
>>> > > > > > >
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
"2018071900"
>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
<project_name>]
>>> [-s
>>> > > > > > > <source_dir>]
>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
2018071900
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $
>>> /usr/local/met-8.1.1/bin/grid_stat
>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>>> > > > > > > bash: syntax error near unexpected `newline '
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $
>>> /usr/local/met-8.1.1/bin/grid_stat
>>> > > > > > > wrfout_19_2.nc
>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such file
or
>>> > directory
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
>>> > > > > > > .nc
>>> > > > > > > bash:
>>> > > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
>>> > > > > > > Is a directory
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $
>>> /usr/local/met-8.1.1/bin/grid_stat
>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>>> > > > > > > bash: syntax error near unexpected `newline '
>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>> 8.1 /
>>> > > > > met-8.1.1
>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
GridStatConfig_pw
>>> > -outdir
>>> > > > out
>>> > > > > > -v 3
>>> > > > > > > ERAI_pw.nc: command not found
>>> > > > > > >
>>> > > > > > > Can you please, send me your execution script.
>>> > > > > > > I may not be performing them properly. Please help me.
I'm
>>> lost.
>>> > > > > > >
>>> > > > > > > Best regards
>>> > > > > > > Dores
>>> > > > > > >
>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
>>> > > > ngaminidas at gmail.com>
>>> > > > > a
>>> > > > > > > écrit :
>>> > > > > > >
>>> > > > > > >> Thank you very much.
>>> > > > > > >>
>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via
RT <
>>> > > > > > >> met_help at ucar.edu> a écrit :
>>> > > > > > >>
>>> > > > > > >>> Dores,
>>> > > > > > >>>
>>> > > > > > >>> OK, great. Thanks for sending some sample data.
>>> > > > > > >>>
>>> > > > > > >>> When getting started with new datasets in MET, I
always
>>> start
>>> > by
>>> > > > > > running
>>> > > > > > >>> the plot_data_plane tool to make sure MET can read
the
>>> data and
>>> > > > place
>>> > > > > > it
>>> > > > > > >>> on
>>> > > > > > >>> the earth correctly.
>>> > > > > > >>>
>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format, and
MET
>>> can
>>> > > easily
>>> > > > > > read
>>> > > > > > >>> that:
>>> > > > > > >>>
>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**ERAI_pw.nc
>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
>>> > level="(2018071900,*,*)";'
>>> > > -v
>>> > > > > 4*
>>> > > > > > >>>
>>> > > > > > >>> Next for the WRF output. When I try passing it to
MET
>>> > directly,
>>> > > I
>>> > > > > get
>>> > > > > > an
>>> > > > > > >>> error message:
>>> > > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc"
not a
>>> valid
>>> > > data
>>> > > > > > file
>>> > > > > > >>>
>>> > > > > > >>> However, since this is on a lat/lon grid, we can
just tell
>>> MET
>>> > to
>>> > > > > > >>> interpret
>>> > > > > > >>> it as being CF-compliant NetCDF, like this
"file_type =
>>> > > > > NETCDF_NCCF;":
>>> > > > > > >>>
>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**wrfout_19_2.nc
>>> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
>>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
>>> > > > > > level="(2018071900,*,*)";
>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
>>> > > > > > >>>
>>> > > > > > >>> PNG versions of the resulting images are attached.
>>> > > > > > >>>
>>> > > > > > >>> Looking at these images, we see that MET is able to
read
>>> data
>>> > > from
>>> > > > > > them.
>>> > > > > > >>> And I'll leave it to you to confirm that MET is
placing
>>> them in
>>> > > the
>>> > > > > > right
>>> > > > > > >>> spot on earth, but I assume it is.
>>> > > > > > >>>
>>> > > > > > >>> Next, let's run Grid-Stat to compute statistics on
them.
>>> I've
>>> > > set
>>> > > > up
>>> > > > > > the
>>> > > > > > >>> attached Grid-Stat config file to...
>>> > > > > > >>>
>>> > > > > > >>> (1) Regrid the ERAI data to the model domain using
the
>>> budget
>>> > > > > > >>> interpolation
>>> > > > > > >>> method
>>> > > > > > >>> regrid = {
>>> > > > > > >>> to_grid = FCST;
>>> > > > > > >>> method = BUDGET;
>>> > > > > > >>> width = 2;
>>> > > > > > >>> vld_thresh = 0.5;
>>> > > > > > >>> shape = SQUARE;
>>> > > > > > >>> }
>>> > > > > > >>>
>>> > > > > > >>> (2) Transfer the config options from the
plot_data_plane
>>> > command
>>> > > > line
>>> > > > > > to
>>> > > > > > >>> the "fcst" and "obs" dictionaries. For convenience,
I
>>> defined
>>> > > the
>>> > > > > time
>>> > > > > > >>> as
>>> > > > > > >>> an environment variable named $VXTIME:
>>> > > > > > >>> fcst = {
>>> > > > > > >>> file_type = NETCDF_NCCF;
>>> > > > > > >>> field = [ { name = "pw"; level= [
>>> "(${VXTIME},*,*)" ];
>>> > }
>>> > > ];
>>> > > > > > >>> }
>>> > > > > > >>> obs = {
>>> > > > > > >>> field = [ { name = "tcw"; level= [
>>> "(${VXTIME},*,*)" ];
>>> > }
>>> > > ];
>>> > > > > > >>> }
>>> > > > > > >>>
>>> > > > > > >>> (3) Compute stats over the FULL model domain.
>>> > > > > > >>> mask = {
>>> > > > > > >>> grid = [ "FULL" ];
>>> > > > > > >>> poly = [];
>>> > > > > > >>> }
>>> > > > > > >>>
>>> > > > > > >>> (4) And just compute continuous stats.
>>> > > > > > >>> output_flag = {
>>> > > > > > >>> ...
>>> > > > > > >>> cnt = BOTH;
>>> > > > > > >>> ...
>>> > > > > > >>> }
>>> > > > > > >>>
>>> > > > > > >>> Finally, run Grid-Stat on the command line like
this:
>>> > > > > > >>>
>>> > > > > > >>> *mkdir -p out*
>>> > > > > > >>> *setenv VXTIME "2018071900"*
>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
>>> > > > > > >>> http://wrfout_19_2.nc>
>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>>> > > > > > >>>
>>> > > > > > >>> And that run successfully and creates output files:
>>> > > > > > >>> DEBUG 1: Output file:
>>> > out/grid_stat_000000L_20180719_000000V.stat
>>> > > > > > >>> DEBUG 1: Output file:
>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
>>> > > > > > >>> DEBUG 1: Output file:
>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
>>> > > > > > >>>
>>> > > > > > >>> Looking in the "_cnt.txt" file for example, the RMSE
value
>>> =
>>> > > > 3.39378.
>>> > > > > > >>>
>>> > > > > > >>> Hope this helps get you up and running with MET.
>>> > > > > > >>>
>>> > > > > > >>> Thanks,
>>> > > > > > >>> John Halley Gotway
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini
via RT <
>>> > > > > > >>> met_help at ucar.edu>
>>> > > > > > >>> wrote:
>>> > > > > > >>>
>>> > > > > > >>> >
>>> > > > > > >>> > <URL:
>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>>> > > >
>>> > > > > > >>> >
>>> > > > > > >>> > Hello John,
>>> > > > > > >>> > I have already sent my data to my ftp site. In
these
>>> files, I
>>> > > > want
>>> > > > > to
>>> > > > > > >>> > extract the pw. There is another missing ERAI
file. That
>>> > one, I
>>> > > > > have
>>> > > > > > >>> > trouble sending it. It contains the relative
humidity and
>>> > wind
>>> > > > > data.
>>> > > > > > >>> > Please,
>>> > > > > > >>> > just tell me how to do it because I can not send
this
>>> file.
>>> > > There
>>> > > > > are
>>> > > > > > >>> two
>>> > > > > > >>> > wrfout files because my forecasts are made over 24
hours
>>> or
>>> > > more.
>>> > > > > My
>>> > > > > > >>> raw
>>> > > > > > >>> > wrf outputs are in "HDF", and I can not send them.
That's
>>> > why I
>>> > > > > sent
>>> > > > > > >>> those
>>> > > > > > >>> > in NetCDF. If I continue to wait for the other
files to
>>> be
>>> > > sent,
>>> > > > > the
>>> > > > > > >>> time
>>> > > > > > >>> > to deposit my memory will expire.
>>> > > > > > >>> > Thank you very much for helping me.
>>> > > > > > >>> > Yours sincerely.
>>> > > > > > >>> > Dores
>>> > > > > > >>> >
>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway
via RT <
>>> > > > > > >>> met_help at ucar.edu
>>> > > > > > >>> > >
>>> > > > > > >>> > a écrit :
>>> > > > > > >>> >
>>> > > > > > >>> > > Dores,
>>> > > > > > >>> > >
>>> > > > > > >>> > > Were you able to post any data to the ftp site?
You
>>> could
>>> > > try
>>> > > > > > >>> sending
>>> > > > > > >>> > via
>>> > > > > > >>> > > email but I worry that the data files will be
too
>>> large to
>>> > > > > transfer
>>> > > > > > >>> that
>>> > > > > > >>> > > way.
>>> > > > > > >>> > >
>>> > > > > > >>> > > Stephen is right... you need to put the files
one by
>>> way.
>>> > By
>>> > > > way
>>> > > > > > of
>>> > > > > > >>> > > example, here are commands to create a file
named
>>> > > > hello_world.txt
>>> > > > > > and
>>> > > > > > >>> > post
>>> > > > > > >>> > > it to our ftp site.
>>> > > > > > >>> > >
>>> > > > > > >>> > > cd /home/johnhg
>>> > > > > > >>> > > echo "hello world" > hello_world.txt
>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
>>> > > > > > >>> > > username = anonymous
>>> > > > > > >>> > > password = "my email address"
>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
>>> > > > > > >>> > > put hello_world.txt
>>> > > > > > >>> > > bye
>>> > > > > > >>> > >
>>> > > > > > >>> > > And then checking the ftp via a web browser:
>>> > > > > > >>> > >
>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>>> > > > > > >>> > >
>>> > > > > > >>> > > I see that file now exists. Just be sure that
you're
>>> in
>>> > the
>>> > > > > > >>> directory
>>> > > > > > >>> > > which contains the files you want to send before
>>> running
>>> > ftp.
>>> > > > > > >>> > >
>>> > > > > > >>> > > Thanks,
>>> > > > > > >>> > > John
>>> > > > > > >>> > >
>>> > > > > > >>> > >
>>> > > > > > >>> > >
>>> > > > > > >>> > >
>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy
via RT <
>>> > > > > > >>> met_help at ucar.edu>
>>> > > > > > >>> > > wrote:
>>> > > > > > >>> > >
>>> > > > > > >>> > > >
>>> > > > > > >>> > > > <URL:
>>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>>> > > > > >
>>> > > > > > >>> > > >
>>> > > > > > >>> > > >
>>> > > > > > >>> > > > John,
>>> > > > > > >>> > > >
>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from Dores
into
>>> this
>>> > > > ticket
>>> > > > > > >>> with
>>> > > > > > >>> > > > explanation of what i think the problem is
>>> (specifying
>>> > full
>>> > > > > paths
>>> > > > > > >>> on
>>> > > > > > >>> > the
>>> > > > > > >>> > > > files w/o telling the FTP server to rename to
>>> non-pathed
>>> > > > > > filename.
>>> > > > > > >>> > > >
>>> > > > > > >>> > > > If you want, it might be helpful to add
something
>>> about
>>> > > that
>>> > > > to
>>> > > > > > >>> your
>>> > > > > > >>> > Met
>>> > > > > > >>> > > > Help FTP upload page.
>>> > > > > > >>> > > >
>>> > > > > > >>> > > > thanks,
>>> > > > > > >>> > > > --stephen
>>> > > > > > >>> > > >
>>> > > > > > >>> > >
>>> > > > > > >>> > >
>>> > > > > > >>> >
>>> > > > > > >>> >
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > >
>>> > > > > >
>>> > > > >
>>> > > > >
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Wed Oct 30 14:00:54 2019
Hello John,
Please, help me to run grid_stat for my another wrfout files. I don't
know
what to change in the files I used to run the first wrfout.
Cordially
Dorès
Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> I use the same config file and the same test_grid_stat.sh file.
>
>
> Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
>> Hello John,
>> Another problem that I have now is I am not able to run another
wrfout
>> with the same command. What should I change? I have several wrfout
files
>> that I want to fill the CTC.
>> Here the error that I have.
>>
>> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
>> DEBUG 1: Default Config File:
>>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
>> DEBUG 1: User Config File: GridStatConfig_pw
>> ERROR :
>> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
>> file "wrfout_20_2.nc"
>> ERROR :
>> ERROR :
>> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
>> file "wrfout_20_2.nc"
>> ERROR :
>> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>>
>> Best regards
>> Dorès
>>
>> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini
<ngaminidas at gmail.com> a
>> écrit :
>>
>>> Hello John,
>>> FCST_VALID_BEG = 20180719_000000
>>> FCST_VALID_END = 20180719_000000
>>> It is the same for OBS.
>>> I want to have
>>> FCST_VALID_BEG = 20180719_000000
>>> FCST_VALID_END = 20180726_000000
>>>
>>> My another problem is how to cite MET.
>>>
>>> Cordially
>>> Dorès
>>>
>>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
>>> met_help at ucar.edu> a écrit :
>>>
>>>> Dores,
>>>>
>>>> Each time Grid-Stat or Point-Stat is run, the timing information
is
>>>> extracted from the metadata of the data files. And that timing
>>>> information
>>>> is written to the header columns of the output files. There is,
in
>>>> general, no easy way of modifying the timing information of the
data
>>>> you're
>>>> processing.
>>>>
>>>> And I don't really understand why you would want to change that
timing
>>>> info.
>>>>
>>>> We actually do have a development issue defined that would enable
this
>>>> in
>>>> the future, but that work has not been done yet.
>>>> https://github.com/NCAR/MET/issues/1020
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
>>>> met_help at ucar.edu>
>>>> wrote:
>>>>
>>>> >
>>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>>> >
>>>> > Hello John,
>>>> > Thanks a lot for your help.
>>>> > I can already see something interesting. But, I have another
problem.
>>>> I
>>>> > would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
>>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find them
and
>>>> how to
>>>> > take them into account when running. I predict 24 hours to 144
hours
>>>> (0 to
>>>> > 6 days). Please help me.
>>>> >
>>>> > Thank you in advance.
>>>> >
>>>> > Dorès
>>>> >
>>>> >
>>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
>>>> met_help at ucar.edu
>>>> > >
>>>> > a écrit :
>>>> >
>>>> > > Dores,
>>>> > >
>>>> > > It looks like you're running Grid-Stat in this way:
>>>> > >
>>>> > >
>>>> > >
>>>> > > *dores at dores
>>>> > >
>>>> >
>>>>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
>>>> > > grid_statwrfout_19_2.nc
>>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
>>>> > >
>>>> > > And Grid-Stat is printing out the usage statement to indicate
that
>>>> you
>>>> > have
>>>> > > provided the correct input arguments.
>>>> > >
>>>> > > Grid-Stat has 3 required arguments on the command line:
>>>> > > (1) the path to the forecast file
>>>> > > (2) the path to the observation file
>>>> > > (3) the path the grid_stat configuration file
>>>> > >
>>>> > > You have provided the first 2 but not the 3rd. Please try
running
>>>> > > grid_stat will all 3 required arguments:
>>>> > >
>>>> > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>>>> > >
>>>> > > And there is no requirement for the directory structure to be
>>>> used. You
>>>> > > can either provide the full absolute path the the input
files, or
>>>> the
>>>> > > relative path. If these files are all in your current
working
>>>> directory,
>>>> > > you just list the filenames.
>>>> > >
>>>> > > John
>>>> > >
>>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
>>>> > > met_help at ucar.edu>
>>>> > > wrote:
>>>> > >
>>>> > > >
>>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>>>> > > >
>>>> > > > Hello John,
>>>> > > > Excuse me for not understanding. I would like to
interpolate on
>>>> the
>>>> > grid
>>>> > > > points in order to also have the "RMSE" and the "Pearson
>>>> correlation
>>>> > > > coefficient" in addition to the contingency table. For this
fact,
>>>> I put
>>>> > > > ctc, cts and cnt at BOTH.
>>>> > > > But, my problem remains the same: how do I execute my grid-
stat
>>>> and in
>>>> > > what
>>>> > > > directory. In fact, I would like to know which files to
use,
>>>> where to
>>>> > put
>>>> > > > these files and how to handle them. For the moment, I have
>>>> created a
>>>> > > > symbolic link between the directory containing my data and
the
>>>> > directory
>>>> > > > pcp-combines. I put my GridStatConfig_pw in the config
directory
>>>> and
>>>> > also
>>>> > > > in bin. I modify the test_grid_stat.sh and I left it in the
>>>> examples
>>>> > > > directory. When I run in bin following the command you sent
me, I
>>>> have
>>>> > > > these errors.
>>>> > > >
>>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>>>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>>>> > > > wrfout_19_2.nc ERAI_pw.nc
>>>> > > >
>>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
>>>> > > >
>>>> > > > Usage: grid_stat
>>>> > > > fcst_file
>>>> > > > obs_file
>>>> > > > config_file
>>>> > > > [-outdir path]
>>>> > > > [-log file]
>>>> > > > [-v level]
>>>> > > > [-compress level]
>>>> > > >
>>>> > > > where "fcst_file" is a gridded forecast file
containing
>>>> the
>>>> > > > field(s) to be verified (required).
>>>> > > > "obs_file" is a gridded observation file
>>>> containing the
>>>> > > > verifying field(s) (required).
>>>> > > > "config_file" is a GridStatConfig file
containing
>>>> the
>>>> > > > desired configuration settings (required).
>>>> > > > "-outdir path" overrides the default output
>>>> directory
>>>> > (.)
>>>> > > > (optional).
>>>> > > > "-log file" outputs log messages to the
specified
>>>> file
>>>> > > > (optional).
>>>> > > > "-v level" overrides the default level of
logging
>>>> (2)
>>>> > > > (optional).
>>>> > > > "-compress level" overrides the compression
level
>>>> of
>>>> > > NetCDF
>>>> > > > variable (0) (optional).
>>>> > > >
>>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>>>> > > >
>>>> > > > Here is my test_grid_stat.sh file
>>>> > > > Cordially Dores.
>>>> > > >
>>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
>>>> > > met_help at ucar.edu
>>>> > > > >
>>>> > > > a écrit :
>>>> > > >
>>>> > > > > Das,
>>>> > > > >
>>>> > > > > Good news. It is very easy to configure Grid-Stat to
compute
>>>> 2x2
>>>> > > > > contingency tables. We just need to edit the config file
to...
>>>> > > > > (1) Define the categorical thresholds that should be
applied
>>>> > > (cat_thresh
>>>> > > > =
>>>> > > > > [ >20, >30, >40, >50 ];)
>>>> > > > > (2) Turn on the CTC and CTS output line types (ctc =
BOTH; cts =
>>>> > BOTH;)
>>>> > > > >
>>>> > > > > You can of course change those thresholds however you'd
like.
>>>> Here
>>>> > are
>>>> > > > > more commands to illustrate this:
>>>> > > > >
>>>> > > > > # Pull sample data from ftp site
>>>> > > > > wget
>>>> > > > >
>>>> > > > >
>>>> > > >
>>>> > >
>>>> >
>>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>>>> > > > > wget
>>>> > > > >
>>>> > > > >
>>>> > > >
>>>> > >
>>>> >
>>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>>>> > > > > wget
>>>> > >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
>>>> > > > > GridStatConfig_pw
>>>> > > > >
>>>> > > > > # Create output directory and run Grid-Stat
>>>> > > > > mkdir -p out
>>>> > > > > export VXTIME=2018071900
>>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
ERAI_pw.nc
>>>> > > > > GridStatConfig_pw -outdir out -v 3
>>>> > > > >
>>>> > > > > Then take a look at the output files:
>>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
>>>> > > > >
>>>> > > > > The _ctc.txt file contains the counts for the 2x2
contingency
>>>> table
>>>> > for
>>>> > > > > each of the 4 thresholds we specified.
>>>> > > > >
>>>> > > > > Hope this helps get you going.
>>>> > > > >
>>>> > > > > Thanks,
>>>> > > > > John
>>>> > > > >
>>>> > > > >
>>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via RT
<
>>>> > > > > met_help at ucar.edu>
>>>> > > > > wrote:
>>>> > > > >
>>>> > > > > > hello John,
>>>> > > > > > Excuse me, I beg you, to bother you.
>>>> > > > > > I created a symbolic link between my data and the pcp-
combines
>>>> > > > > directory. I
>>>> > > > > > used test_grid_stat.sh which I modified. I compile it,
it did
>>>> not
>>>> > > > produce
>>>> > > > > > anything. I tried the command lines you sent me and I
get the
>>>> > errors
>>>> > > I
>>>> > > > > sent
>>>> > > > > > you. I really have no idea to get me out. I beg you,
please,
>>>> to
>>>> > help
>>>> > > > me.
>>>> > > > > > Attaching my test_grid_stat.sh file.
>>>> > > > > >
>>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
>>>> > > ngaminidas at gmail.com>
>>>> > > > a
>>>> > > > > > écrit :
>>>> > > > > >
>>>> > > > > > > Hello John,
>>>> > > > > > > I am still unable to pull out my contingency table
(CTC)
>>>> with
>>>> > MET.
>>>> > > I
>>>> > > > > have
>>>> > > > > > > read your email, the user guide, the online tutorial,
but I
>>>> still
>>>> > > do
>>>> > > > > not
>>>> > > > > > > understand how I should run.
>>>> > > > > > > I see the lines of code:
>>>> > > > > > >
>>>> > > > > > > Use: grid_stat
>>>> > > > > > > fcst_file
>>>> > > > > > > obs_file
>>>> > > > > > > config_file
>>>> > > > > > > [-outdir path]
>>>> > > > > > > [-log file]
>>>> > > > > > > [-v level]
>>>> > > > > > > [-compress level]
>>>> > > > > > >
>>>> > > > > > > And, I do not know where I have to write them.
>>>> > > > > > > I see your run command lines:
>>>> > > > > > >
>>>> > > > > > > * mkdir -p out *
>>>> > > > > > > * setenv VXTIME "2018071900" *
>>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
>>>> wrfout_19_2.nc <
>>>> > > > > > > http://wrfout_19_2.nc>
>>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
>>>> > > > > > >
>>>> > > > > > > "setenv" did not give, I had to install "getenv".
>>>> > > > > > >
>>>> > > > > > > Command 'setenv' not found, did you mean:
>>>> > > > > > >
>>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
>>>> > > > > > >
>>>> > > > > > > See 'snap info <snapname>' for additional versions.
>>>> > > > > > >
>>>> > > > > > > But when I try to run, I have errors:
>>>> > > > > > >
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
"2018071900"
>>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
<project_name>]
>>>> [-s
>>>> > > > > > > <source_dir>]
>>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
2018071900
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $
>>>> /usr/local/met-8.1.1/bin/grid_stat
>>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>>>> > > > > > > bash: syntax error near unexpected `newline '
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $
>>>> /usr/local/met-8.1.1/bin/grid_stat
>>>> > > > > > > wrfout_19_2.nc
>>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such
file or
>>>> > directory
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $
>>>> > > > > > >
>>>> > > > > >
>>>> > > > >
>>>> > > >
>>>> > >
>>>> >
>>>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
>>>> > > > > > > .nc
>>>> > > > > > > bash:
>>>> > > > > > >
>>>> > > > > >
>>>> > > > >
>>>> > > >
>>>> > >
>>>> >
>>>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
>>>> > > > > > > Is a directory
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $
>>>> /usr/local/met-8.1.1/bin/grid_stat
>>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>>>> > > > > > > bash: syntax error near unexpected `newline '
>>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
>>>> 8.1 /
>>>> > > > > met-8.1.1
>>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
GridStatConfig_pw
>>>> > -outdir
>>>> > > > out
>>>> > > > > > -v 3
>>>> > > > > > > ERAI_pw.nc: command not found
>>>> > > > > > >
>>>> > > > > > > Can you please, send me your execution script.
>>>> > > > > > > I may not be performing them properly. Please help
me. I'm
>>>> lost.
>>>> > > > > > >
>>>> > > > > > > Best regards
>>>> > > > > > > Dores
>>>> > > > > > >
>>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
>>>> > > > ngaminidas at gmail.com>
>>>> > > > > a
>>>> > > > > > > écrit :
>>>> > > > > > >
>>>> > > > > > >> Thank you very much.
>>>> > > > > > >>
>>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway via
RT <
>>>> > > > > > >> met_help at ucar.edu> a écrit :
>>>> > > > > > >>
>>>> > > > > > >>> Dores,
>>>> > > > > > >>>
>>>> > > > > > >>> OK, great. Thanks for sending some sample data.
>>>> > > > > > >>>
>>>> > > > > > >>> When getting started with new datasets in MET, I
always
>>>> start
>>>> > by
>>>> > > > > > running
>>>> > > > > > >>> the plot_data_plane tool to make sure MET can read
the
>>>> data and
>>>> > > > place
>>>> > > > > > it
>>>> > > > > > >>> on
>>>> > > > > > >>> the earth correctly.
>>>> > > > > > >>>
>>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format,
and MET
>>>> can
>>>> > > easily
>>>> > > > > > read
>>>> > > > > > >>> that:
>>>> > > > > > >>>
>>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**ERAI_pw.nc
>>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
>>>> > level="(2018071900,*,*)";'
>>>> > > -v
>>>> > > > > 4*
>>>> > > > > > >>>
>>>> > > > > > >>> Next for the WRF output. When I try passing it to
MET
>>>> > directly,
>>>> > > I
>>>> > > > > get
>>>> > > > > > an
>>>> > > > > > >>> error message:
>>>> > > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc"
not a
>>>> valid
>>>> > > data
>>>> > > > > > file
>>>> > > > > > >>>
>>>> > > > > > >>> However, since this is on a lat/lon grid, we can
just
>>>> tell MET
>>>> > to
>>>> > > > > > >>> interpret
>>>> > > > > > >>> it as being CF-compliant NetCDF, like this
"file_type =
>>>> > > > > NETCDF_NCCF;":
>>>> > > > > > >>>
>>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **
>>>> wrfout_19_2.nc
>>>> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
>>>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
>>>> > > > > > level="(2018071900,*,*)";
>>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
>>>> > > > > > >>>
>>>> > > > > > >>> PNG versions of the resulting images are attached.
>>>> > > > > > >>>
>>>> > > > > > >>> Looking at these images, we see that MET is able to
read
>>>> data
>>>> > > from
>>>> > > > > > them.
>>>> > > > > > >>> And I'll leave it to you to confirm that MET is
placing
>>>> them in
>>>> > > the
>>>> > > > > > right
>>>> > > > > > >>> spot on earth, but I assume it is.
>>>> > > > > > >>>
>>>> > > > > > >>> Next, let's run Grid-Stat to compute statistics on
them.
>>>> I've
>>>> > > set
>>>> > > > up
>>>> > > > > > the
>>>> > > > > > >>> attached Grid-Stat config file to...
>>>> > > > > > >>>
>>>> > > > > > >>> (1) Regrid the ERAI data to the model domain using
the
>>>> budget
>>>> > > > > > >>> interpolation
>>>> > > > > > >>> method
>>>> > > > > > >>> regrid = {
>>>> > > > > > >>> to_grid = FCST;
>>>> > > > > > >>> method = BUDGET;
>>>> > > > > > >>> width = 2;
>>>> > > > > > >>> vld_thresh = 0.5;
>>>> > > > > > >>> shape = SQUARE;
>>>> > > > > > >>> }
>>>> > > > > > >>>
>>>> > > > > > >>> (2) Transfer the config options from the
plot_data_plane
>>>> > command
>>>> > > > line
>>>> > > > > > to
>>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
convenience, I
>>>> defined
>>>> > > the
>>>> > > > > time
>>>> > > > > > >>> as
>>>> > > > > > >>> an environment variable named $VXTIME:
>>>> > > > > > >>> fcst = {
>>>> > > > > > >>> file_type = NETCDF_NCCF;
>>>> > > > > > >>> field = [ { name = "pw"; level= [
>>>> "(${VXTIME},*,*)" ];
>>>> > }
>>>> > > ];
>>>> > > > > > >>> }
>>>> > > > > > >>> obs = {
>>>> > > > > > >>> field = [ { name = "tcw"; level= [
>>>> "(${VXTIME},*,*)" ];
>>>> > }
>>>> > > ];
>>>> > > > > > >>> }
>>>> > > > > > >>>
>>>> > > > > > >>> (3) Compute stats over the FULL model domain.
>>>> > > > > > >>> mask = {
>>>> > > > > > >>> grid = [ "FULL" ];
>>>> > > > > > >>> poly = [];
>>>> > > > > > >>> }
>>>> > > > > > >>>
>>>> > > > > > >>> (4) And just compute continuous stats.
>>>> > > > > > >>> output_flag = {
>>>> > > > > > >>> ...
>>>> > > > > > >>> cnt = BOTH;
>>>> > > > > > >>> ...
>>>> > > > > > >>> }
>>>> > > > > > >>>
>>>> > > > > > >>> Finally, run Grid-Stat on the command line like
this:
>>>> > > > > > >>>
>>>> > > > > > >>> *mkdir -p out*
>>>> > > > > > >>> *setenv VXTIME "2018071900"*
>>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<
>>>> > > > > > >>> http://wrfout_19_2.nc>
>>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>>>> > > > > > >>>
>>>> > > > > > >>> And that run successfully and creates output files:
>>>> > > > > > >>> DEBUG 1: Output file:
>>>> > out/grid_stat_000000L_20180719_000000V.stat
>>>> > > > > > >>> DEBUG 1: Output file:
>>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
>>>> > > > > > >>> DEBUG 1: Output file:
>>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
>>>> > > > > > >>>
>>>> > > > > > >>> Looking in the "_cnt.txt" file for example, the
RMSE
>>>> value =
>>>> > > > 3.39378.
>>>> > > > > > >>>
>>>> > > > > > >>> Hope this helps get you up and running with MET.
>>>> > > > > > >>>
>>>> > > > > > >>> Thanks,
>>>> > > > > > >>> John Halley Gotway
>>>> > > > > > >>>
>>>> > > > > > >>>
>>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores Ngamini
via RT
>>>> <
>>>> > > > > > >>> met_help at ucar.edu>
>>>> > > > > > >>> wrote:
>>>> > > > > > >>>
>>>> > > > > > >>> >
>>>> > > > > > >>> > <URL:
>>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>>>> > > >
>>>> > > > > > >>> >
>>>> > > > > > >>> > Hello John,
>>>> > > > > > >>> > I have already sent my data to my ftp site. In
these
>>>> files, I
>>>> > > > want
>>>> > > > > to
>>>> > > > > > >>> > extract the pw. There is another missing ERAI
file. That
>>>> > one, I
>>>> > > > > have
>>>> > > > > > >>> > trouble sending it. It contains the relative
humidity
>>>> and
>>>> > wind
>>>> > > > > data.
>>>> > > > > > >>> > Please,
>>>> > > > > > >>> > just tell me how to do it because I can not send
this
>>>> file.
>>>> > > There
>>>> > > > > are
>>>> > > > > > >>> two
>>>> > > > > > >>> > wrfout files because my forecasts are made over
24
>>>> hours or
>>>> > > more.
>>>> > > > > My
>>>> > > > > > >>> raw
>>>> > > > > > >>> > wrf outputs are in "HDF", and I can not send
them.
>>>> That's
>>>> > why I
>>>> > > > > sent
>>>> > > > > > >>> those
>>>> > > > > > >>> > in NetCDF. If I continue to wait for the other
files to
>>>> be
>>>> > > sent,
>>>> > > > > the
>>>> > > > > > >>> time
>>>> > > > > > >>> > to deposit my memory will expire.
>>>> > > > > > >>> > Thank you very much for helping me.
>>>> > > > > > >>> > Yours sincerely.
>>>> > > > > > >>> > Dores
>>>> > > > > > >>> >
>>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley Gotway
via RT
>>>> <
>>>> > > > > > >>> met_help at ucar.edu
>>>> > > > > > >>> > >
>>>> > > > > > >>> > a écrit :
>>>> > > > > > >>> >
>>>> > > > > > >>> > > Dores,
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > Were you able to post any data to the ftp site?
You
>>>> could
>>>> > > try
>>>> > > > > > >>> sending
>>>> > > > > > >>> > via
>>>> > > > > > >>> > > email but I worry that the data files will be
too
>>>> large to
>>>> > > > > transfer
>>>> > > > > > >>> that
>>>> > > > > > >>> > > way.
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > Stephen is right... you need to put the files
one by
>>>> way.
>>>> > By
>>>> > > > way
>>>> > > > > > of
>>>> > > > > > >>> > > example, here are commands to create a file
named
>>>> > > > hello_world.txt
>>>> > > > > > and
>>>> > > > > > >>> > post
>>>> > > > > > >>> > > it to our ftp site.
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > cd /home/johnhg
>>>> > > > > > >>> > > echo "hello world" > hello_world.txt
>>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
>>>> > > > > > >>> > > username = anonymous
>>>> > > > > > >>> > > password = "my email address"
>>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
>>>> > > > > > >>> > > put hello_world.txt
>>>> > > > > > >>> > > bye
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > And then checking the ftp via a web browser:
>>>> > > > > > >>> > >
>>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > I see that file now exists. Just be sure that
you're
>>>> in
>>>> > the
>>>> > > > > > >>> directory
>>>> > > > > > >>> > > which contains the files you want to send
before
>>>> running
>>>> > ftp.
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > Thanks,
>>>> > > > > > >>> > > John
>>>> > > > > > >>> > >
>>>> > > > > > >>> > >
>>>> > > > > > >>> > >
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy
via RT <
>>>> > > > > > >>> met_help at ucar.edu>
>>>> > > > > > >>> > > wrote:
>>>> > > > > > >>> > >
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > > <URL:
>>>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>>>> > > > > >
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > > John,
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from
Dores into
>>>> this
>>>> > > > ticket
>>>> > > > > > >>> with
>>>> > > > > > >>> > > > explanation of what i think the problem is
>>>> (specifying
>>>> > full
>>>> > > > > paths
>>>> > > > > > >>> on
>>>> > > > > > >>> > the
>>>> > > > > > >>> > > > files w/o telling the FTP server to rename to
>>>> non-pathed
>>>> > > > > > filename.
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > > If you want, it might be helpful to add
something
>>>> about
>>>> > > that
>>>> > > > to
>>>> > > > > > >>> your
>>>> > > > > > >>> > Met
>>>> > > > > > >>> > > > Help FTP upload page.
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > > > thanks,
>>>> > > > > > >>> > > > --stephen
>>>> > > > > > >>> > > >
>>>> > > > > > >>> > >
>>>> > > > > > >>> > >
>>>> > > > > > >>> >
>>>> > > > > > >>> >
>>>> > > > > > >>>
>>>> > > > > > >>>
>>>> > > > > >
>>>> > > > > >
>>>> > > > >
>>>> > > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> > >
>>>> >
>>>> >
>>>>
>>>>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Thu Oct 31 15:19:42 2019
Dores,
In the GridStatConfig_pw file, we requested data from the
forecast/observation files as shown below. Note that we used an
environment variable named "VXTIME" to define the timestamp of the
data we
want to retrieve:
fcst = {
file_type = NETCDF_NCCF;
field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
}
obs = {
field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
}
You indicated that the script worked fine for the WRF file named "
wrfout_19_2.nc" but errors out when processing "wrfout_20_2.nc".
Presumably the timestamps differ between these two files. I suggest
that
you:
(1) Make sure that wrfout_20_2.nc exists and is a valid NetCDF file
(run
"ncdump -h wrfout_20_2.nc" and make sure it prints sensible results).
(2) Set the VXTIME environment variable to a timestamp which actually
exists in that file.
(3) Run plot_data_plane to confirm that MET processes this data fine.
For
example:
*setenv VXTIME 20180725*
*plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
<http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)"; file_type =
NETCDF_NCCF;' -v 4*
Thanks,
John
On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John,
> Please, help me to run grid_stat for my another wrfout files. I
don't know
> what to change in the files I used to run the first wrfout.
>
> Cordially
> Dorès
>
> Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
> > Hello John,
> > I use the same config file and the same test_grid_stat.sh file.
> >
> >
> > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> >> Hello John,
> >> Another problem that I have now is I am not able to run another
wrfout
> >> with the same command. What should I change? I have several
wrfout files
> >> that I want to fill the CTC.
> >> Here the error that I have.
> >>
> >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> >> DEBUG 1: Default Config File:
> >>
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> >> DEBUG 1: User Config File: GridStatConfig_pw
> >> ERROR :
> >> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> >> file "wrfout_20_2.nc"
> >> ERROR :
> >> ERROR :
> >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> >> file "wrfout_20_2.nc"
> >> ERROR :
> >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >>
> >> Best regards
> >> Dorès
> >>
> >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> >> écrit :
> >>
> >>> Hello John,
> >>> FCST_VALID_BEG = 20180719_000000
> >>> FCST_VALID_END = 20180719_000000
> >>> It is the same for OBS.
> >>> I want to have
> >>> FCST_VALID_BEG = 20180719_000000
> >>> FCST_VALID_END = 20180726_000000
> >>>
> >>> My another problem is how to cite MET.
> >>>
> >>> Cordially
> >>> Dorès
> >>>
> >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
> >>> met_help at ucar.edu> a écrit :
> >>>
> >>>> Dores,
> >>>>
> >>>> Each time Grid-Stat or Point-Stat is run, the timing
information is
> >>>> extracted from the metadata of the data files. And that timing
> >>>> information
> >>>> is written to the header columns of the output files. There
is, in
> >>>> general, no easy way of modifying the timing information of the
data
> >>>> you're
> >>>> processing.
> >>>>
> >>>> And I don't really understand why you would want to change that
timing
> >>>> info.
> >>>>
> >>>> We actually do have a development issue defined that would
enable this
> >>>> in
> >>>> the future, but that work has not been done yet.
> >>>> https://github.com/NCAR/MET/issues/1020
> >>>>
> >>>> Thanks,
> >>>> John
> >>>>
> >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
> >>>> met_help at ucar.edu>
> >>>> wrote:
> >>>>
> >>>> >
> >>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> >>>> >
> >>>> > Hello John,
> >>>> > Thanks a lot for your help.
> >>>> > I can already see something interesting. But, I have another
> problem.
> >>>> I
> >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG FCST_VALID_END
> OBS_LEAD
> >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find
them and
> >>>> how to
> >>>> > take them into account when running. I predict 24 hours to
144 hours
> >>>> (0 to
> >>>> > 6 days). Please help me.
> >>>> >
> >>>> > Thank you in advance.
> >>>> >
> >>>> > Dorès
> >>>> >
> >>>> >
> >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
> >>>> met_help at ucar.edu
> >>>> > >
> >>>> > a écrit :
> >>>> >
> >>>> > > Dores,
> >>>> > >
> >>>> > > It looks like you're running Grid-Stat in this way:
> >>>> > >
> >>>> > >
> >>>> > >
> >>>> > > *dores at dores
> >>>> > >
> >>>> >
> >>>>
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> >>>> > > grid_statwrfout_19_2.nc
> >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> >>>> > >
> >>>> > > And Grid-Stat is printing out the usage statement to
indicate that
> >>>> you
> >>>> > have
> >>>> > > provided the correct input arguments.
> >>>> > >
> >>>> > > Grid-Stat has 3 required arguments on the command line:
> >>>> > > (1) the path to the forecast file
> >>>> > > (2) the path to the observation file
> >>>> > > (3) the path the grid_stat configuration file
> >>>> > >
> >>>> > > You have provided the first 2 but not the 3rd. Please try
running
> >>>> > > grid_stat will all 3 required arguments:
> >>>> > >
> >>>> > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> >>>> > >
> >>>> > > And there is no requirement for the directory structure to
be
> >>>> used. You
> >>>> > > can either provide the full absolute path the the input
files, or
> >>>> the
> >>>> > > relative path. If these files are all in your current
working
> >>>> directory,
> >>>> > > you just list the filenames.
> >>>> > >
> >>>> > > John
> >>>> > >
> >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT <
> >>>> > > met_help at ucar.edu>
> >>>> > > wrote:
> >>>> > >
> >>>> > > >
> >>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >>>> > > >
> >>>> > > > Hello John,
> >>>> > > > Excuse me for not understanding. I would like to
interpolate on
> >>>> the
> >>>> > grid
> >>>> > > > points in order to also have the "RMSE" and the "Pearson
> >>>> correlation
> >>>> > > > coefficient" in addition to the contingency table. For
this
> fact,
> >>>> I put
> >>>> > > > ctc, cts and cnt at BOTH.
> >>>> > > > But, my problem remains the same: how do I execute my
grid-stat
> >>>> and in
> >>>> > > what
> >>>> > > > directory. In fact, I would like to know which files to
use,
> >>>> where to
> >>>> > put
> >>>> > > > these files and how to handle them. For the moment, I
have
> >>>> created a
> >>>> > > > symbolic link between the directory containing my data
and the
> >>>> > directory
> >>>> > > > pcp-combines. I put my GridStatConfig_pw in the config
directory
> >>>> and
> >>>> > also
> >>>> > > > in bin. I modify the test_grid_stat.sh and I left it in
the
> >>>> examples
> >>>> > > > directory. When I run in bin following the command you
sent me,
> I
> >>>> have
> >>>> > > > these errors.
> >>>> > > >
> >>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >>>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> >>>> > > >
> >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> >>>> > > >
> >>>> > > > Usage: grid_stat
> >>>> > > > fcst_file
> >>>> > > > obs_file
> >>>> > > > config_file
> >>>> > > > [-outdir path]
> >>>> > > > [-log file]
> >>>> > > > [-v level]
> >>>> > > > [-compress level]
> >>>> > > >
> >>>> > > > where "fcst_file" is a gridded forecast file
> containing
> >>>> the
> >>>> > > > field(s) to be verified (required).
> >>>> > > > "obs_file" is a gridded observation file
> >>>> containing the
> >>>> > > > verifying field(s) (required).
> >>>> > > > "config_file" is a GridStatConfig file
> containing
> >>>> the
> >>>> > > > desired configuration settings (required).
> >>>> > > > "-outdir path" overrides the default
output
> >>>> directory
> >>>> > (.)
> >>>> > > > (optional).
> >>>> > > > "-log file" outputs log messages to the
> specified
> >>>> file
> >>>> > > > (optional).
> >>>> > > > "-v level" overrides the default level of
> logging
> >>>> (2)
> >>>> > > > (optional).
> >>>> > > > "-compress level" overrides the
compression
> level
> >>>> of
> >>>> > > NetCDF
> >>>> > > > variable (0) (optional).
> >>>> > > >
> >>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >>>> > > >
> >>>> > > > Here is my test_grid_stat.sh file
> >>>> > > > Cordially Dores.
> >>>> > > >
> >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT <
> >>>> > > met_help at ucar.edu
> >>>> > > > >
> >>>> > > > a écrit :
> >>>> > > >
> >>>> > > > > Das,
> >>>> > > > >
> >>>> > > > > Good news. It is very easy to configure Grid-Stat to
compute
> >>>> 2x2
> >>>> > > > > contingency tables. We just need to edit the config
file
> to...
> >>>> > > > > (1) Define the categorical thresholds that should be
applied
> >>>> > > (cat_thresh
> >>>> > > > =
> >>>> > > > > [ >20, >30, >40, >50 ];)
> >>>> > > > > (2) Turn on the CTC and CTS output line types (ctc =
BOTH;
> cts =
> >>>> > BOTH;)
> >>>> > > > >
> >>>> > > > > You can of course change those thresholds however you'd
like.
> >>>> Here
> >>>> > are
> >>>> > > > > more commands to illustrate this:
> >>>> > > > >
> >>>> > > > > # Pull sample data from ftp site
> >>>> > > > > wget
> >>>> > > > >
> >>>> > > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> >>>> > > > > wget
> >>>> > > > >
> >>>> > > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> >>>> > > > > wget
> >>>> > >
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> >>>> > > > > GridStatConfig_pw
> >>>> > > > >
> >>>> > > > > # Create output directory and run Grid-Stat
> >>>> > > > > mkdir -p out
> >>>> > > > > export VXTIME=2018071900
> >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
ERAI_pw.nc
> >>>> > > > > GridStatConfig_pw -outdir out -v 3
> >>>> > > > >
> >>>> > > > > Then take a look at the output files:
> >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> >>>> > > > >
> >>>> > > > > The _ctc.txt file contains the counts for the 2x2
contingency
> >>>> table
> >>>> > for
> >>>> > > > > each of the 4 thresholds we specified.
> >>>> > > > >
> >>>> > > > > Hope this helps get you going.
> >>>> > > > >
> >>>> > > > > Thanks,
> >>>> > > > > John
> >>>> > > > >
> >>>> > > > >
> >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via
RT <
> >>>> > > > > met_help at ucar.edu>
> >>>> > > > > wrote:
> >>>> > > > >
> >>>> > > > > > hello John,
> >>>> > > > > > Excuse me, I beg you, to bother you.
> >>>> > > > > > I created a symbolic link between my data and the
> pcp-combines
> >>>> > > > > directory. I
> >>>> > > > > > used test_grid_stat.sh which I modified. I compile
it, it
> did
> >>>> not
> >>>> > > > produce
> >>>> > > > > > anything. I tried the command lines you sent me and I
get
> the
> >>>> > errors
> >>>> > > I
> >>>> > > > > sent
> >>>> > > > > > you. I really have no idea to get me out. I beg you,
please,
> >>>> to
> >>>> > help
> >>>> > > > me.
> >>>> > > > > > Attaching my test_grid_stat.sh file.
> >>>> > > > > >
> >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
> >>>> > > ngaminidas at gmail.com>
> >>>> > > > a
> >>>> > > > > > écrit :
> >>>> > > > > >
> >>>> > > > > > > Hello John,
> >>>> > > > > > > I am still unable to pull out my contingency table
(CTC)
> >>>> with
> >>>> > MET.
> >>>> > > I
> >>>> > > > > have
> >>>> > > > > > > read your email, the user guide, the online
tutorial, but
> I
> >>>> still
> >>>> > > do
> >>>> > > > > not
> >>>> > > > > > > understand how I should run.
> >>>> > > > > > > I see the lines of code:
> >>>> > > > > > >
> >>>> > > > > > > Use: grid_stat
> >>>> > > > > > > fcst_file
> >>>> > > > > > > obs_file
> >>>> > > > > > > config_file
> >>>> > > > > > > [-outdir path]
> >>>> > > > > > > [-log file]
> >>>> > > > > > > [-v level]
> >>>> > > > > > > [-compress level]
> >>>> > > > > > >
> >>>> > > > > > > And, I do not know where I have to write them.
> >>>> > > > > > > I see your run command lines:
> >>>> > > > > > >
> >>>> > > > > > > * mkdir -p out *
> >>>> > > > > > > * setenv VXTIME "2018071900" *
> >>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
> >>>> wrfout_19_2.nc <
> >>>> > > > > > > http://wrfout_19_2.nc>
> >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> >>>> > > > > > >
> >>>> > > > > > > "setenv" did not give, I had to install "getenv".
> >>>> > > > > > >
> >>>> > > > > > > Command 'setenv' not found, did you mean:
> >>>> > > > > > >
> >>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
> >>>> > > > > > >
> >>>> > > > > > > See 'snap info <snapname>' for additional versions.
> >>>> > > > > > >
> >>>> > > > > > > But when I try to run, I have errors:
> >>>> > > > > > >
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
"2018071900"
> >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
<project_name>]
> >>>> [-s
> >>>> > > > > > > <source_dir>]
> >>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
2018071900
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $
> >>>> /usr/local/met-8.1.1/bin/grid_stat
> >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> >>>> > > > > > > bash: syntax error near unexpected `newline '
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $
> >>>> /usr/local/met-8.1.1/bin/grid_stat
> >>>> > > > > > > wrfout_19_2.nc
> >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such
file or
> >>>> > directory
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $
> >>>> > > > > > >
> >>>> > > > > >
> >>>> > > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> >>>> > > > > > > .nc
> >>>> > > > > > > bash:
> >>>> > > > > > >
> >>>> > > > > >
> >>>> > > > >
> >>>> > > >
> >>>> > >
> >>>> >
> >>>>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> >>>> > > > > > > Is a directory
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $
> >>>> /usr/local/met-8.1.1/bin/grid_stat
> >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> >>>> > > > > > > bash: syntax error near unexpected `newline '
> >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision /
MET /
> >>>> 8.1 /
> >>>> > > > > met-8.1.1
> >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
GridStatConfig_pw
> >>>> > -outdir
> >>>> > > > out
> >>>> > > > > > -v 3
> >>>> > > > > > > ERAI_pw.nc: command not found
> >>>> > > > > > >
> >>>> > > > > > > Can you please, send me your execution script.
> >>>> > > > > > > I may not be performing them properly. Please help
me. I'm
> >>>> lost.
> >>>> > > > > > >
> >>>> > > > > > > Best regards
> >>>> > > > > > > Dores
> >>>> > > > > > >
> >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> >>>> > > > ngaminidas at gmail.com>
> >>>> > > > > a
> >>>> > > > > > > écrit :
> >>>> > > > > > >
> >>>> > > > > > >> Thank you very much.
> >>>> > > > > > >>
> >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway
via RT <
> >>>> > > > > > >> met_help at ucar.edu> a écrit :
> >>>> > > > > > >>
> >>>> > > > > > >>> Dores,
> >>>> > > > > > >>>
> >>>> > > > > > >>> OK, great. Thanks for sending some sample data.
> >>>> > > > > > >>>
> >>>> > > > > > >>> When getting started with new datasets in MET, I
always
> >>>> start
> >>>> > by
> >>>> > > > > > running
> >>>> > > > > > >>> the plot_data_plane tool to make sure MET can
read the
> >>>> data and
> >>>> > > > place
> >>>> > > > > > it
> >>>> > > > > > >>> on
> >>>> > > > > > >>> the earth correctly.
> >>>> > > > > > >>>
> >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF format,
and MET
> >>>> can
> >>>> > > easily
> >>>> > > > > > read
> >>>> > > > > > >>> that:
> >>>> > > > > > >>>
> >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**ERAI_pw.nc
> >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> >>>> > level="(2018071900,*,*)";'
> >>>> > > -v
> >>>> > > > > 4*
> >>>> > > > > > >>>
> >>>> > > > > > >>> Next for the WRF output. When I try passing it
to MET
> >>>> > directly,
> >>>> > > I
> >>>> > > > > get
> >>>> > > > > > an
> >>>> > > > > > >>> error message:
> >>>> > > > > > >>> ERROR : plot_data_plane -> file "wrfout_19_2.nc"
not a
> >>>> valid
> >>>> > > data
> >>>> > > > > > file
> >>>> > > > > > >>>
> >>>> > > > > > >>> However, since this is on a lat/lon grid, we can
just
> >>>> tell MET
> >>>> > to
> >>>> > > > > > >>> interpret
> >>>> > > > > > >>> it as being CF-compliant NetCDF, like this
"file_type =
> >>>> > > > > NETCDF_NCCF;":
> >>>> > > > > > >>>
> >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **
> >>>> wrfout_19_2.nc
> >>>> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> >>>> > > > > > level="(2018071900,*,*)";
> >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> >>>> > > > > > >>>
> >>>> > > > > > >>> PNG versions of the resulting images are
attached.
> >>>> > > > > > >>>
> >>>> > > > > > >>> Looking at these images, we see that MET is able
to read
> >>>> data
> >>>> > > from
> >>>> > > > > > them.
> >>>> > > > > > >>> And I'll leave it to you to confirm that MET is
placing
> >>>> them in
> >>>> > > the
> >>>> > > > > > right
> >>>> > > > > > >>> spot on earth, but I assume it is.
> >>>> > > > > > >>>
> >>>> > > > > > >>> Next, let's run Grid-Stat to compute statistics
on them.
> >>>> I've
> >>>> > > set
> >>>> > > > up
> >>>> > > > > > the
> >>>> > > > > > >>> attached Grid-Stat config file to...
> >>>> > > > > > >>>
> >>>> > > > > > >>> (1) Regrid the ERAI data to the model domain
using the
> >>>> budget
> >>>> > > > > > >>> interpolation
> >>>> > > > > > >>> method
> >>>> > > > > > >>> regrid = {
> >>>> > > > > > >>> to_grid = FCST;
> >>>> > > > > > >>> method = BUDGET;
> >>>> > > > > > >>> width = 2;
> >>>> > > > > > >>> vld_thresh = 0.5;
> >>>> > > > > > >>> shape = SQUARE;
> >>>> > > > > > >>> }
> >>>> > > > > > >>>
> >>>> > > > > > >>> (2) Transfer the config options from the
plot_data_plane
> >>>> > command
> >>>> > > > line
> >>>> > > > > > to
> >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
convenience, I
> >>>> defined
> >>>> > > the
> >>>> > > > > time
> >>>> > > > > > >>> as
> >>>> > > > > > >>> an environment variable named $VXTIME:
> >>>> > > > > > >>> fcst = {
> >>>> > > > > > >>> file_type = NETCDF_NCCF;
> >>>> > > > > > >>> field = [ { name = "pw"; level= [
> >>>> "(${VXTIME},*,*)" ];
> >>>> > }
> >>>> > > ];
> >>>> > > > > > >>> }
> >>>> > > > > > >>> obs = {
> >>>> > > > > > >>> field = [ { name = "tcw"; level= [
> >>>> "(${VXTIME},*,*)" ];
> >>>> > }
> >>>> > > ];
> >>>> > > > > > >>> }
> >>>> > > > > > >>>
> >>>> > > > > > >>> (3) Compute stats over the FULL model domain.
> >>>> > > > > > >>> mask = {
> >>>> > > > > > >>> grid = [ "FULL" ];
> >>>> > > > > > >>> poly = [];
> >>>> > > > > > >>> }
> >>>> > > > > > >>>
> >>>> > > > > > >>> (4) And just compute continuous stats.
> >>>> > > > > > >>> output_flag = {
> >>>> > > > > > >>> ...
> >>>> > > > > > >>> cnt = BOTH;
> >>>> > > > > > >>> ...
> >>>> > > > > > >>> }
> >>>> > > > > > >>>
> >>>> > > > > > >>> Finally, run Grid-Stat on the command line like
this:
> >>>> > > > > > >>>
> >>>> > > > > > >>> *mkdir -p out*
> >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc <
> >>>> > > > > > >>> http://wrfout_19_2.nc>
> >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> >>>> > > > > > >>>
> >>>> > > > > > >>> And that run successfully and creates output
files:
> >>>> > > > > > >>> DEBUG 1: Output file:
> >>>> > out/grid_stat_000000L_20180719_000000V.stat
> >>>> > > > > > >>> DEBUG 1: Output file:
> >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> >>>> > > > > > >>> DEBUG 1: Output file:
> >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> >>>> > > > > > >>>
> >>>> > > > > > >>> Looking in the "_cnt.txt" file for example, the
RMSE
> >>>> value =
> >>>> > > > 3.39378.
> >>>> > > > > > >>>
> >>>> > > > > > >>> Hope this helps get you up and running with MET.
> >>>> > > > > > >>>
> >>>> > > > > > >>> Thanks,
> >>>> > > > > > >>> John Halley Gotway
> >>>> > > > > > >>>
> >>>> > > > > > >>>
> >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores
Ngamini via
> RT
> >>>> <
> >>>> > > > > > >>> met_help at ucar.edu>
> >>>> > > > > > >>> wrote:
> >>>> > > > > > >>>
> >>>> > > > > > >>> >
> >>>> > > > > > >>> > <URL:
> >>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >>>> > > >
> >>>> > > > > > >>> >
> >>>> > > > > > >>> > Hello John,
> >>>> > > > > > >>> > I have already sent my data to my ftp site. In
these
> >>>> files, I
> >>>> > > > want
> >>>> > > > > to
> >>>> > > > > > >>> > extract the pw. There is another missing ERAI
file.
> That
> >>>> > one, I
> >>>> > > > > have
> >>>> > > > > > >>> > trouble sending it. It contains the relative
humidity
> >>>> and
> >>>> > wind
> >>>> > > > > data.
> >>>> > > > > > >>> > Please,
> >>>> > > > > > >>> > just tell me how to do it because I can not
send this
> >>>> file.
> >>>> > > There
> >>>> > > > > are
> >>>> > > > > > >>> two
> >>>> > > > > > >>> > wrfout files because my forecasts are made over
24
> >>>> hours or
> >>>> > > more.
> >>>> > > > > My
> >>>> > > > > > >>> raw
> >>>> > > > > > >>> > wrf outputs are in "HDF", and I can not send
them.
> >>>> That's
> >>>> > why I
> >>>> > > > > sent
> >>>> > > > > > >>> those
> >>>> > > > > > >>> > in NetCDF. If I continue to wait for the other
files
> to
> >>>> be
> >>>> > > sent,
> >>>> > > > > the
> >>>> > > > > > >>> time
> >>>> > > > > > >>> > to deposit my memory will expire.
> >>>> > > > > > >>> > Thank you very much for helping me.
> >>>> > > > > > >>> > Yours sincerely.
> >>>> > > > > > >>> > Dores
> >>>> > > > > > >>> >
> >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley
Gotway via
> RT
> >>>> <
> >>>> > > > > > >>> met_help at ucar.edu
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > a écrit :
> >>>> > > > > > >>> >
> >>>> > > > > > >>> > > Dores,
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > Were you able to post any data to the ftp
site? You
> >>>> could
> >>>> > > try
> >>>> > > > > > >>> sending
> >>>> > > > > > >>> > via
> >>>> > > > > > >>> > > email but I worry that the data files will be
too
> >>>> large to
> >>>> > > > > transfer
> >>>> > > > > > >>> that
> >>>> > > > > > >>> > > way.
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > Stephen is right... you need to put the files
one by
> >>>> way.
> >>>> > By
> >>>> > > > way
> >>>> > > > > > of
> >>>> > > > > > >>> > > example, here are commands to create a file
named
> >>>> > > > hello_world.txt
> >>>> > > > > > and
> >>>> > > > > > >>> > post
> >>>> > > > > > >>> > > it to our ftp site.
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > cd /home/johnhg
> >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
> >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> >>>> > > > > > >>> > > username = anonymous
> >>>> > > > > > >>> > > password = "my email address"
> >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> >>>> > > > > > >>> > > put hello_world.txt
> >>>> > > > > > >>> > > bye
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > And then checking the ftp via a web browser:
> >>>> > > > > > >>> > >
> >>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > I see that file now exists. Just be sure
that
> you're
> >>>> in
> >>>> > the
> >>>> > > > > > >>> directory
> >>>> > > > > > >>> > > which contains the files you want to send
before
> >>>> running
> >>>> > ftp.
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > Thanks,
> >>>> > > > > > >>> > > John
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen Dowdy
via
> RT <
> >>>> > > > > > >>> met_help at ucar.edu>
> >>>> > > > > > >>> > > wrote:
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > > <URL:
> >>>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >>>> > > > > >
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > > John,
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from
Dores
> into
> >>>> this
> >>>> > > > ticket
> >>>> > > > > > >>> with
> >>>> > > > > > >>> > > > explanation of what i think the problem is
> >>>> (specifying
> >>>> > full
> >>>> > > > > paths
> >>>> > > > > > >>> on
> >>>> > > > > > >>> > the
> >>>> > > > > > >>> > > > files w/o telling the FTP server to rename
to
> >>>> non-pathed
> >>>> > > > > > filename.
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > > If you want, it might be helpful to add
something
> >>>> about
> >>>> > > that
> >>>> > > > to
> >>>> > > > > > >>> your
> >>>> > > > > > >>> > Met
> >>>> > > > > > >>> > > > Help FTP upload page.
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > > > thanks,
> >>>> > > > > > >>> > > > --stephen
> >>>> > > > > > >>> > > >
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> > >
> >>>> > > > > > >>> >
> >>>> > > > > > >>> >
> >>>> > > > > > >>>
> >>>> > > > > > >>>
> >>>> > > > > >
> >>>> > > > > >
> >>>> > > > >
> >>>> > > > >
> >>>> > > >
> >>>> > > >
> >>>> > >
> >>>> > >
> >>>> >
> >>>> >
> >>>>
> >>>>
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Oct 31 22:57:26 2019
Hello John,
Thank you for your reply.
ncdump -h wrfout_20_2.nc gives all the variables normally. However,
plot_data_plane does not run. At this point, grid_stat is not running
any
of my wrf output files, not even wrfout_19_2.nc that was working
first.
Thank you in advance
Dorès
Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> In the GridStatConfig_pw file, we requested data from the
> forecast/observation files as shown below. Note that we used an
> environment variable named "VXTIME" to define the timestamp of the
data we
> want to retrieve:
>
> fcst = {
> file_type = NETCDF_NCCF;
> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
> }
> obs = {
> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
> }
>
> You indicated that the script worked fine for the WRF file named "
> wrfout_19_2.nc" but errors out when processing "wrfout_20_2.nc".
> Presumably the timestamps differ between these two files. I suggest
that
> you:
>
> (1) Make sure that wrfout_20_2.nc exists and is a valid NetCDF file
(run
> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
results).
> (2) Set the VXTIME environment variable to a timestamp which
actually
> exists in that file.
> (3) Run plot_data_plane to confirm that MET processes this data
fine. For
> example:
>
>
> *setenv VXTIME 20180725*
> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)"; file_type =
> NETCDF_NCCF;' -v 4*
>
> Thanks,
> John
>
> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John,
> > Please, help me to run grid_stat for my another wrfout files. I
don't
> know
> > what to change in the files I used to run the first wrfout.
> >
> > Cordially
> > Dorès
> >
> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> > > Hello John,
> > > I use the same config file and the same test_grid_stat.sh file.
> > >
> > >
> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> > > écrit :
> > >
> > >> Hello John,
> > >> Another problem that I have now is I am not able to run another
wrfout
> > >> with the same command. What should I change? I have several
wrfout
> files
> > >> that I want to fill the CTC.
> > >> Here the error that I have.
> > >>
> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > >> DEBUG 1: Default Config File:
> > >>
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > >> DEBUG 1: User Config File: GridStatConfig_pw
> > >> ERROR :
> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> > >> file "wrfout_20_2.nc"
> > >> ERROR :
> > >> ERROR :
> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> > >> file "wrfout_20_2.nc"
> > >> ERROR :
> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >>
> > >> Best regards
> > >> Dorès
> > >>
> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini
<ngaminidas at gmail.com
> >
> > a
> > >> écrit :
> > >>
> > >>> Hello John,
> > >>> FCST_VALID_BEG = 20180719_000000
> > >>> FCST_VALID_END = 20180719_000000
> > >>> It is the same for OBS.
> > >>> I want to have
> > >>> FCST_VALID_BEG = 20180719_000000
> > >>> FCST_VALID_END = 20180726_000000
> > >>>
> > >>> My another problem is how to cite MET.
> > >>>
> > >>> Cordially
> > >>> Dorès
> > >>>
> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
> > >>> met_help at ucar.edu> a écrit :
> > >>>
> > >>>> Dores,
> > >>>>
> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
information is
> > >>>> extracted from the metadata of the data files. And that
timing
> > >>>> information
> > >>>> is written to the header columns of the output files. There
is, in
> > >>>> general, no easy way of modifying the timing information of
the data
> > >>>> you're
> > >>>> processing.
> > >>>>
> > >>>> And I don't really understand why you would want to change
that
> timing
> > >>>> info.
> > >>>>
> > >>>> We actually do have a development issue defined that would
enable
> this
> > >>>> in
> > >>>> the future, but that work has not been done yet.
> > >>>> https://github.com/NCAR/MET/issues/1020
> > >>>>
> > >>>> Thanks,
> > >>>> John
> > >>>>
> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
> > >>>> met_help at ucar.edu>
> > >>>> wrote:
> > >>>>
> > >>>> >
> > >>>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >>>> >
> > >>>> > Hello John,
> > >>>> > Thanks a lot for your help.
> > >>>> > I can already see something interesting. But, I have
another
> > problem.
> > >>>> I
> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
> > OBS_LEAD
> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find
them and
> > >>>> how to
> > >>>> > take them into account when running. I predict 24 hours to
144
> hours
> > >>>> (0 to
> > >>>> > 6 days). Please help me.
> > >>>> >
> > >>>> > Thank you in advance.
> > >>>> >
> > >>>> > Dorès
> > >>>> >
> > >>>> >
> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
> > >>>> met_help at ucar.edu
> > >>>> > >
> > >>>> > a écrit :
> > >>>> >
> > >>>> > > Dores,
> > >>>> > >
> > >>>> > > It looks like you're running Grid-Stat in this way:
> > >>>> > >
> > >>>> > >
> > >>>> > >
> > >>>> > > *dores at dores
> > >>>> > >
> > >>>> >
> > >>>>
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > >>>> > > grid_statwrfout_19_2.nc
> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> > >>>> > >
> > >>>> > > And Grid-Stat is printing out the usage statement to
indicate
> that
> > >>>> you
> > >>>> > have
> > >>>> > > provided the correct input arguments.
> > >>>> > >
> > >>>> > > Grid-Stat has 3 required arguments on the command line:
> > >>>> > > (1) the path to the forecast file
> > >>>> > > (2) the path to the observation file
> > >>>> > > (3) the path the grid_stat configuration file
> > >>>> > >
> > >>>> > > You have provided the first 2 but not the 3rd. Please
try
> running
> > >>>> > > grid_stat will all 3 required arguments:
> > >>>> > >
> > >>>> > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> > >>>> > >
> > >>>> > > And there is no requirement for the directory structure
to be
> > >>>> used. You
> > >>>> > > can either provide the full absolute path the the input
files,
> or
> > >>>> the
> > >>>> > > relative path. If these files are all in your current
working
> > >>>> directory,
> > >>>> > > you just list the filenames.
> > >>>> > >
> > >>>> > > John
> > >>>> > >
> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT
<
> > >>>> > > met_help at ucar.edu>
> > >>>> > > wrote:
> > >>>> > >
> > >>>> > > >
> > >>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >
> > >>>> > > >
> > >>>> > > > Hello John,
> > >>>> > > > Excuse me for not understanding. I would like to
interpolate
> on
> > >>>> the
> > >>>> > grid
> > >>>> > > > points in order to also have the "RMSE" and the
"Pearson
> > >>>> correlation
> > >>>> > > > coefficient" in addition to the contingency table. For
this
> > fact,
> > >>>> I put
> > >>>> > > > ctc, cts and cnt at BOTH.
> > >>>> > > > But, my problem remains the same: how do I execute my
> grid-stat
> > >>>> and in
> > >>>> > > what
> > >>>> > > > directory. In fact, I would like to know which files to
use,
> > >>>> where to
> > >>>> > put
> > >>>> > > > these files and how to handle them. For the moment, I
have
> > >>>> created a
> > >>>> > > > symbolic link between the directory containing my data
and the
> > >>>> > directory
> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in the config
> directory
> > >>>> and
> > >>>> > also
> > >>>> > > > in bin. I modify the test_grid_stat.sh and I left it in
the
> > >>>> examples
> > >>>> > > > directory. When I run in bin following the command you
sent
> me,
> > I
> > >>>> have
> > >>>> > > > these errors.
> > >>>> > > >
> > >>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >>>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> > >>>> > > >
> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> > >>>> > > >
> > >>>> > > > Usage: grid_stat
> > >>>> > > > fcst_file
> > >>>> > > > obs_file
> > >>>> > > > config_file
> > >>>> > > > [-outdir path]
> > >>>> > > > [-log file]
> > >>>> > > > [-v level]
> > >>>> > > > [-compress level]
> > >>>> > > >
> > >>>> > > > where "fcst_file" is a gridded forecast file
> > containing
> > >>>> the
> > >>>> > > > field(s) to be verified (required).
> > >>>> > > > "obs_file" is a gridded observation
file
> > >>>> containing the
> > >>>> > > > verifying field(s) (required).
> > >>>> > > > "config_file" is a GridStatConfig file
> > containing
> > >>>> the
> > >>>> > > > desired configuration settings (required).
> > >>>> > > > "-outdir path" overrides the default
output
> > >>>> directory
> > >>>> > (.)
> > >>>> > > > (optional).
> > >>>> > > > "-log file" outputs log messages to the
> > specified
> > >>>> file
> > >>>> > > > (optional).
> > >>>> > > > "-v level" overrides the default level
of
> > logging
> > >>>> (2)
> > >>>> > > > (optional).
> > >>>> > > > "-compress level" overrides the
compression
> > level
> > >>>> of
> > >>>> > > NetCDF
> > >>>> > > > variable (0) (optional).
> > >>>> > > >
> > >>>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >>>> > > >
> > >>>> > > > Here is my test_grid_stat.sh file
> > >>>> > > > Cordially Dores.
> > >>>> > > >
> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via RT
<
> > >>>> > > met_help at ucar.edu
> > >>>> > > > >
> > >>>> > > > a écrit :
> > >>>> > > >
> > >>>> > > > > Das,
> > >>>> > > > >
> > >>>> > > > > Good news. It is very easy to configure Grid-Stat to
> compute
> > >>>> 2x2
> > >>>> > > > > contingency tables. We just need to edit the config
file
> > to...
> > >>>> > > > > (1) Define the categorical thresholds that should be
applied
> > >>>> > > (cat_thresh
> > >>>> > > > =
> > >>>> > > > > [ >20, >30, >40, >50 ];)
> > >>>> > > > > (2) Turn on the CTC and CTS output line types (ctc =
BOTH;
> > cts =
> > >>>> > BOTH;)
> > >>>> > > > >
> > >>>> > > > > You can of course change those thresholds however
you'd
> like.
> > >>>> Here
> > >>>> > are
> > >>>> > > > > more commands to illustrate this:
> > >>>> > > > >
> > >>>> > > > > # Pull sample data from ftp site
> > >>>> > > > > wget
> > >>>> > > > >
> > >>>> > > > >
> > >>>> > > >
> > >>>> > >
> > >>>> >
> > >>>>
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > >>>> > > > > wget
> > >>>> > > > >
> > >>>> > > > >
> > >>>> > > >
> > >>>> > >
> > >>>> >
> > >>>>
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > >>>> > > > > wget
> > >>>> > >
> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > >>>> > > > > GridStatConfig_pw
> > >>>> > > > >
> > >>>> > > > > # Create output directory and run Grid-Stat
> > >>>> > > > > mkdir -p out
> > >>>> > > > > export VXTIME=2018071900
> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
> ERAI_pw.nc
> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
> > >>>> > > > >
> > >>>> > > > > Then take a look at the output files:
> > >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > >>>> > > > >
> > >>>> > > > > The _ctc.txt file contains the counts for the 2x2
> contingency
> > >>>> table
> > >>>> > for
> > >>>> > > > > each of the 4 thresholds we specified.
> > >>>> > > > >
> > >>>> > > > > Hope this helps get you going.
> > >>>> > > > >
> > >>>> > > > > Thanks,
> > >>>> > > > > John
> > >>>> > > > >
> > >>>> > > > >
> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini via
RT <
> > >>>> > > > > met_help at ucar.edu>
> > >>>> > > > > wrote:
> > >>>> > > > >
> > >>>> > > > > > hello John,
> > >>>> > > > > > Excuse me, I beg you, to bother you.
> > >>>> > > > > > I created a symbolic link between my data and the
> > pcp-combines
> > >>>> > > > > directory. I
> > >>>> > > > > > used test_grid_stat.sh which I modified. I compile
it, it
> > did
> > >>>> not
> > >>>> > > > produce
> > >>>> > > > > > anything. I tried the command lines you sent me and
I get
> > the
> > >>>> > errors
> > >>>> > > I
> > >>>> > > > > sent
> > >>>> > > > > > you. I really have no idea to get me out. I beg
you,
> please,
> > >>>> to
> > >>>> > help
> > >>>> > > > me.
> > >>>> > > > > > Attaching my test_grid_stat.sh file.
> > >>>> > > > > >
> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
> > >>>> > > ngaminidas at gmail.com>
> > >>>> > > > a
> > >>>> > > > > > écrit :
> > >>>> > > > > >
> > >>>> > > > > > > Hello John,
> > >>>> > > > > > > I am still unable to pull out my contingency
table (CTC)
> > >>>> with
> > >>>> > MET.
> > >>>> > > I
> > >>>> > > > > have
> > >>>> > > > > > > read your email, the user guide, the online
tutorial,
> but
> > I
> > >>>> still
> > >>>> > > do
> > >>>> > > > > not
> > >>>> > > > > > > understand how I should run.
> > >>>> > > > > > > I see the lines of code:
> > >>>> > > > > > >
> > >>>> > > > > > > Use: grid_stat
> > >>>> > > > > > > fcst_file
> > >>>> > > > > > > obs_file
> > >>>> > > > > > > config_file
> > >>>> > > > > > > [-outdir path]
> > >>>> > > > > > > [-log file]
> > >>>> > > > > > > [-v level]
> > >>>> > > > > > > [-compress level]
> > >>>> > > > > > >
> > >>>> > > > > > > And, I do not know where I have to write them.
> > >>>> > > > > > > I see your run command lines:
> > >>>> > > > > > >
> > >>>> > > > > > > * mkdir -p out *
> > >>>> > > > > > > * setenv VXTIME "2018071900" *
> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
> > >>>> wrfout_19_2.nc <
> > >>>> > > > > > > http://wrfout_19_2.nc>
> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
> > >>>> > > > > > >
> > >>>> > > > > > > "setenv" did not give, I had to install "getenv".
> > >>>> > > > > > >
> > >>>> > > > > > > Command 'setenv' not found, did you mean:
> > >>>> > > > > > >
> > >>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
> > >>>> > > > > > >
> > >>>> > > > > > > See 'snap info <snapname>' for additional
versions.
> > >>>> > > > > > >
> > >>>> > > > > > > But when I try to run, I have errors:
> > >>>> > > > > > >
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
"2018071900"
> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
> <project_name>]
> > >>>> [-s
> > >>>> > > > > > > <source_dir>]
> > >>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
2018071900
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $
> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > >>>> > > > > > > bash: syntax error near unexpected `newline '
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $
> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >>>> > > > > > > wrfout_19_2.nc
> > >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No such
file
> or
> > >>>> > directory
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $
> > >>>> > > > > > >
> > >>>> > > > > >
> > >>>> > > > >
> > >>>> > > >
> > >>>> > >
> > >>>> >
> > >>>>
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > >>>> > > > > > > .nc
> > >>>> > > > > > > bash:
> > >>>> > > > > > >
> > >>>> > > > > >
> > >>>> > > > >
> > >>>> > > >
> > >>>> > >
> > >>>> >
> > >>>>
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > >>>> > > > > > > Is a directory
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $
> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > >>>> > > > > > > bash: syntax error near unexpected `newline '
> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master / TP_Prevision
/ MET
> /
> > >>>> 8.1 /
> > >>>> > > > > met-8.1.1
> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
> GridStatConfig_pw
> > >>>> > -outdir
> > >>>> > > > out
> > >>>> > > > > > -v 3
> > >>>> > > > > > > ERAI_pw.nc: command not found
> > >>>> > > > > > >
> > >>>> > > > > > > Can you please, send me your execution script.
> > >>>> > > > > > > I may not be performing them properly. Please
help me.
> I'm
> > >>>> lost.
> > >>>> > > > > > >
> > >>>> > > > > > > Best regards
> > >>>> > > > > > > Dores
> > >>>> > > > > > >
> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini <
> > >>>> > > > ngaminidas at gmail.com>
> > >>>> > > > > a
> > >>>> > > > > > > écrit :
> > >>>> > > > > > >
> > >>>> > > > > > >> Thank you very much.
> > >>>> > > > > > >>
> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley Gotway
via
> RT <
> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
> > >>>> > > > > > >>
> > >>>> > > > > > >>> Dores,
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> OK, great. Thanks for sending some sample
data.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> When getting started with new datasets in MET,
I
> always
> > >>>> start
> > >>>> > by
> > >>>> > > > > > running
> > >>>> > > > > > >>> the plot_data_plane tool to make sure MET can
read the
> > >>>> data and
> > >>>> > > > place
> > >>>> > > > > > it
> > >>>> > > > > > >>> on
> > >>>> > > > > > >>> the earth correctly.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF
format, and
> MET
> > >>>> can
> > >>>> > > easily
> > >>>> > > > > > read
> > >>>> > > > > > >>> that:
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**ERAI_pw.nc
> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> > >>>> > level="(2018071900,*,*)";'
> > >>>> > > -v
> > >>>> > > > > 4*
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Next for the WRF output. When I try passing it
to MET
> > >>>> > directly,
> > >>>> > > I
> > >>>> > > > > get
> > >>>> > > > > > an
> > >>>> > > > > > >>> error message:
> > >>>> > > > > > >>> ERROR : plot_data_plane -> file
"wrfout_19_2.nc"
> not a
> > >>>> valid
> > >>>> > > data
> > >>>> > > > > > file
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> However, since this is on a lat/lon grid, we
can just
> > >>>> tell MET
> > >>>> > to
> > >>>> > > > > > >>> interpret
> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like this
"file_type
> =
> > >>>> > > > > NETCDF_NCCF;":
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **
> > >>>> wrfout_19_2.nc
> > >>>> > > > > > >>> <http://wrfout_19_2.nc> wrfout_pw_2018071900.ps
> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
> > >>>> > > > > > level="(2018071900,*,*)";
> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> PNG versions of the resulting images are
attached.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Looking at these images, we see that MET is
able to
> read
> > >>>> data
> > >>>> > > from
> > >>>> > > > > > them.
> > >>>> > > > > > >>> And I'll leave it to you to confirm that MET is
> placing
> > >>>> them in
> > >>>> > > the
> > >>>> > > > > > right
> > >>>> > > > > > >>> spot on earth, but I assume it is.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute statistics
on
> them.
> > >>>> I've
> > >>>> > > set
> > >>>> > > > up
> > >>>> > > > > > the
> > >>>> > > > > > >>> attached Grid-Stat config file to...
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model domain
using the
> > >>>> budget
> > >>>> > > > > > >>> interpolation
> > >>>> > > > > > >>> method
> > >>>> > > > > > >>> regrid = {
> > >>>> > > > > > >>> to_grid = FCST;
> > >>>> > > > > > >>> method = BUDGET;
> > >>>> > > > > > >>> width = 2;
> > >>>> > > > > > >>> vld_thresh = 0.5;
> > >>>> > > > > > >>> shape = SQUARE;
> > >>>> > > > > > >>> }
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> (2) Transfer the config options from the
> plot_data_plane
> > >>>> > command
> > >>>> > > > line
> > >>>> > > > > > to
> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
convenience, I
> > >>>> defined
> > >>>> > > the
> > >>>> > > > > time
> > >>>> > > > > > >>> as
> > >>>> > > > > > >>> an environment variable named $VXTIME:
> > >>>> > > > > > >>> fcst = {
> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
> > >>>> > > > > > >>> field = [ { name = "pw"; level= [
> > >>>> "(${VXTIME},*,*)" ];
> > >>>> > }
> > >>>> > > ];
> > >>>> > > > > > >>> }
> > >>>> > > > > > >>> obs = {
> > >>>> > > > > > >>> field = [ { name = "tcw"; level= [
> > >>>> "(${VXTIME},*,*)" ];
> > >>>> > }
> > >>>> > > ];
> > >>>> > > > > > >>> }
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> (3) Compute stats over the FULL model domain.
> > >>>> > > > > > >>> mask = {
> > >>>> > > > > > >>> grid = [ "FULL" ];
> > >>>> > > > > > >>> poly = [];
> > >>>> > > > > > >>> }
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> (4) And just compute continuous stats.
> > >>>> > > > > > >>> output_flag = {
> > >>>> > > > > > >>> ...
> > >>>> > > > > > >>> cnt = BOTH;
> > >>>> > > > > > >>> ...
> > >>>> > > > > > >>> }
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Finally, run Grid-Stat on the command line like
this:
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> *mkdir -p out*
> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc <
> > >>>> > > > > > >>> http://wrfout_19_2.nc>
> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> And that run successfully and creates output
files:
> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for example, the
RMSE
> > >>>> value =
> > >>>> > > > 3.39378.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Hope this helps get you up and running with
MET.
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> Thanks,
> > >>>> > > > > > >>> John Halley Gotway
> > >>>> > > > > > >>>
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores
Ngamini via
> > RT
> > >>>> <
> > >>>> > > > > > >>> met_help at ucar.edu>
> > >>>> > > > > > >>> wrote:
> > >>>> > > > > > >>>
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>> > <URL:
> > >>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >>>> > > >
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>> > Hello John,
> > >>>> > > > > > >>> > I have already sent my data to my ftp site.
In these
> > >>>> files, I
> > >>>> > > > want
> > >>>> > > > > to
> > >>>> > > > > > >>> > extract the pw. There is another missing ERAI
file.
> > That
> > >>>> > one, I
> > >>>> > > > > have
> > >>>> > > > > > >>> > trouble sending it. It contains the relative
> humidity
> > >>>> and
> > >>>> > wind
> > >>>> > > > > data.
> > >>>> > > > > > >>> > Please,
> > >>>> > > > > > >>> > just tell me how to do it because I can not
send
> this
> > >>>> file.
> > >>>> > > There
> > >>>> > > > > are
> > >>>> > > > > > >>> two
> > >>>> > > > > > >>> > wrfout files because my forecasts are made
over 24
> > >>>> hours or
> > >>>> > > more.
> > >>>> > > > > My
> > >>>> > > > > > >>> raw
> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can not send
them.
> > >>>> That's
> > >>>> > why I
> > >>>> > > > > sent
> > >>>> > > > > > >>> those
> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for the
other files
> > to
> > >>>> be
> > >>>> > > sent,
> > >>>> > > > > the
> > >>>> > > > > > >>> time
> > >>>> > > > > > >>> > to deposit my memory will expire.
> > >>>> > > > > > >>> > Thank you very much for helping me.
> > >>>> > > > > > >>> > Yours sincerely.
> > >>>> > > > > > >>> > Dores
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley
Gotway via
> > RT
> > >>>> <
> > >>>> > > > > > >>> met_help at ucar.edu
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > a écrit :
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>> > > Dores,
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > Were you able to post any data to the ftp
site?
> You
> > >>>> could
> > >>>> > > try
> > >>>> > > > > > >>> sending
> > >>>> > > > > > >>> > via
> > >>>> > > > > > >>> > > email but I worry that the data files will
be too
> > >>>> large to
> > >>>> > > > > transfer
> > >>>> > > > > > >>> that
> > >>>> > > > > > >>> > > way.
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > Stephen is right... you need to put the
files one
> by
> > >>>> way.
> > >>>> > By
> > >>>> > > > way
> > >>>> > > > > > of
> > >>>> > > > > > >>> > > example, here are commands to create a file
named
> > >>>> > > > hello_world.txt
> > >>>> > > > > > and
> > >>>> > > > > > >>> > post
> > >>>> > > > > > >>> > > it to our ftp site.
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > cd /home/johnhg
> > >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> > >>>> > > > > > >>> > > username = anonymous
> > >>>> > > > > > >>> > > password = "my email address"
> > >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> > >>>> > > > > > >>> > > put hello_world.txt
> > >>>> > > > > > >>> > > bye
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > And then checking the ftp via a web
browser:
> > >>>> > > > > > >>> > >
> > >>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > I see that file now exists. Just be sure
that
> > you're
> > >>>> in
> > >>>> > the
> > >>>> > > > > > >>> directory
> > >>>> > > > > > >>> > > which contains the files you want to send
before
> > >>>> running
> > >>>> > ftp.
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > Thanks,
> > >>>> > > > > > >>> > > John
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen
Dowdy via
> > RT <
> > >>>> > > > > > >>> met_help at ucar.edu>
> > >>>> > > > > > >>> > > wrote:
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > > <URL:
> > >>>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >>>> > > > > >
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > > John,
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from
Dores
> > into
> > >>>> this
> > >>>> > > > ticket
> > >>>> > > > > > >>> with
> > >>>> > > > > > >>> > > > explanation of what i think the problem
is
> > >>>> (specifying
> > >>>> > full
> > >>>> > > > > paths
> > >>>> > > > > > >>> on
> > >>>> > > > > > >>> > the
> > >>>> > > > > > >>> > > > files w/o telling the FTP server to
rename to
> > >>>> non-pathed
> > >>>> > > > > > filename.
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > > If you want, it might be helpful to add
> something
> > >>>> about
> > >>>> > > that
> > >>>> > > > to
> > >>>> > > > > > >>> your
> > >>>> > > > > > >>> > Met
> > >>>> > > > > > >>> > > > Help FTP upload page.
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > > > thanks,
> > >>>> > > > > > >>> > > > --stephen
> > >>>> > > > > > >>> > > >
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> > >
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>> >
> > >>>> > > > > > >>>
> > >>>> > > > > > >>>
> > >>>> > > > > >
> > >>>> > > > > >
> > >>>> > > > >
> > >>>> > > > >
> > >>>> > > >
> > >>>> > > >
> > >>>> > >
> > >>>> > >
> > >>>> >
> > >>>> >
> > >>>>
> > >>>>
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sun Nov 03 22:28:47 2019
Hello John
Since my gridstat tool is not running, can you please run it for me
and
send me the .txt, .stat output files? I have 6 wrfout left to execute.
If
you agree, I send you the other files.
However, I would like if possible to execute myself. That is why I ask
you
to look very carefully at the errors I am getting and to propose a
solution.
Attached is the type of error obtained for each data, including
wrfout_19_2.nc which gave first and the files used.
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
VXTIME=2018072000
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
DEBUG 1: Default Config File:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_pw
ERROR :
ERROR : MetNcCFDataFile::open(const char *) -> unable to open NetCDF
file "
wrfout_20_2.nc"
ERROR :
ERROR :
ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error opening
file
"wrfout_20_2.nc"
ERROR :
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
Thank you in advance
Dorès
Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> Thank you for your reply.
> ncdump -h wrfout_20_2.nc gives all the variables normally. However,
> plot_data_plane does not run. At this point, grid_stat is not
running any
> of my wrf output files, not even wrfout_19_2.nc that was working
first.
> Thank you in advance
> Dorès
>
> Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> Dores,
>>
>> In the GridStatConfig_pw file, we requested data from the
>> forecast/observation files as shown below. Note that we used an
>> environment variable named "VXTIME" to define the timestamp of the
data we
>> want to retrieve:
>>
>> fcst = {
>> file_type = NETCDF_NCCF;
>> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; } ];
>> }
>> obs = {
>> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; } ];
>> }
>>
>> You indicated that the script worked fine for the WRF file named "
>> wrfout_19_2.nc" but errors out when processing "wrfout_20_2.nc".
>> Presumably the timestamps differ between these two files. I
suggest that
>> you:
>>
>> (1) Make sure that wrfout_20_2.nc exists and is a valid NetCDF file
(run
>> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
results).
>> (2) Set the VXTIME environment variable to a timestamp which
actually
>> exists in that file.
>> (3) Run plot_data_plane to confirm that MET processes this data
fine. For
>> example:
>>
>>
>> *setenv VXTIME 20180725*
>> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
>> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)"; file_type =
>> NETCDF_NCCF;' -v 4*
>>
>> Thanks,
>> John
>>
>> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> >
>> > Hello John,
>> > Please, help me to run grid_stat for my another wrfout files. I
don't
>> know
>> > what to change in the files I used to run the first wrfout.
>> >
>> > Cordially
>> > Dorès
>> >
>> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini
<ngaminidas at gmail.com>
>> a
>> > écrit :
>> >
>> > > Hello John,
>> > > I use the same config file and the same test_grid_stat.sh file.
>> > >
>> > >
>> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini
<ngaminidas at gmail.com>
>> a
>> > > écrit :
>> > >
>> > >> Hello John,
>> > >> Another problem that I have now is I am not able to run
another
>> wrfout
>> > >> with the same command. What should I change? I have several
wrfout
>> files
>> > >> that I want to fill the CTC.
>> > >> Here the error that I have.
>> > >>
>> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > >> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
>> > >> DEBUG 1: Default Config File:
>> > >>
>> >
>>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
>> > >> DEBUG 1: User Config File: GridStatConfig_pw
>> > >> ERROR :
>> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
>> > >> file "wrfout_20_2.nc"
>> > >> ERROR :
>> > >> ERROR :
>> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
>> opening
>> > >> file "wrfout_20_2.nc"
>> > >> ERROR :
>> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > >>
>> > >> Best regards
>> > >> Dorès
>> > >>
>> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
>> ngaminidas at gmail.com>
>> > a
>> > >> écrit :
>> > >>
>> > >>> Hello John,
>> > >>> FCST_VALID_BEG = 20180719_000000
>> > >>> FCST_VALID_END = 20180719_000000
>> > >>> It is the same for OBS.
>> > >>> I want to have
>> > >>> FCST_VALID_BEG = 20180719_000000
>> > >>> FCST_VALID_END = 20180726_000000
>> > >>>
>> > >>> My another problem is how to cite MET.
>> > >>>
>> > >>> Cordially
>> > >>> Dorès
>> > >>>
>> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
>> > >>> met_help at ucar.edu> a écrit :
>> > >>>
>> > >>>> Dores,
>> > >>>>
>> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
information is
>> > >>>> extracted from the metadata of the data files. And that
timing
>> > >>>> information
>> > >>>> is written to the header columns of the output files. There
is, in
>> > >>>> general, no easy way of modifying the timing information of
the
>> data
>> > >>>> you're
>> > >>>> processing.
>> > >>>>
>> > >>>> And I don't really understand why you would want to change
that
>> timing
>> > >>>> info.
>> > >>>>
>> > >>>> We actually do have a development issue defined that would
enable
>> this
>> > >>>> in
>> > >>>> the future, but that work has not been done yet.
>> > >>>> https://github.com/NCAR/MET/issues/1020
>> > >>>>
>> > >>>> Thanks,
>> > >>>> John
>> > >>>>
>> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
>> > >>>> met_help at ucar.edu>
>> > >>>> wrote:
>> > >>>>
>> > >>>> >
>> > >>>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> > >>>> >
>> > >>>> > Hello John,
>> > >>>> > Thanks a lot for your help.
>> > >>>> > I can already see something interesting. But, I have
another
>> > problem.
>> > >>>> I
>> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
>> > OBS_LEAD
>> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to find
them
>> and
>> > >>>> how to
>> > >>>> > take them into account when running. I predict 24 hours to
144
>> hours
>> > >>>> (0 to
>> > >>>> > 6 days). Please help me.
>> > >>>> >
>> > >>>> > Thank you in advance.
>> > >>>> >
>> > >>>> > Dorès
>> > >>>> >
>> > >>>> >
>> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT <
>> > >>>> met_help at ucar.edu
>> > >>>> > >
>> > >>>> > a écrit :
>> > >>>> >
>> > >>>> > > Dores,
>> > >>>> > >
>> > >>>> > > It looks like you're running Grid-Stat in this way:
>> > >>>> > >
>> > >>>> > >
>> > >>>> > >
>> > >>>> > > *dores at dores
>> > >>>> > >
>> > >>>> >
>> > >>>>
>> >
>>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
>> > >>>> > > grid_statwrfout_19_2.nc
>> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
>> > >>>> > >
>> > >>>> > > And Grid-Stat is printing out the usage statement to
indicate
>> that
>> > >>>> you
>> > >>>> > have
>> > >>>> > > provided the correct input arguments.
>> > >>>> > >
>> > >>>> > > Grid-Stat has 3 required arguments on the command line:
>> > >>>> > > (1) the path to the forecast file
>> > >>>> > > (2) the path to the observation file
>> > >>>> > > (3) the path the grid_stat configuration file
>> > >>>> > >
>> > >>>> > > You have provided the first 2 but not the 3rd. Please
try
>> running
>> > >>>> > > grid_stat will all 3 required arguments:
>> > >>>> > >
>> > >>>> > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>> > >>>> > >
>> > >>>> > > And there is no requirement for the directory structure
to be
>> > >>>> used. You
>> > >>>> > > can either provide the full absolute path the the input
files,
>> or
>> > >>>> the
>> > >>>> > > relative path. If these files are all in your current
working
>> > >>>> directory,
>> > >>>> > > you just list the filenames.
>> > >>>> > >
>> > >>>> > > John
>> > >>>> > >
>> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via RT
<
>> > >>>> > > met_help at ucar.edu>
>> > >>>> > > wrote:
>> > >>>> > >
>> > >>>> > > >
>> > >>>> > > > <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> > >>>> > > >
>> > >>>> > > > Hello John,
>> > >>>> > > > Excuse me for not understanding. I would like to
interpolate
>> on
>> > >>>> the
>> > >>>> > grid
>> > >>>> > > > points in order to also have the "RMSE" and the
"Pearson
>> > >>>> correlation
>> > >>>> > > > coefficient" in addition to the contingency table. For
this
>> > fact,
>> > >>>> I put
>> > >>>> > > > ctc, cts and cnt at BOTH.
>> > >>>> > > > But, my problem remains the same: how do I execute my
>> grid-stat
>> > >>>> and in
>> > >>>> > > what
>> > >>>> > > > directory. In fact, I would like to know which files
to use,
>> > >>>> where to
>> > >>>> > put
>> > >>>> > > > these files and how to handle them. For the moment, I
have
>> > >>>> created a
>> > >>>> > > > symbolic link between the directory containing my data
and
>> the
>> > >>>> > directory
>> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in the config
>> directory
>> > >>>> and
>> > >>>> > also
>> > >>>> > > > in bin. I modify the test_grid_stat.sh and I left it
in the
>> > >>>> examples
>> > >>>> > > > directory. When I run in bin following the command you
sent
>> me,
>> > I
>> > >>>> have
>> > >>>> > > > these errors.
>> > >>>> > > >
>> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > >>>> > > >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
>> > >>>> > > >
>> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
>> > >>>> > > >
>> > >>>> > > > Usage: grid_stat
>> > >>>> > > > fcst_file
>> > >>>> > > > obs_file
>> > >>>> > > > config_file
>> > >>>> > > > [-outdir path]
>> > >>>> > > > [-log file]
>> > >>>> > > > [-v level]
>> > >>>> > > > [-compress level]
>> > >>>> > > >
>> > >>>> > > > where "fcst_file" is a gridded forecast file
>> > containing
>> > >>>> the
>> > >>>> > > > field(s) to be verified (required).
>> > >>>> > > > "obs_file" is a gridded observation
file
>> > >>>> containing the
>> > >>>> > > > verifying field(s) (required).
>> > >>>> > > > "config_file" is a GridStatConfig file
>> > containing
>> > >>>> the
>> > >>>> > > > desired configuration settings (required).
>> > >>>> > > > "-outdir path" overrides the default
output
>> > >>>> directory
>> > >>>> > (.)
>> > >>>> > > > (optional).
>> > >>>> > > > "-log file" outputs log messages to
the
>> > specified
>> > >>>> file
>> > >>>> > > > (optional).
>> > >>>> > > > "-v level" overrides the default level
of
>> > logging
>> > >>>> (2)
>> > >>>> > > > (optional).
>> > >>>> > > > "-compress level" overrides the
compression
>> > level
>> > >>>> of
>> > >>>> > > NetCDF
>> > >>>> > > > variable (0) (optional).
>> > >>>> > > >
>> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > >>>> > > >
>> > >>>> > > > Here is my test_grid_stat.sh file
>> > >>>> > > > Cordially Dores.
>> > >>>> > > >
>> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via
RT <
>> > >>>> > > met_help at ucar.edu
>> > >>>> > > > >
>> > >>>> > > > a écrit :
>> > >>>> > > >
>> > >>>> > > > > Das,
>> > >>>> > > > >
>> > >>>> > > > > Good news. It is very easy to configure Grid-Stat
to
>> compute
>> > >>>> 2x2
>> > >>>> > > > > contingency tables. We just need to edit the config
file
>> > to...
>> > >>>> > > > > (1) Define the categorical thresholds that should be
>> applied
>> > >>>> > > (cat_thresh
>> > >>>> > > > =
>> > >>>> > > > > [ >20, >30, >40, >50 ];)
>> > >>>> > > > > (2) Turn on the CTC and CTS output line types (ctc =
BOTH;
>> > cts =
>> > >>>> > BOTH;)
>> > >>>> > > > >
>> > >>>> > > > > You can of course change those thresholds however
you'd
>> like.
>> > >>>> Here
>> > >>>> > are
>> > >>>> > > > > more commands to illustrate this:
>> > >>>> > > > >
>> > >>>> > > > > # Pull sample data from ftp site
>> > >>>> > > > > wget
>> > >>>> > > > >
>> > >>>> > > > >
>> > >>>> > > >
>> > >>>> > >
>> > >>>> >
>> > >>>>
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>> > >>>> > > > > wget
>> > >>>> > > > >
>> > >>>> > > > >
>> > >>>> > > >
>> > >>>> > >
>> > >>>> >
>> > >>>>
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>> > >>>> > > > > wget
>> > >>>> > >
>> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
>> > >>>> > > > > GridStatConfig_pw
>> > >>>> > > > >
>> > >>>> > > > > # Create output directory and run Grid-Stat
>> > >>>> > > > > mkdir -p out
>> > >>>> > > > > export VXTIME=2018071900
>> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
>> ERAI_pw.nc
>> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
>> > >>>> > > > >
>> > >>>> > > > > Then take a look at the output files:
>> > >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
>> > >>>> > > > >
>> > >>>> > > > > The _ctc.txt file contains the counts for the 2x2
>> contingency
>> > >>>> table
>> > >>>> > for
>> > >>>> > > > > each of the 4 thresholds we specified.
>> > >>>> > > > >
>> > >>>> > > > > Hope this helps get you going.
>> > >>>> > > > >
>> > >>>> > > > > Thanks,
>> > >>>> > > > > John
>> > >>>> > > > >
>> > >>>> > > > >
>> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini
via RT <
>> > >>>> > > > > met_help at ucar.edu>
>> > >>>> > > > > wrote:
>> > >>>> > > > >
>> > >>>> > > > > > hello John,
>> > >>>> > > > > > Excuse me, I beg you, to bother you.
>> > >>>> > > > > > I created a symbolic link between my data and the
>> > pcp-combines
>> > >>>> > > > > directory. I
>> > >>>> > > > > > used test_grid_stat.sh which I modified. I compile
it, it
>> > did
>> > >>>> not
>> > >>>> > > > produce
>> > >>>> > > > > > anything. I tried the command lines you sent me
and I get
>> > the
>> > >>>> > errors
>> > >>>> > > I
>> > >>>> > > > > sent
>> > >>>> > > > > > you. I really have no idea to get me out. I beg
you,
>> please,
>> > >>>> to
>> > >>>> > help
>> > >>>> > > > me.
>> > >>>> > > > > > Attaching my test_grid_stat.sh file.
>> > >>>> > > > > >
>> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini <
>> > >>>> > > ngaminidas at gmail.com>
>> > >>>> > > > a
>> > >>>> > > > > > écrit :
>> > >>>> > > > > >
>> > >>>> > > > > > > Hello John,
>> > >>>> > > > > > > I am still unable to pull out my contingency
table
>> (CTC)
>> > >>>> with
>> > >>>> > MET.
>> > >>>> > > I
>> > >>>> > > > > have
>> > >>>> > > > > > > read your email, the user guide, the online
tutorial,
>> but
>> > I
>> > >>>> still
>> > >>>> > > do
>> > >>>> > > > > not
>> > >>>> > > > > > > understand how I should run.
>> > >>>> > > > > > > I see the lines of code:
>> > >>>> > > > > > >
>> > >>>> > > > > > > Use: grid_stat
>> > >>>> > > > > > > fcst_file
>> > >>>> > > > > > > obs_file
>> > >>>> > > > > > > config_file
>> > >>>> > > > > > > [-outdir path]
>> > >>>> > > > > > > [-log file]
>> > >>>> > > > > > > [-v level]
>> > >>>> > > > > > > [-compress level]
>> > >>>> > > > > > >
>> > >>>> > > > > > > And, I do not know where I have to write them.
>> > >>>> > > > > > > I see your run command lines:
>> > >>>> > > > > > >
>> > >>>> > > > > > > * mkdir -p out *
>> > >>>> > > > > > > * setenv VXTIME "2018071900" *
>> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
>> > >>>> wrfout_19_2.nc <
>> > >>>> > > > > > > http://wrfout_19_2.nc>
>> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3 *
>> > >>>> > > > > > >
>> > >>>> > > > > > > "setenv" did not give, I had to install
"getenv".
>> > >>>> > > > > > >
>> > >>>> > > > > > > Command 'setenv' not found, did you mean:
>> > >>>> > > > > > >
>> > >>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
>> > >>>> > > > > > >
>> > >>>> > > > > > > See 'snap info <snapname>' for additional
versions.
>> > >>>> > > > > > >
>> > >>>> > > > > > > But when I try to run, I have errors:
>> > >>>> > > > > > >
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
>> "2018071900"
>> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
>> <project_name>]
>> > >>>> [-s
>> > >>>> > > > > > > <source_dir>]
>> > >>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
>> 2018071900
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $
>> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>> > >>>> > > > > > > bash: syntax error near unexpected `newline '
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $
>> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > >>>> > > > > > > wrfout_19_2.nc
>> > >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No
such file
>> or
>> > >>>> > directory
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $
>> > >>>> > > > > > >
>> > >>>> > > > > >
>> > >>>> > > > >
>> > >>>> > > >
>> > >>>> > >
>> > >>>> >
>> > >>>>
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
>> > >>>> > > > > > > .nc
>> > >>>> > > > > > > bash:
>> > >>>> > > > > > >
>> > >>>> > > > > >
>> > >>>> > > > >
>> > >>>> > > >
>> > >>>> > >
>> > >>>> >
>> > >>>>
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
>> > >>>> > > > > > > Is a directory
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $
>> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
>> > >>>> > > > > > > bash: syntax error near unexpected `newline '
>> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
>> MET /
>> > >>>> 8.1 /
>> > >>>> > > > > met-8.1.1
>> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
>> GridStatConfig_pw
>> > >>>> > -outdir
>> > >>>> > > > out
>> > >>>> > > > > > -v 3
>> > >>>> > > > > > > ERAI_pw.nc: command not found
>> > >>>> > > > > > >
>> > >>>> > > > > > > Can you please, send me your execution script.
>> > >>>> > > > > > > I may not be performing them properly. Please
help me.
>> I'm
>> > >>>> lost.
>> > >>>> > > > > > >
>> > >>>> > > > > > > Best regards
>> > >>>> > > > > > > Dores
>> > >>>> > > > > > >
>> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores Ngamini
<
>> > >>>> > > > ngaminidas at gmail.com>
>> > >>>> > > > > a
>> > >>>> > > > > > > écrit :
>> > >>>> > > > > > >
>> > >>>> > > > > > >> Thank you very much.
>> > >>>> > > > > > >>
>> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley
Gotway via
>> RT <
>> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
>> > >>>> > > > > > >>
>> > >>>> > > > > > >>> Dores,
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> OK, great. Thanks for sending some sample
data.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> When getting started with new datasets in MET,
I
>> always
>> > >>>> start
>> > >>>> > by
>> > >>>> > > > > > running
>> > >>>> > > > > > >>> the plot_data_plane tool to make sure MET can
read
>> the
>> > >>>> data and
>> > >>>> > > > place
>> > >>>> > > > > > it
>> > >>>> > > > > > >>> on
>> > >>>> > > > > > >>> the earth correctly.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF
format, and
>> MET
>> > >>>> can
>> > >>>> > > easily
>> > >>>> > > > > > read
>> > >>>> > > > > > >>> that:
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
>> **ERAI_pw.nc
>> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
>> > >>>> > level="(2018071900,*,*)";'
>> > >>>> > > -v
>> > >>>> > > > > 4*
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Next for the WRF output. When I try passing
it to
>> MET
>> > >>>> > directly,
>> > >>>> > > I
>> > >>>> > > > > get
>> > >>>> > > > > > an
>> > >>>> > > > > > >>> error message:
>> > >>>> > > > > > >>> ERROR : plot_data_plane -> file
"wrfout_19_2.nc"
>> not a
>> > >>>> valid
>> > >>>> > > data
>> > >>>> > > > > > file
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> However, since this is on a lat/lon grid, we
can just
>> > >>>> tell MET
>> > >>>> > to
>> > >>>> > > > > > >>> interpret
>> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like this
>> "file_type =
>> > >>>> > > > > NETCDF_NCCF;":
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **
>> > >>>> wrfout_19_2.nc
>> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
wrfout_pw_2018071900.ps
>> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps> **'name="pw";
>> > >>>> > > > > > level="(2018071900,*,*)";
>> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> PNG versions of the resulting images are
attached.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Looking at these images, we see that MET is
able to
>> read
>> > >>>> data
>> > >>>> > > from
>> > >>>> > > > > > them.
>> > >>>> > > > > > >>> And I'll leave it to you to confirm that MET
is
>> placing
>> > >>>> them in
>> > >>>> > > the
>> > >>>> > > > > > right
>> > >>>> > > > > > >>> spot on earth, but I assume it is.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
statistics on
>> them.
>> > >>>> I've
>> > >>>> > > set
>> > >>>> > > > up
>> > >>>> > > > > > the
>> > >>>> > > > > > >>> attached Grid-Stat config file to...
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model domain
using
>> the
>> > >>>> budget
>> > >>>> > > > > > >>> interpolation
>> > >>>> > > > > > >>> method
>> > >>>> > > > > > >>> regrid = {
>> > >>>> > > > > > >>> to_grid = FCST;
>> > >>>> > > > > > >>> method = BUDGET;
>> > >>>> > > > > > >>> width = 2;
>> > >>>> > > > > > >>> vld_thresh = 0.5;
>> > >>>> > > > > > >>> shape = SQUARE;
>> > >>>> > > > > > >>> }
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> (2) Transfer the config options from the
>> plot_data_plane
>> > >>>> > command
>> > >>>> > > > line
>> > >>>> > > > > > to
>> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
convenience,
>> I
>> > >>>> defined
>> > >>>> > > the
>> > >>>> > > > > time
>> > >>>> > > > > > >>> as
>> > >>>> > > > > > >>> an environment variable named $VXTIME:
>> > >>>> > > > > > >>> fcst = {
>> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
>> > >>>> > > > > > >>> field = [ { name = "pw"; level= [
>> > >>>> "(${VXTIME},*,*)" ];
>> > >>>> > }
>> > >>>> > > ];
>> > >>>> > > > > > >>> }
>> > >>>> > > > > > >>> obs = {
>> > >>>> > > > > > >>> field = [ { name = "tcw"; level= [
>> > >>>> "(${VXTIME},*,*)" ];
>> > >>>> > }
>> > >>>> > > ];
>> > >>>> > > > > > >>> }
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> (3) Compute stats over the FULL model domain.
>> > >>>> > > > > > >>> mask = {
>> > >>>> > > > > > >>> grid = [ "FULL" ];
>> > >>>> > > > > > >>> poly = [];
>> > >>>> > > > > > >>> }
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> (4) And just compute continuous stats.
>> > >>>> > > > > > >>> output_flag = {
>> > >>>> > > > > > >>> ...
>> > >>>> > > > > > >>> cnt = BOTH;
>> > >>>> > > > > > >>> ...
>> > >>>> > > > > > >>> }
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Finally, run Grid-Stat on the command line
like this:
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> *mkdir -p out*
>> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
>> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc <
>> > >>>> > > > > > >>> http://wrfout_19_2.nc>
>> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v 3*
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> And that run successfully and creates output
files:
>> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
>> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
>> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for example,
the RMSE
>> > >>>> value =
>> > >>>> > > > 3.39378.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Hope this helps get you up and running with
MET.
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> Thanks,
>> > >>>> > > > > > >>> John Halley Gotway
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores
Ngamini
>> via
>> > RT
>> > >>>> <
>> > >>>> > > > > > >>> met_help at ucar.edu>
>> > >>>> > > > > > >>> wrote:
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>> > <URL:
>> > >>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > >>>> > > >
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>> > Hello John,
>> > >>>> > > > > > >>> > I have already sent my data to my ftp site.
In
>> these
>> > >>>> files, I
>> > >>>> > > > want
>> > >>>> > > > > to
>> > >>>> > > > > > >>> > extract the pw. There is another missing
ERAI file.
>> > That
>> > >>>> > one, I
>> > >>>> > > > > have
>> > >>>> > > > > > >>> > trouble sending it. It contains the relative
>> humidity
>> > >>>> and
>> > >>>> > wind
>> > >>>> > > > > data.
>> > >>>> > > > > > >>> > Please,
>> > >>>> > > > > > >>> > just tell me how to do it because I can not
send
>> this
>> > >>>> file.
>> > >>>> > > There
>> > >>>> > > > > are
>> > >>>> > > > > > >>> two
>> > >>>> > > > > > >>> > wrfout files because my forecasts are made
over 24
>> > >>>> hours or
>> > >>>> > > more.
>> > >>>> > > > > My
>> > >>>> > > > > > >>> raw
>> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can not send
them.
>> > >>>> That's
>> > >>>> > why I
>> > >>>> > > > > sent
>> > >>>> > > > > > >>> those
>> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for the
other
>> files
>> > to
>> > >>>> be
>> > >>>> > > sent,
>> > >>>> > > > > the
>> > >>>> > > > > > >>> time
>> > >>>> > > > > > >>> > to deposit my memory will expire.
>> > >>>> > > > > > >>> > Thank you very much for helping me.
>> > >>>> > > > > > >>> > Yours sincerely.
>> > >>>> > > > > > >>> > Dores
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley
Gotway
>> via
>> > RT
>> > >>>> <
>> > >>>> > > > > > >>> met_help at ucar.edu
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > a écrit :
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>> > > Dores,
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > Were you able to post any data to the ftp
site?
>> You
>> > >>>> could
>> > >>>> > > try
>> > >>>> > > > > > >>> sending
>> > >>>> > > > > > >>> > via
>> > >>>> > > > > > >>> > > email but I worry that the data files will
be too
>> > >>>> large to
>> > >>>> > > > > transfer
>> > >>>> > > > > > >>> that
>> > >>>> > > > > > >>> > > way.
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > Stephen is right... you need to put the
files
>> one by
>> > >>>> way.
>> > >>>> > By
>> > >>>> > > > way
>> > >>>> > > > > > of
>> > >>>> > > > > > >>> > > example, here are commands to create a
file named
>> > >>>> > > > hello_world.txt
>> > >>>> > > > > > and
>> > >>>> > > > > > >>> > post
>> > >>>> > > > > > >>> > > it to our ftp site.
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > cd /home/johnhg
>> > >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
>> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
>> > >>>> > > > > > >>> > > username = anonymous
>> > >>>> > > > > > >>> > > password = "my email address"
>> > >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
>> > >>>> > > > > > >>> > > put hello_world.txt
>> > >>>> > > > > > >>> > > bye
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > And then checking the ftp via a web
browser:
>> > >>>> > > > > > >>> > >
>> > >>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > I see that file now exists. Just be sure
that
>> > you're
>> > >>>> in
>> > >>>> > the
>> > >>>> > > > > > >>> directory
>> > >>>> > > > > > >>> > > which contains the files you want to send
before
>> > >>>> running
>> > >>>> > ftp.
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > Thanks,
>> > >>>> > > > > > >>> > > John
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen
Dowdy via
>> > RT <
>> > >>>> > > > > > >>> met_help at ucar.edu>
>> > >>>> > > > > > >>> > > wrote:
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > > <URL:
>> > >>>> > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > >>>> > > > > >
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > > John,
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket from
Dores
>> > into
>> > >>>> this
>> > >>>> > > > ticket
>> > >>>> > > > > > >>> with
>> > >>>> > > > > > >>> > > > explanation of what i think the problem
is
>> > >>>> (specifying
>> > >>>> > full
>> > >>>> > > > > paths
>> > >>>> > > > > > >>> on
>> > >>>> > > > > > >>> > the
>> > >>>> > > > > > >>> > > > files w/o telling the FTP server to
rename to
>> > >>>> non-pathed
>> > >>>> > > > > > filename.
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > > If you want, it might be helpful to add
>> something
>> > >>>> about
>> > >>>> > > that
>> > >>>> > > > to
>> > >>>> > > > > > >>> your
>> > >>>> > > > > > >>> > Met
>> > >>>> > > > > > >>> > > > Help FTP upload page.
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > > > thanks,
>> > >>>> > > > > > >>> > > > --stephen
>> > >>>> > > > > > >>> > > >
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> > >
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>> >
>> > >>>> > > > > > >>>
>> > >>>> > > > > > >>>
>> > >>>> > > > > >
>> > >>>> > > > > >
>> > >>>> > > > >
>> > >>>> > > > >
>> > >>>> > > >
>> > >>>> > > >
>> > >>>> > >
>> > >>>> > >
>> > >>>> >
>> > >>>> >
>> > >>>>
>> > >>>>
>> >
>> >
>>
>>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Mon Nov 04 09:28:18 2019
Dores,
I see that you are getting the following error message:
*ERROR : MetNcCFDataFile::open(const char *) -> unable to open NetCDF
file
"wrfout_20_2.nc <http://wrfout_20_2.nc>"*
Of course there is not enough information in that single ERROR message
line
to diagnose the source of the problem. Looking back at the history on
this
ticket, I see that you've sent me two wrfout files, named
"wrfout_19_2.nc"
and "wrfout_25_2.nc". I do not have the file named wrfout_20_2.nc
which is
the source of the problem.
But I'm making the assumption here that wrfout_20_2.nc is formatted
*exactly* the same way as wrfout_19_2.nc but just contains different
dates. So demonstrating that the MET software can run on
wrfout_19_2.nc
should be sufficient. If those two files are formatted differently,
then
you should figure out why and fix that issue.
No, I am not able to process this data for you. The MET-Help email
support
is intended to answer clarifying questions and point users in the
right
direction. But we do not have the time or funding to support users at
the
level you're requesting.
Let me demonstrate how I am able to run grid_stat to compare the files
wrfout_19_2.nc and ERAI_pw.nc. And that should give you enough
information
to run grid_stat yourself on the other data. Please copy and paste
the
following commands (of course you'll need to update the path to the
grid_stat executable):
*wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
<ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc>*
*wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
<ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw>*
*wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
<ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc>*
*mkdir out*
*setenv VXTIME "20180719"*
*/usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<http://wrfout_19_2.nc>
ERAI_pw.nc GridStatConfig_pw -outdir out*
I've attached a tarball of the resulting output files "out.tar.gz".
Notice
that I set VXTIME to "20180719" for the file named wrfout_19_2.nc.
Your
wrfout_20_2.nc will contain data starting on the "20180720". So you
should
change the VXTIME environment variable to match the timestamps of the
data
you're processing.
John
On Sun, Nov 3, 2019 at 10:29 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John
> Since my gridstat tool is not running, can you please run it for me
and
> send me the .txt, .stat output files? I have 6 wrfout left to
execute. If
> you agree, I send you the other files.
> However, I would like if possible to execute myself. That is why I
ask you
> to look very carefully at the errors I am getting and to propose a
> solution.
> Attached is the type of error obtained for each data, including
> wrfout_19_2.nc which gave first and the files used.
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> VXTIME=2018072000
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> DEBUG 1: Default Config File:
>
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_pw
> ERROR :
> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF file
> "
> wrfout_20_2.nc"
> ERROR :
> ERROR :
> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening file
> "wrfout_20_2.nc"
> ERROR :
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>
> Thank you in advance
> Dorès
>
>
> Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
> > Hello John,
> > Thank you for your reply.
> > ncdump -h wrfout_20_2.nc gives all the variables normally.
However,
> > plot_data_plane does not run. At this point, grid_stat is not
running any
> > of my wrf output files, not even wrfout_19_2.nc that was working
first.
> > Thank you in advance
> > Dorès
> >
> > Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT <
> met_help at ucar.edu>
> > a écrit :
> >
> >> Dores,
> >>
> >> In the GridStatConfig_pw file, we requested data from the
> >> forecast/observation files as shown below. Note that we used an
> >> environment variable named "VXTIME" to define the timestamp of
the data
> we
> >> want to retrieve:
> >>
> >> fcst = {
> >> file_type = NETCDF_NCCF;
> >> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ]; }
];
> >> }
> >> obs = {
> >> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ]; }
];
> >> }
> >>
> >> You indicated that the script worked fine for the WRF file named
"
> >> wrfout_19_2.nc" but errors out when processing "wrfout_20_2.nc".
> >> Presumably the timestamps differ between these two files. I
suggest
> that
> >> you:
> >>
> >> (1) Make sure that wrfout_20_2.nc exists and is a valid NetCDF
file
> (run
> >> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
results).
> >> (2) Set the VXTIME environment variable to a timestamp which
actually
> >> exists in that file.
> >> (3) Run plot_data_plane to confirm that MET processes this data
fine.
> For
> >> example:
> >>
> >>
> >> *setenv VXTIME 20180725*
> >> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
> >> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)"; file_type
=
> >> NETCDF_NCCF;' -v 4*
> >>
> >> Thanks,
> >> John
> >>
> >> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
> >> met_help at ucar.edu>
> >> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >> >
> >> > Hello John,
> >> > Please, help me to run grid_stat for my another wrfout files. I
don't
> >> know
> >> > what to change in the files I used to run the first wrfout.
> >> >
> >> > Cordially
> >> > Dorès
> >> >
> >> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini
<ngaminidas at gmail.com
> >
> >> a
> >> > écrit :
> >> >
> >> > > Hello John,
> >> > > I use the same config file and the same test_grid_stat.sh
file.
> >> > >
> >> > >
> >> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <
> ngaminidas at gmail.com>
> >> a
> >> > > écrit :
> >> > >
> >> > >> Hello John,
> >> > >> Another problem that I have now is I am not able to run
another
> >> wrfout
> >> > >> with the same command. What should I change? I have several
wrfout
> >> files
> >> > >> that I want to fill the CTC.
> >> > >> Here the error that I have.
> >> > >>
> >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> >> > >> DEBUG 1: Default Config File:
> >> > >>
> >> >
> >>
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> >> > >> DEBUG 1: User Config File: GridStatConfig_pw
> >> > >> ERROR :
> >> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable to
open
> NetCDF
> >> > >> file "wrfout_20_2.nc"
> >> > >> ERROR :
> >> > >> ERROR :
> >> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() ->
error
> >> opening
> >> > >> file "wrfout_20_2.nc"
> >> > >> ERROR :
> >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> > >>
> >> > >> Best regards
> >> > >> Dorès
> >> > >>
> >> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
> >> ngaminidas at gmail.com>
> >> > a
> >> > >> écrit :
> >> > >>
> >> > >>> Hello John,
> >> > >>> FCST_VALID_BEG = 20180719_000000
> >> > >>> FCST_VALID_END = 20180719_000000
> >> > >>> It is the same for OBS.
> >> > >>> I want to have
> >> > >>> FCST_VALID_BEG = 20180719_000000
> >> > >>> FCST_VALID_END = 20180726_000000
> >> > >>>
> >> > >>> My another problem is how to cite MET.
> >> > >>>
> >> > >>> Cordially
> >> > >>> Dorès
> >> > >>>
> >> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
> >> > >>> met_help at ucar.edu> a écrit :
> >> > >>>
> >> > >>>> Dores,
> >> > >>>>
> >> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
information
> is
> >> > >>>> extracted from the metadata of the data files. And that
timing
> >> > >>>> information
> >> > >>>> is written to the header columns of the output files.
There is,
> in
> >> > >>>> general, no easy way of modifying the timing information
of the
> >> data
> >> > >>>> you're
> >> > >>>> processing.
> >> > >>>>
> >> > >>>> And I don't really understand why you would want to change
that
> >> timing
> >> > >>>> info.
> >> > >>>>
> >> > >>>> We actually do have a development issue defined that would
enable
> >> this
> >> > >>>> in
> >> > >>>> the future, but that work has not been done yet.
> >> > >>>> https://github.com/NCAR/MET/issues/1020
> >> > >>>>
> >> > >>>> Thanks,
> >> > >>>> John
> >> > >>>>
> >> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT <
> >> > >>>> met_help at ucar.edu>
> >> > >>>> wrote:
> >> > >>>>
> >> > >>>> >
> >> > >>>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >
> >> > >>>> >
> >> > >>>> > Hello John,
> >> > >>>> > Thanks a lot for your help.
> >> > >>>> > I can already see something interesting. But, I have
another
> >> > problem.
> >> > >>>> I
> >> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
> >> > OBS_LEAD
> >> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to
find them
> >> and
> >> > >>>> how to
> >> > >>>> > take them into account when running. I predict 24 hours
to 144
> >> hours
> >> > >>>> (0 to
> >> > >>>> > 6 days). Please help me.
> >> > >>>> >
> >> > >>>> > Thank you in advance.
> >> > >>>> >
> >> > >>>> > Dorès
> >> > >>>> >
> >> > >>>> >
> >> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via RT
<
> >> > >>>> met_help at ucar.edu
> >> > >>>> > >
> >> > >>>> > a écrit :
> >> > >>>> >
> >> > >>>> > > Dores,
> >> > >>>> > >
> >> > >>>> > > It looks like you're running Grid-Stat in this way:
> >> > >>>> > >
> >> > >>>> > >
> >> > >>>> > >
> >> > >>>> > > *dores at dores
> >> > >>>> > >
> >> > >>>> >
> >> > >>>>
> >> >
> >>
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> >> > >>>> > > grid_statwrfout_19_2.nc
> >> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> >> > >>>> > >
> >> > >>>> > > And Grid-Stat is printing out the usage statement to
indicate
> >> that
> >> > >>>> you
> >> > >>>> > have
> >> > >>>> > > provided the correct input arguments.
> >> > >>>> > >
> >> > >>>> > > Grid-Stat has 3 required arguments on the command
line:
> >> > >>>> > > (1) the path to the forecast file
> >> > >>>> > > (2) the path to the observation file
> >> > >>>> > > (3) the path the grid_stat configuration file
> >> > >>>> > >
> >> > >>>> > > You have provided the first 2 but not the 3rd. Please
try
> >> running
> >> > >>>> > > grid_stat will all 3 required arguments:
> >> > >>>> > >
> >> > >>>> > >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> >> > >>>> > >
> >> > >>>> > > And there is no requirement for the directory
structure to be
> >> > >>>> used. You
> >> > >>>> > > can either provide the full absolute path the the
input
> files,
> >> or
> >> > >>>> the
> >> > >>>> > > relative path. If these files are all in your current
> working
> >> > >>>> directory,
> >> > >>>> > > you just list the filenames.
> >> > >>>> > >
> >> > >>>> > > John
> >> > >>>> > >
> >> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini via
RT <
> >> > >>>> > > met_help at ucar.edu>
> >> > >>>> > > wrote:
> >> > >>>> > >
> >> > >>>> > > >
> >> > >>>> > > > <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >> > >>>> > > >
> >> > >>>> > > > Hello John,
> >> > >>>> > > > Excuse me for not understanding. I would like to
> interpolate
> >> on
> >> > >>>> the
> >> > >>>> > grid
> >> > >>>> > > > points in order to also have the "RMSE" and the
"Pearson
> >> > >>>> correlation
> >> > >>>> > > > coefficient" in addition to the contingency table.
For this
> >> > fact,
> >> > >>>> I put
> >> > >>>> > > > ctc, cts and cnt at BOTH.
> >> > >>>> > > > But, my problem remains the same: how do I execute
my
> >> grid-stat
> >> > >>>> and in
> >> > >>>> > > what
> >> > >>>> > > > directory. In fact, I would like to know which files
to
> use,
> >> > >>>> where to
> >> > >>>> > put
> >> > >>>> > > > these files and how to handle them. For the moment,
I have
> >> > >>>> created a
> >> > >>>> > > > symbolic link between the directory containing my
data and
> >> the
> >> > >>>> > directory
> >> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in the
config
> >> directory
> >> > >>>> and
> >> > >>>> > also
> >> > >>>> > > > in bin. I modify the test_grid_stat.sh and I left it
in the
> >> > >>>> examples
> >> > >>>> > > > directory. When I run in bin following the command
you sent
> >> me,
> >> > I
> >> > >>>> have
> >> > >>>> > > > these errors.
> >> > >>>> > > >
> >> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> > >>>> > > >
> >> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> >> > >>>> > > >
> >> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> >> > >>>> > > >
> >> > >>>> > > > Usage: grid_stat
> >> > >>>> > > > fcst_file
> >> > >>>> > > > obs_file
> >> > >>>> > > > config_file
> >> > >>>> > > > [-outdir path]
> >> > >>>> > > > [-log file]
> >> > >>>> > > > [-v level]
> >> > >>>> > > > [-compress level]
> >> > >>>> > > >
> >> > >>>> > > > where "fcst_file" is a gridded forecast
file
> >> > containing
> >> > >>>> the
> >> > >>>> > > > field(s) to be verified (required).
> >> > >>>> > > > "obs_file" is a gridded observation
file
> >> > >>>> containing the
> >> > >>>> > > > verifying field(s) (required).
> >> > >>>> > > > "config_file" is a GridStatConfig
file
> >> > containing
> >> > >>>> the
> >> > >>>> > > > desired configuration settings (required).
> >> > >>>> > > > "-outdir path" overrides the default
output
> >> > >>>> directory
> >> > >>>> > (.)
> >> > >>>> > > > (optional).
> >> > >>>> > > > "-log file" outputs log messages to
the
> >> > specified
> >> > >>>> file
> >> > >>>> > > > (optional).
> >> > >>>> > > > "-v level" overrides the default
level of
> >> > logging
> >> > >>>> (2)
> >> > >>>> > > > (optional).
> >> > >>>> > > > "-compress level" overrides the
compression
> >> > level
> >> > >>>> of
> >> > >>>> > > NetCDF
> >> > >>>> > > > variable (0) (optional).
> >> > >>>> > > >
> >> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> > >>>> > > >
> >> > >>>> > > > Here is my test_grid_stat.sh file
> >> > >>>> > > > Cordially Dores.
> >> > >>>> > > >
> >> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway via
RT <
> >> > >>>> > > met_help at ucar.edu
> >> > >>>> > > > >
> >> > >>>> > > > a écrit :
> >> > >>>> > > >
> >> > >>>> > > > > Das,
> >> > >>>> > > > >
> >> > >>>> > > > > Good news. It is very easy to configure Grid-Stat
to
> >> compute
> >> > >>>> 2x2
> >> > >>>> > > > > contingency tables. We just need to edit the
config file
> >> > to...
> >> > >>>> > > > > (1) Define the categorical thresholds that should
be
> >> applied
> >> > >>>> > > (cat_thresh
> >> > >>>> > > > =
> >> > >>>> > > > > [ >20, >30, >40, >50 ];)
> >> > >>>> > > > > (2) Turn on the CTC and CTS output line types (ctc
=
> BOTH;
> >> > cts =
> >> > >>>> > BOTH;)
> >> > >>>> > > > >
> >> > >>>> > > > > You can of course change those thresholds however
you'd
> >> like.
> >> > >>>> Here
> >> > >>>> > are
> >> > >>>> > > > > more commands to illustrate this:
> >> > >>>> > > > >
> >> > >>>> > > > > # Pull sample data from ftp site
> >> > >>>> > > > > wget
> >> > >>>> > > > >
> >> > >>>> > > > >
> >> > >>>> > > >
> >> > >>>> > >
> >> > >>>> >
> >> > >>>>
> >> >
> >>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> >> > >>>> > > > > wget
> >> > >>>> > > > >
> >> > >>>> > > > >
> >> > >>>> > > >
> >> > >>>> > >
> >> > >>>> >
> >> > >>>>
> >> >
> >>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> >> > >>>> > > > > wget
> >> > >>>> > >
> >> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> >> > >>>> > > > > GridStatConfig_pw
> >> > >>>> > > > >
> >> > >>>> > > > > # Create output directory and run Grid-Stat
> >> > >>>> > > > > mkdir -p out
> >> > >>>> > > > > export VXTIME=2018071900
> >> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
> >> ERAI_pw.nc
> >> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
> >> > >>>> > > > >
> >> > >>>> > > > > Then take a look at the output files:
> >> > >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> >> > >>>> > > > >
> >> > >>>> > > > > The _ctc.txt file contains the counts for the 2x2
> >> contingency
> >> > >>>> table
> >> > >>>> > for
> >> > >>>> > > > > each of the 4 thresholds we specified.
> >> > >>>> > > > >
> >> > >>>> > > > > Hope this helps get you going.
> >> > >>>> > > > >
> >> > >>>> > > > > Thanks,
> >> > >>>> > > > > John
> >> > >>>> > > > >
> >> > >>>> > > > >
> >> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores Ngamini
via RT
> <
> >> > >>>> > > > > met_help at ucar.edu>
> >> > >>>> > > > > wrote:
> >> > >>>> > > > >
> >> > >>>> > > > > > hello John,
> >> > >>>> > > > > > Excuse me, I beg you, to bother you.
> >> > >>>> > > > > > I created a symbolic link between my data and
the
> >> > pcp-combines
> >> > >>>> > > > > directory. I
> >> > >>>> > > > > > used test_grid_stat.sh which I modified. I
compile it,
> it
> >> > did
> >> > >>>> not
> >> > >>>> > > > produce
> >> > >>>> > > > > > anything. I tried the command lines you sent me
and I
> get
> >> > the
> >> > >>>> > errors
> >> > >>>> > > I
> >> > >>>> > > > > sent
> >> > >>>> > > > > > you. I really have no idea to get me out. I beg
you,
> >> please,
> >> > >>>> to
> >> > >>>> > help
> >> > >>>> > > > me.
> >> > >>>> > > > > > Attaching my test_grid_stat.sh file.
> >> > >>>> > > > > >
> >> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores Ngamini
<
> >> > >>>> > > ngaminidas at gmail.com>
> >> > >>>> > > > a
> >> > >>>> > > > > > écrit :
> >> > >>>> > > > > >
> >> > >>>> > > > > > > Hello John,
> >> > >>>> > > > > > > I am still unable to pull out my contingency
table
> >> (CTC)
> >> > >>>> with
> >> > >>>> > MET.
> >> > >>>> > > I
> >> > >>>> > > > > have
> >> > >>>> > > > > > > read your email, the user guide, the online
tutorial,
> >> but
> >> > I
> >> > >>>> still
> >> > >>>> > > do
> >> > >>>> > > > > not
> >> > >>>> > > > > > > understand how I should run.
> >> > >>>> > > > > > > I see the lines of code:
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > Use: grid_stat
> >> > >>>> > > > > > > fcst_file
> >> > >>>> > > > > > > obs_file
> >> > >>>> > > > > > > config_file
> >> > >>>> > > > > > > [-outdir path]
> >> > >>>> > > > > > > [-log file]
> >> > >>>> > > > > > > [-v level]
> >> > >>>> > > > > > > [-compress level]
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > And, I do not know where I have to write them.
> >> > >>>> > > > > > > I see your run command lines:
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > * mkdir -p out *
> >> > >>>> > > > > > > * setenv VXTIME "2018071900" *
> >> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin / grid_stat
> >> > >>>> wrfout_19_2.nc <
> >> > >>>> > > > > > > http://wrfout_19_2.nc>
> >> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v 3
*
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > "setenv" did not give, I had to install
"getenv".
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > Command 'setenv' not found, did you mean:
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > See 'snap info <snapname>' for additional
versions.
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > But when I try to run, I have errors:
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
> >> "2018071900"
> >> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
> >> <project_name>]
> >> > >>>> [-s
> >> > >>>> > > > > > > <source_dir>]
> >> > >>>> > > > > > > getenv: error: unrecognized arguments: VXTIME
> >> 2018071900
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $
> >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> >> > >>>> > > > > > > bash: syntax error near unexpected `newline '
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $
> >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> >> > >>>> > > > > > > wrfout_19_2.nc
> >> > >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No
such
> file
> >> or
> >> > >>>> > directory
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $
> >> > >>>> > > > > > >
> >> > >>>> > > > > >
> >> > >>>> > > > >
> >> > >>>> > > >
> >> > >>>> > >
> >> > >>>> >
> >> > >>>>
> >> >
> >>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> >> > >>>> > > > > > > .nc
> >> > >>>> > > > > > > bash:
> >> > >>>> > > > > > >
> >> > >>>> > > > > >
> >> > >>>> > > > >
> >> > >>>> > > >
> >> > >>>> > >
> >> > >>>> >
> >> > >>>>
> >> >
> >>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> >> > >>>> > > > > > > Is a directory
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $
> >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> >> > >>>> > > > > > > bash: syntax error near unexpected `newline '
> >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> >> MET /
> >> > >>>> 8.1 /
> >> > >>>> > > > > met-8.1.1
> >> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
> >> GridStatConfig_pw
> >> > >>>> > -outdir
> >> > >>>> > > > out
> >> > >>>> > > > > > -v 3
> >> > >>>> > > > > > > ERAI_pw.nc: command not found
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > Can you please, send me your execution
script.
> >> > >>>> > > > > > > I may not be performing them properly. Please
help
> me.
> >> I'm
> >> > >>>> lost.
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > Best regards
> >> > >>>> > > > > > > Dores
> >> > >>>> > > > > > >
> >> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores
Ngamini <
> >> > >>>> > > > ngaminidas at gmail.com>
> >> > >>>> > > > > a
> >> > >>>> > > > > > > écrit :
> >> > >>>> > > > > > >
> >> > >>>> > > > > > >> Thank you very much.
> >> > >>>> > > > > > >>
> >> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley
Gotway via
> >> RT <
> >> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
> >> > >>>> > > > > > >>
> >> > >>>> > > > > > >>> Dores,
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> OK, great. Thanks for sending some sample
data.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> When getting started with new datasets in
MET, I
> >> always
> >> > >>>> start
> >> > >>>> > by
> >> > >>>> > > > > > running
> >> > >>>> > > > > > >>> the plot_data_plane tool to make sure MET
can read
> >> the
> >> > >>>> data and
> >> > >>>> > > > place
> >> > >>>> > > > > > it
> >> > >>>> > > > > > >>> on
> >> > >>>> > > > > > >>> the earth correctly.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF
format,
> and
> >> MET
> >> > >>>> can
> >> > >>>> > > easily
> >> > >>>> > > > > > read
> >> > >>>> > > > > > >>> that:
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
> >> **ERAI_pw.nc
> >> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> >> > >>>> > level="(2018071900,*,*)";'
> >> > >>>> > > -v
> >> > >>>> > > > > 4*
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Next for the WRF output. When I try passing
it to
> >> MET
> >> > >>>> > directly,
> >> > >>>> > > I
> >> > >>>> > > > > get
> >> > >>>> > > > > > an
> >> > >>>> > > > > > >>> error message:
> >> > >>>> > > > > > >>> ERROR : plot_data_plane -> file
"wrfout_19_2.nc"
> >> not a
> >> > >>>> valid
> >> > >>>> > > data
> >> > >>>> > > > > > file
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> However, since this is on a lat/lon grid, we
can
> just
> >> > >>>> tell MET
> >> > >>>> > to
> >> > >>>> > > > > > >>> interpret
> >> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like this
> >> "file_type =
> >> > >>>> > > > > NETCDF_NCCF;":
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane **
> >> > >>>> wrfout_19_2.nc
> >> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
wrfout_pw_2018071900.ps
> >> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps>
**'name="pw";
> >> > >>>> > > > > > level="(2018071900,*,*)";
> >> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> PNG versions of the resulting images are
attached.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Looking at these images, we see that MET is
able to
> >> read
> >> > >>>> data
> >> > >>>> > > from
> >> > >>>> > > > > > them.
> >> > >>>> > > > > > >>> And I'll leave it to you to confirm that MET
is
> >> placing
> >> > >>>> them in
> >> > >>>> > > the
> >> > >>>> > > > > > right
> >> > >>>> > > > > > >>> spot on earth, but I assume it is.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
statistics on
> >> them.
> >> > >>>> I've
> >> > >>>> > > set
> >> > >>>> > > > up
> >> > >>>> > > > > > the
> >> > >>>> > > > > > >>> attached Grid-Stat config file to...
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model domain
using
> >> the
> >> > >>>> budget
> >> > >>>> > > > > > >>> interpolation
> >> > >>>> > > > > > >>> method
> >> > >>>> > > > > > >>> regrid = {
> >> > >>>> > > > > > >>> to_grid = FCST;
> >> > >>>> > > > > > >>> method = BUDGET;
> >> > >>>> > > > > > >>> width = 2;
> >> > >>>> > > > > > >>> vld_thresh = 0.5;
> >> > >>>> > > > > > >>> shape = SQUARE;
> >> > >>>> > > > > > >>> }
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> (2) Transfer the config options from the
> >> plot_data_plane
> >> > >>>> > command
> >> > >>>> > > > line
> >> > >>>> > > > > > to
> >> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
> convenience,
> >> I
> >> > >>>> defined
> >> > >>>> > > the
> >> > >>>> > > > > time
> >> > >>>> > > > > > >>> as
> >> > >>>> > > > > > >>> an environment variable named $VXTIME:
> >> > >>>> > > > > > >>> fcst = {
> >> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
> >> > >>>> > > > > > >>> field = [ { name = "pw"; level= [
> >> > >>>> "(${VXTIME},*,*)" ];
> >> > >>>> > }
> >> > >>>> > > ];
> >> > >>>> > > > > > >>> }
> >> > >>>> > > > > > >>> obs = {
> >> > >>>> > > > > > >>> field = [ { name = "tcw"; level= [
> >> > >>>> "(${VXTIME},*,*)" ];
> >> > >>>> > }
> >> > >>>> > > ];
> >> > >>>> > > > > > >>> }
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> (3) Compute stats over the FULL model
domain.
> >> > >>>> > > > > > >>> mask = {
> >> > >>>> > > > > > >>> grid = [ "FULL" ];
> >> > >>>> > > > > > >>> poly = [];
> >> > >>>> > > > > > >>> }
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> (4) And just compute continuous stats.
> >> > >>>> > > > > > >>> output_flag = {
> >> > >>>> > > > > > >>> ...
> >> > >>>> > > > > > >>> cnt = BOTH;
> >> > >>>> > > > > > >>> ...
> >> > >>>> > > > > > >>> }
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Finally, run Grid-Stat on the command line
like
> this:
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> *mkdir -p out*
> >> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
> <
> >> > >>>> > > > > > >>> http://wrfout_19_2.nc>
> >> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out -v
3*
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> And that run successfully and creates output
files:
> >> > >>>> > > > > > >>> DEBUG 1: Output file:
> >> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
> >> > >>>> > > > > > >>> DEBUG 1: Output file:
> >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> >> > >>>> > > > > > >>> DEBUG 1: Output file:
> >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for example,
the
> RMSE
> >> > >>>> value =
> >> > >>>> > > > 3.39378.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Hope this helps get you up and running with
MET.
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> Thanks,
> >> > >>>> > > > > > >>> John Halley Gotway
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores
Ngamini
> >> via
> >> > RT
> >> > >>>> <
> >> > >>>> > > > > > >>> met_help at ucar.edu>
> >> > >>>> > > > > > >>> wrote:
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>> > <URL:
> >> > >>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >> > >>>> > > >
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>> > Hello John,
> >> > >>>> > > > > > >>> > I have already sent my data to my ftp
site. In
> >> these
> >> > >>>> files, I
> >> > >>>> > > > want
> >> > >>>> > > > > to
> >> > >>>> > > > > > >>> > extract the pw. There is another missing
ERAI
> file.
> >> > That
> >> > >>>> > one, I
> >> > >>>> > > > > have
> >> > >>>> > > > > > >>> > trouble sending it. It contains the
relative
> >> humidity
> >> > >>>> and
> >> > >>>> > wind
> >> > >>>> > > > > data.
> >> > >>>> > > > > > >>> > Please,
> >> > >>>> > > > > > >>> > just tell me how to do it because I can
not send
> >> this
> >> > >>>> file.
> >> > >>>> > > There
> >> > >>>> > > > > are
> >> > >>>> > > > > > >>> two
> >> > >>>> > > > > > >>> > wrfout files because my forecasts are made
over
> 24
> >> > >>>> hours or
> >> > >>>> > > more.
> >> > >>>> > > > > My
> >> > >>>> > > > > > >>> raw
> >> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can not
send
> them.
> >> > >>>> That's
> >> > >>>> > why I
> >> > >>>> > > > > sent
> >> > >>>> > > > > > >>> those
> >> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for the
other
> >> files
> >> > to
> >> > >>>> be
> >> > >>>> > > sent,
> >> > >>>> > > > > the
> >> > >>>> > > > > > >>> time
> >> > >>>> > > > > > >>> > to deposit my memory will expire.
> >> > >>>> > > > > > >>> > Thank you very much for helping me.
> >> > >>>> > > > > > >>> > Yours sincerely.
> >> > >>>> > > > > > >>> > Dores
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John Halley
Gotway
> >> via
> >> > RT
> >> > >>>> <
> >> > >>>> > > > > > >>> met_help at ucar.edu
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > a écrit :
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>> > > Dores,
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > Were you able to post any data to the
ftp site?
> >> You
> >> > >>>> could
> >> > >>>> > > try
> >> > >>>> > > > > > >>> sending
> >> > >>>> > > > > > >>> > via
> >> > >>>> > > > > > >>> > > email but I worry that the data files
will be
> too
> >> > >>>> large to
> >> > >>>> > > > > transfer
> >> > >>>> > > > > > >>> that
> >> > >>>> > > > > > >>> > > way.
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > Stephen is right... you need to put the
files
> >> one by
> >> > >>>> way.
> >> > >>>> > By
> >> > >>>> > > > way
> >> > >>>> > > > > > of
> >> > >>>> > > > > > >>> > > example, here are commands to create a
file
> named
> >> > >>>> > > > hello_world.txt
> >> > >>>> > > > > > and
> >> > >>>> > > > > > >>> > post
> >> > >>>> > > > > > >>> > > it to our ftp site.
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > cd /home/johnhg
> >> > >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
> >> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> >> > >>>> > > > > > >>> > > username = anonymous
> >> > >>>> > > > > > >>> > > password = "my email address"
> >> > >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> >> > >>>> > > > > > >>> > > put hello_world.txt
> >> > >>>> > > > > > >>> > > bye
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > And then checking the ftp via a web
browser:
> >> > >>>> > > > > > >>> > >
> >> > >>>> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > I see that file now exists. Just be
sure that
> >> > you're
> >> > >>>> in
> >> > >>>> > the
> >> > >>>> > > > > > >>> directory
> >> > >>>> > > > > > >>> > > which contains the files you want to
send
> before
> >> > >>>> running
> >> > >>>> > ftp.
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > Thanks,
> >> > >>>> > > > > > >>> > > John
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM Stephen
Dowdy
> via
> >> > RT <
> >> > >>>> > > > > > >>> met_help at ucar.edu>
> >> > >>>> > > > > > >>> > > wrote:
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > > <URL:
> >> > >>>> > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> >> > >>>> > > > > >
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > > John,
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket
from
> Dores
> >> > into
> >> > >>>> this
> >> > >>>> > > > ticket
> >> > >>>> > > > > > >>> with
> >> > >>>> > > > > > >>> > > > explanation of what i think the
problem is
> >> > >>>> (specifying
> >> > >>>> > full
> >> > >>>> > > > > paths
> >> > >>>> > > > > > >>> on
> >> > >>>> > > > > > >>> > the
> >> > >>>> > > > > > >>> > > > files w/o telling the FTP server to
rename to
> >> > >>>> non-pathed
> >> > >>>> > > > > > filename.
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > > If you want, it might be helpful to
add
> >> something
> >> > >>>> about
> >> > >>>> > > that
> >> > >>>> > > > to
> >> > >>>> > > > > > >>> your
> >> > >>>> > > > > > >>> > Met
> >> > >>>> > > > > > >>> > > > Help FTP upload page.
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > > > thanks,
> >> > >>>> > > > > > >>> > > > --stephen
> >> > >>>> > > > > > >>> > > >
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> > >
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>> >
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > > >>>
> >> > >>>> > > > > >
> >> > >>>> > > > > >
> >> > >>>> > > > >
> >> > >>>> > > > >
> >> > >>>> > > >
> >> > >>>> > > >
> >> > >>>> > >
> >> > >>>> > >
> >> > >>>> >
> >> > >>>> >
> >> > >>>>
> >> > >>>>
> >> >
> >> >
> >>
> >>
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Tue Nov 05 08:13:22 2019
Hello John
Thank you for your help. I will try again until I have the solution.
Please,
can you tell me how to refer to MET ?
Best regards
Dorès
Le lun. 4 nov. 2019 à 17:28, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> I see that you are getting the following error message:
> *ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF file
> "wrfout_20_2.nc <http://wrfout_20_2.nc>"*
>
> Of course there is not enough information in that single ERROR
message line
> to diagnose the source of the problem. Looking back at the history
on this
> ticket, I see that you've sent me two wrfout files, named
"wrfout_19_2.nc"
> and "wrfout_25_2.nc". I do not have the file named wrfout_20_2.nc
which
> is
> the source of the problem.
>
> But I'm making the assumption here that wrfout_20_2.nc is formatted
> *exactly* the same way as wrfout_19_2.nc but just contains different
> dates. So demonstrating that the MET software can run on
wrfout_19_2.nc
> should be sufficient. If those two files are formatted differently,
then
> you should figure out why and fix that issue.
>
> No, I am not able to process this data for you. The MET-Help email
support
> is intended to answer clarifying questions and point users in the
right
> direction. But we do not have the time or funding to support users
at the
> level you're requesting.
>
> Let me demonstrate how I am able to run grid_stat to compare the
files
> wrfout_19_2.nc and ERAI_pw.nc. And that should give you enough
> information
> to run grid_stat yourself on the other data. Please copy and paste
the
> following commands (of course you'll need to update the path to the
> grid_stat executable):
>
> *wget
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> <
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> >*
>
> *wget
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> <
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> >*
>
> *wget
>
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> <
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> >*
> *mkdir out*
> *setenv VXTIME "20180719"*
> */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc
<http://wrfout_19_2.nc>
> ERAI_pw.nc GridStatConfig_pw -outdir out*
>
> I've attached a tarball of the resulting output files "out.tar.gz".
Notice
> that I set VXTIME to "20180719" for the file named wrfout_19_2.nc.
Your
> wrfout_20_2.nc will contain data starting on the "20180720". So you
> should
> change the VXTIME environment variable to match the timestamps of
the data
> you're processing.
>
> John
>
> On Sun, Nov 3, 2019 at 10:29 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John
> > Since my gridstat tool is not running, can you please run it for
me and
> > send me the .txt, .stat output files? I have 6 wrfout left to
execute. If
> > you agree, I send you the other files.
> > However, I would like if possible to execute myself. That is why I
ask
> you
> > to look very carefully at the errors I am getting and to propose a
> > solution.
> > Attached is the type of error obtained for each data, including
> > wrfout_19_2.nc which gave first and the files used.
> >
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> > VXTIME=2018072000
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > DEBUG 1: Default Config File:
> >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > DEBUG 1: User Config File: GridStatConfig_pw
> > ERROR :
> > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> file
> > "
> > wrfout_20_2.nc"
> > ERROR :
> > ERROR :
> > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> file
> > "wrfout_20_2.nc"
> > ERROR :
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >
> > Thank you in advance
> > Dorès
> >
> >
> > Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> > > Hello John,
> > > Thank you for your reply.
> > > ncdump -h wrfout_20_2.nc gives all the variables normally.
However,
> > > plot_data_plane does not run. At this point, grid_stat is not
running
> any
> > > of my wrf output files, not even wrfout_19_2.nc that was working
> first.
> > > Thank you in advance
> > > Dorès
> > >
> > > Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT <
> > met_help at ucar.edu>
> > > a écrit :
> > >
> > >> Dores,
> > >>
> > >> In the GridStatConfig_pw file, we requested data from the
> > >> forecast/observation files as shown below. Note that we used
an
> > >> environment variable named "VXTIME" to define the timestamp of
the
> data
> > we
> > >> want to retrieve:
> > >>
> > >> fcst = {
> > >> file_type = NETCDF_NCCF;
> > >> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)" ];
} ];
> > >> }
> > >> obs = {
> > >> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)" ];
} ];
> > >> }
> > >>
> > >> You indicated that the script worked fine for the WRF file
named "
> > >> wrfout_19_2.nc" but errors out when processing
"wrfout_20_2.nc".
> > >> Presumably the timestamps differ between these two files. I
suggest
> > that
> > >> you:
> > >>
> > >> (1) Make sure that wrfout_20_2.nc exists and is a valid NetCDF
file
> > (run
> > >> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
results).
> > >> (2) Set the VXTIME environment variable to a timestamp which
actually
> > >> exists in that file.
> > >> (3) Run plot_data_plane to confirm that MET processes this data
fine.
> > For
> > >> example:
> > >>
> > >>
> > >> *setenv VXTIME 20180725*
> > >> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
> > >> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)";
file_type =
> > >> NETCDF_NCCF;' -v 4*
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
> > >> met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> > >> >
> > >> > Hello John,
> > >> > Please, help me to run grid_stat for my another wrfout files.
I
> don't
> > >> know
> > >> > what to change in the files I used to run the first wrfout.
> > >> >
> > >> > Cordially
> > >> > Dorès
> > >> >
> > >> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini <
> ngaminidas at gmail.com
> > >
> > >> a
> > >> > écrit :
> > >> >
> > >> > > Hello John,
> > >> > > I use the same config file and the same test_grid_stat.sh
file.
> > >> > >
> > >> > >
> > >> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <
> > ngaminidas at gmail.com>
> > >> a
> > >> > > écrit :
> > >> > >
> > >> > >> Hello John,
> > >> > >> Another problem that I have now is I am not able to run
another
> > >> wrfout
> > >> > >> with the same command. What should I change? I have
several
> wrfout
> > >> files
> > >> > >> that I want to fill the CTC.
> > >> > >> Here the error that I have.
> > >> > >>
> > >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > >> > >> DEBUG 1: Default Config File:
> > >> > >>
> > >> >
> > >>
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > >> > >> DEBUG 1: User Config File: GridStatConfig_pw
> > >> > >> ERROR :
> > >> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable to
open
> > NetCDF
> > >> > >> file "wrfout_20_2.nc"
> > >> > >> ERROR :
> > >> > >> ERROR :
> > >> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() ->
error
> > >> opening
> > >> > >> file "wrfout_20_2.nc"
> > >> > >> ERROR :
> > >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> > >>
> > >> > >> Best regards
> > >> > >> Dorès
> > >> > >>
> > >> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
> > >> ngaminidas at gmail.com>
> > >> > a
> > >> > >> écrit :
> > >> > >>
> > >> > >>> Hello John,
> > >> > >>> FCST_VALID_BEG = 20180719_000000
> > >> > >>> FCST_VALID_END = 20180719_000000
> > >> > >>> It is the same for OBS.
> > >> > >>> I want to have
> > >> > >>> FCST_VALID_BEG = 20180719_000000
> > >> > >>> FCST_VALID_END = 20180726_000000
> > >> > >>>
> > >> > >>> My another problem is how to cite MET.
> > >> > >>>
> > >> > >>> Cordially
> > >> > >>> Dorès
> > >> > >>>
> > >> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT <
> > >> > >>> met_help at ucar.edu> a écrit :
> > >> > >>>
> > >> > >>>> Dores,
> > >> > >>>>
> > >> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
> information
> > is
> > >> > >>>> extracted from the metadata of the data files. And that
timing
> > >> > >>>> information
> > >> > >>>> is written to the header columns of the output files.
There
> is,
> > in
> > >> > >>>> general, no easy way of modifying the timing information
of the
> > >> data
> > >> > >>>> you're
> > >> > >>>> processing.
> > >> > >>>>
> > >> > >>>> And I don't really understand why you would want to
change that
> > >> timing
> > >> > >>>> info.
> > >> > >>>>
> > >> > >>>> We actually do have a development issue defined that
would
> enable
> > >> this
> > >> > >>>> in
> > >> > >>>> the future, but that work has not been done yet.
> > >> > >>>> https://github.com/NCAR/MET/issues/1020
> > >> > >>>>
> > >> > >>>> Thanks,
> > >> > >>>> John
> > >> > >>>>
> > >> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via RT
<
> > >> > >>>> met_help at ucar.edu>
> > >> > >>>> wrote:
> > >> > >>>>
> > >> > >>>> >
> > >> > >>>> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >
> > >> > >>>> >
> > >> > >>>> > Hello John,
> > >> > >>>> > Thanks a lot for your help.
> > >> > >>>> > I can already see something interesting. But, I have
another
> > >> > problem.
> > >> > >>>> I
> > >> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
> > >> > OBS_LEAD
> > >> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to
find
> them
> > >> and
> > >> > >>>> how to
> > >> > >>>> > take them into account when running. I predict 24
hours to
> 144
> > >> hours
> > >> > >>>> (0 to
> > >> > >>>> > 6 days). Please help me.
> > >> > >>>> >
> > >> > >>>> > Thank you in advance.
> > >> > >>>> >
> > >> > >>>> > Dorès
> > >> > >>>> >
> > >> > >>>> >
> > >> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via
RT <
> > >> > >>>> met_help at ucar.edu
> > >> > >>>> > >
> > >> > >>>> > a écrit :
> > >> > >>>> >
> > >> > >>>> > > Dores,
> > >> > >>>> > >
> > >> > >>>> > > It looks like you're running Grid-Stat in this way:
> > >> > >>>> > >
> > >> > >>>> > >
> > >> > >>>> > >
> > >> > >>>> > > *dores at dores
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>>
> > >> >
> > >>
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > >> > >>>> > > grid_statwrfout_19_2.nc
> > >> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> > >> > >>>> > >
> > >> > >>>> > > And Grid-Stat is printing out the usage statement to
> indicate
> > >> that
> > >> > >>>> you
> > >> > >>>> > have
> > >> > >>>> > > provided the correct input arguments.
> > >> > >>>> > >
> > >> > >>>> > > Grid-Stat has 3 required arguments on the command
line:
> > >> > >>>> > > (1) the path to the forecast file
> > >> > >>>> > > (2) the path to the observation file
> > >> > >>>> > > (3) the path the grid_stat configuration file
> > >> > >>>> > >
> > >> > >>>> > > You have provided the first 2 but not the 3rd.
Please try
> > >> running
> > >> > >>>> > > grid_stat will all 3 required arguments:
> > >> > >>>> > >
> > >> > >>>> > >
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> > >> > >>>> > >
> > >> > >>>> > > And there is no requirement for the directory
structure to
> be
> > >> > >>>> used. You
> > >> > >>>> > > can either provide the full absolute path the the
input
> > files,
> > >> or
> > >> > >>>> the
> > >> > >>>> > > relative path. If these files are all in your
current
> > working
> > >> > >>>> directory,
> > >> > >>>> > > you just list the filenames.
> > >> > >>>> > >
> > >> > >>>> > > John
> > >> > >>>> > >
> > >> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini
via RT <
> > >> > >>>> > > met_help at ucar.edu>
> > >> > >>>> > > wrote:
> > >> > >>>> > >
> > >> > >>>> > > >
> > >> > >>>> > > > <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >> > >>>> > > >
> > >> > >>>> > > > Hello John,
> > >> > >>>> > > > Excuse me for not understanding. I would like to
> > interpolate
> > >> on
> > >> > >>>> the
> > >> > >>>> > grid
> > >> > >>>> > > > points in order to also have the "RMSE" and the
"Pearson
> > >> > >>>> correlation
> > >> > >>>> > > > coefficient" in addition to the contingency table.
For
> this
> > >> > fact,
> > >> > >>>> I put
> > >> > >>>> > > > ctc, cts and cnt at BOTH.
> > >> > >>>> > > > But, my problem remains the same: how do I execute
my
> > >> grid-stat
> > >> > >>>> and in
> > >> > >>>> > > what
> > >> > >>>> > > > directory. In fact, I would like to know which
files to
> > use,
> > >> > >>>> where to
> > >> > >>>> > put
> > >> > >>>> > > > these files and how to handle them. For the
moment, I
> have
> > >> > >>>> created a
> > >> > >>>> > > > symbolic link between the directory containing my
data
> and
> > >> the
> > >> > >>>> > directory
> > >> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in the
config
> > >> directory
> > >> > >>>> and
> > >> > >>>> > also
> > >> > >>>> > > > in bin. I modify the test_grid_stat.sh and I left
it in
> the
> > >> > >>>> examples
> > >> > >>>> > > > directory. When I run in bin following the command
you
> sent
> > >> me,
> > >> > I
> > >> > >>>> have
> > >> > >>>> > > > these errors.
> > >> > >>>> > > >
> > >> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> > >>>> > > >
> > >> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> > >> > >>>> > > >
> > >> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> > >> > >>>> > > >
> > >> > >>>> > > > Usage: grid_stat
> > >> > >>>> > > > fcst_file
> > >> > >>>> > > > obs_file
> > >> > >>>> > > > config_file
> > >> > >>>> > > > [-outdir path]
> > >> > >>>> > > > [-log file]
> > >> > >>>> > > > [-v level]
> > >> > >>>> > > > [-compress level]
> > >> > >>>> > > >
> > >> > >>>> > > > where "fcst_file" is a gridded forecast
file
> > >> > containing
> > >> > >>>> the
> > >> > >>>> > > > field(s) to be verified (required).
> > >> > >>>> > > > "obs_file" is a gridded
observation file
> > >> > >>>> containing the
> > >> > >>>> > > > verifying field(s) (required).
> > >> > >>>> > > > "config_file" is a GridStatConfig
file
> > >> > containing
> > >> > >>>> the
> > >> > >>>> > > > desired configuration settings (required).
> > >> > >>>> > > > "-outdir path" overrides the
default
> output
> > >> > >>>> directory
> > >> > >>>> > (.)
> > >> > >>>> > > > (optional).
> > >> > >>>> > > > "-log file" outputs log messages
to the
> > >> > specified
> > >> > >>>> file
> > >> > >>>> > > > (optional).
> > >> > >>>> > > > "-v level" overrides the default
level of
> > >> > logging
> > >> > >>>> (2)
> > >> > >>>> > > > (optional).
> > >> > >>>> > > > "-compress level" overrides the
> compression
> > >> > level
> > >> > >>>> of
> > >> > >>>> > > NetCDF
> > >> > >>>> > > > variable (0) (optional).
> > >> > >>>> > > >
> > >> > >>>> > > >
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> > >>>> > > >
> > >> > >>>> > > > Here is my test_grid_stat.sh file
> > >> > >>>> > > > Cordially Dores.
> > >> > >>>> > > >
> > >> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway
via RT <
> > >> > >>>> > > met_help at ucar.edu
> > >> > >>>> > > > >
> > >> > >>>> > > > a écrit :
> > >> > >>>> > > >
> > >> > >>>> > > > > Das,
> > >> > >>>> > > > >
> > >> > >>>> > > > > Good news. It is very easy to configure Grid-
Stat to
> > >> compute
> > >> > >>>> 2x2
> > >> > >>>> > > > > contingency tables. We just need to edit the
config
> file
> > >> > to...
> > >> > >>>> > > > > (1) Define the categorical thresholds that
should be
> > >> applied
> > >> > >>>> > > (cat_thresh
> > >> > >>>> > > > =
> > >> > >>>> > > > > [ >20, >30, >40, >50 ];)
> > >> > >>>> > > > > (2) Turn on the CTC and CTS output line types
(ctc =
> > BOTH;
> > >> > cts =
> > >> > >>>> > BOTH;)
> > >> > >>>> > > > >
> > >> > >>>> > > > > You can of course change those thresholds
however you'd
> > >> like.
> > >> > >>>> Here
> > >> > >>>> > are
> > >> > >>>> > > > > more commands to illustrate this:
> > >> > >>>> > > > >
> > >> > >>>> > > > > # Pull sample data from ftp site
> > >> > >>>> > > > > wget
> > >> > >>>> > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > >
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>>
> > >> >
> > >>
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > >> > >>>> > > > > wget
> > >> > >>>> > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > >
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>>
> > >> >
> > >>
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > >> > >>>> > > > > wget
> > >> > >>>> > >
> > >> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > >> > >>>> > > > > GridStatConfig_pw
> > >> > >>>> > > > >
> > >> > >>>> > > > > # Create output directory and run Grid-Stat
> > >> > >>>> > > > > mkdir -p out
> > >> > >>>> > > > > export VXTIME=2018071900
> > >> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
> > >> ERAI_pw.nc
> > >> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
> > >> > >>>> > > > >
> > >> > >>>> > > > > Then take a look at the output files:
> > >> > >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > >> > >>>> > > > >
> > >> > >>>> > > > > The _ctc.txt file contains the counts for the
2x2
> > >> contingency
> > >> > >>>> table
> > >> > >>>> > for
> > >> > >>>> > > > > each of the 4 thresholds we specified.
> > >> > >>>> > > > >
> > >> > >>>> > > > > Hope this helps get you going.
> > >> > >>>> > > > >
> > >> > >>>> > > > > Thanks,
> > >> > >>>> > > > > John
> > >> > >>>> > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores
Ngamini via
> RT
> > <
> > >> > >>>> > > > > met_help at ucar.edu>
> > >> > >>>> > > > > wrote:
> > >> > >>>> > > > >
> > >> > >>>> > > > > > hello John,
> > >> > >>>> > > > > > Excuse me, I beg you, to bother you.
> > >> > >>>> > > > > > I created a symbolic link between my data and
the
> > >> > pcp-combines
> > >> > >>>> > > > > directory. I
> > >> > >>>> > > > > > used test_grid_stat.sh which I modified. I
compile
> it,
> > it
> > >> > did
> > >> > >>>> not
> > >> > >>>> > > > produce
> > >> > >>>> > > > > > anything. I tried the command lines you sent
me and I
> > get
> > >> > the
> > >> > >>>> > errors
> > >> > >>>> > > I
> > >> > >>>> > > > > sent
> > >> > >>>> > > > > > you. I really have no idea to get me out. I
beg you,
> > >> please,
> > >> > >>>> to
> > >> > >>>> > help
> > >> > >>>> > > > me.
> > >> > >>>> > > > > > Attaching my test_grid_stat.sh file.
> > >> > >>>> > > > > >
> > >> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores
Ngamini <
> > >> > >>>> > > ngaminidas at gmail.com>
> > >> > >>>> > > > a
> > >> > >>>> > > > > > écrit :
> > >> > >>>> > > > > >
> > >> > >>>> > > > > > > Hello John,
> > >> > >>>> > > > > > > I am still unable to pull out my contingency
table
> > >> (CTC)
> > >> > >>>> with
> > >> > >>>> > MET.
> > >> > >>>> > > I
> > >> > >>>> > > > > have
> > >> > >>>> > > > > > > read your email, the user guide, the online
> tutorial,
> > >> but
> > >> > I
> > >> > >>>> still
> > >> > >>>> > > do
> > >> > >>>> > > > > not
> > >> > >>>> > > > > > > understand how I should run.
> > >> > >>>> > > > > > > I see the lines of code:
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > Use: grid_stat
> > >> > >>>> > > > > > > fcst_file
> > >> > >>>> > > > > > > obs_file
> > >> > >>>> > > > > > > config_file
> > >> > >>>> > > > > > > [-outdir path]
> > >> > >>>> > > > > > > [-log file]
> > >> > >>>> > > > > > > [-v level]
> > >> > >>>> > > > > > > [-compress level]
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > And, I do not know where I have to write
them.
> > >> > >>>> > > > > > > I see your run command lines:
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > * mkdir -p out *
> > >> > >>>> > > > > > > * setenv VXTIME "2018071900" *
> > >> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin /
grid_stat
> > >> > >>>> wrfout_19_2.nc <
> > >> > >>>> > > > > > > http://wrfout_19_2.nc>
> > >> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out -v
3 *
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > "setenv" did not give, I had to install
"getenv".
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > Command 'setenv' not found, did you mean:
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > command 'getenv' from snap getenv (0.2.0)
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > See 'snap info <snapname>' for additional
versions.
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > But when I try to run, I have errors:
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $ getenv VXTIME
> > >> "2018071900"
> > >> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
> > >> <project_name>]
> > >> > >>>> [-s
> > >> > >>>> > > > > > > <source_dir>]
> > >> > >>>> > > > > > > getenv: error: unrecognized arguments:
VXTIME
> > >> 2018071900
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $
> > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > >> > >>>> > > > > > > bash: syntax error near unexpected `newline
'
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $
> > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >> > >>>> > > > > > > wrfout_19_2.nc
> > >> > >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat: No
such
> > file
> > >> or
> > >> > >>>> > directory
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > >
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>>
> > >> >
> > >>
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > >> > >>>> > > > > > > .nc
> > >> > >>>> > > > > > > bash:
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > >
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>>
> > >> >
> > >>
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > >> > >>>> > > > > > > Is a directory
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $
> > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > >> > >>>> > > > > > > bash: syntax error near unexpected `newline
'
> > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
TP_Prevision /
> > >> MET /
> > >> > >>>> 8.1 /
> > >> > >>>> > > > > met-8.1.1
> > >> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
> > >> GridStatConfig_pw
> > >> > >>>> > -outdir
> > >> > >>>> > > > out
> > >> > >>>> > > > > > -v 3
> > >> > >>>> > > > > > > ERAI_pw.nc: command not found
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > Can you please, send me your execution
script.
> > >> > >>>> > > > > > > I may not be performing them properly.
Please help
> > me.
> > >> I'm
> > >> > >>>> lost.
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > Best regards
> > >> > >>>> > > > > > > Dores
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores
Ngamini <
> > >> > >>>> > > > ngaminidas at gmail.com>
> > >> > >>>> > > > > a
> > >> > >>>> > > > > > > écrit :
> > >> > >>>> > > > > > >
> > >> > >>>> > > > > > >> Thank you very much.
> > >> > >>>> > > > > > >>
> > >> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley
Gotway
> via
> > >> RT <
> > >> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
> > >> > >>>> > > > > > >>
> > >> > >>>> > > > > > >>> Dores,
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> OK, great. Thanks for sending some sample
data.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> When getting started with new datasets in
MET, I
> > >> always
> > >> > >>>> start
> > >> > >>>> > by
> > >> > >>>> > > > > > running
> > >> > >>>> > > > > > >>> the plot_data_plane tool to make sure MET
can
> read
> > >> the
> > >> > >>>> data and
> > >> > >>>> > > > place
> > >> > >>>> > > > > > it
> > >> > >>>> > > > > > >>> on
> > >> > >>>> > > > > > >>> the earth correctly.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF
format,
> > and
> > >> MET
> > >> > >>>> can
> > >> > >>>> > > easily
> > >> > >>>> > > > > > read
> > >> > >>>> > > > > > >>> that:
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
> > >> **ERAI_pw.nc
> > >> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> > >> > >>>> > level="(2018071900,*,*)";'
> > >> > >>>> > > -v
> > >> > >>>> > > > > 4*
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Next for the WRF output. When I try
passing it
> to
> > >> MET
> > >> > >>>> > directly,
> > >> > >>>> > > I
> > >> > >>>> > > > > get
> > >> > >>>> > > > > > an
> > >> > >>>> > > > > > >>> error message:
> > >> > >>>> > > > > > >>> ERROR : plot_data_plane -> file
"wrfout_19_2.nc
> "
> > >> not a
> > >> > >>>> valid
> > >> > >>>> > > data
> > >> > >>>> > > > > > file
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> However, since this is on a lat/lon grid,
we can
> > just
> > >> > >>>> tell MET
> > >> > >>>> > to
> > >> > >>>> > > > > > >>> interpret
> > >> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like this
> > >> "file_type =
> > >> > >>>> > > > > NETCDF_NCCF;":
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/plot_data_plane
**
> > >> > >>>> wrfout_19_2.nc
> > >> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
wrfout_pw_2018071900.ps
> > >> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps>
**'name="pw";
> > >> > >>>> > > > > > level="(2018071900,*,*)";
> > >> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> PNG versions of the resulting images are
> attached.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Looking at these images, we see that MET
is able
> to
> > >> read
> > >> > >>>> data
> > >> > >>>> > > from
> > >> > >>>> > > > > > them.
> > >> > >>>> > > > > > >>> And I'll leave it to you to confirm that
MET is
> > >> placing
> > >> > >>>> them in
> > >> > >>>> > > the
> > >> > >>>> > > > > > right
> > >> > >>>> > > > > > >>> spot on earth, but I assume it is.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
statistics
> on
> > >> them.
> > >> > >>>> I've
> > >> > >>>> > > set
> > >> > >>>> > > > up
> > >> > >>>> > > > > > the
> > >> > >>>> > > > > > >>> attached Grid-Stat config file to...
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model
domain
> using
> > >> the
> > >> > >>>> budget
> > >> > >>>> > > > > > >>> interpolation
> > >> > >>>> > > > > > >>> method
> > >> > >>>> > > > > > >>> regrid = {
> > >> > >>>> > > > > > >>> to_grid = FCST;
> > >> > >>>> > > > > > >>> method = BUDGET;
> > >> > >>>> > > > > > >>> width = 2;
> > >> > >>>> > > > > > >>> vld_thresh = 0.5;
> > >> > >>>> > > > > > >>> shape = SQUARE;
> > >> > >>>> > > > > > >>> }
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> (2) Transfer the config options from the
> > >> plot_data_plane
> > >> > >>>> > command
> > >> > >>>> > > > line
> > >> > >>>> > > > > > to
> > >> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
> > convenience,
> > >> I
> > >> > >>>> defined
> > >> > >>>> > > the
> > >> > >>>> > > > > time
> > >> > >>>> > > > > > >>> as
> > >> > >>>> > > > > > >>> an environment variable named $VXTIME:
> > >> > >>>> > > > > > >>> fcst = {
> > >> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
> > >> > >>>> > > > > > >>> field = [ { name = "pw"; level= [
> > >> > >>>> "(${VXTIME},*,*)" ];
> > >> > >>>> > }
> > >> > >>>> > > ];
> > >> > >>>> > > > > > >>> }
> > >> > >>>> > > > > > >>> obs = {
> > >> > >>>> > > > > > >>> field = [ { name = "tcw"; level= [
> > >> > >>>> "(${VXTIME},*,*)" ];
> > >> > >>>> > }
> > >> > >>>> > > ];
> > >> > >>>> > > > > > >>> }
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> (3) Compute stats over the FULL model
domain.
> > >> > >>>> > > > > > >>> mask = {
> > >> > >>>> > > > > > >>> grid = [ "FULL" ];
> > >> > >>>> > > > > > >>> poly = [];
> > >> > >>>> > > > > > >>> }
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> (4) And just compute continuous stats.
> > >> > >>>> > > > > > >>> output_flag = {
> > >> > >>>> > > > > > >>> ...
> > >> > >>>> > > > > > >>> cnt = BOTH;
> > >> > >>>> > > > > > >>> ...
> > >> > >>>> > > > > > >>> }
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Finally, run Grid-Stat on the command line
like
> > this:
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> *mkdir -p out*
> > >> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
> wrfout_19_2.nc
> > <
> > >> > >>>> > > > > > >>> http://wrfout_19_2.nc>
> > >> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out
-v 3*
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> And that run successfully and creates
output
> files:
> > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
> > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for
example, the
> > RMSE
> > >> > >>>> value =
> > >> > >>>> > > > 3.39378.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Hope this helps get you up and running
with MET.
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> Thanks,
> > >> > >>>> > > > > > >>> John Halley Gotway
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das Dores
> Ngamini
> > >> via
> > >> > RT
> > >> > >>>> <
> > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > >> > >>>> > > > > > >>> wrote:
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>> > <URL:
> > >> > >>>> >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >> > >>>> > > >
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>> > Hello John,
> > >> > >>>> > > > > > >>> > I have already sent my data to my ftp
site. In
> > >> these
> > >> > >>>> files, I
> > >> > >>>> > > > want
> > >> > >>>> > > > > to
> > >> > >>>> > > > > > >>> > extract the pw. There is another missing
ERAI
> > file.
> > >> > That
> > >> > >>>> > one, I
> > >> > >>>> > > > > have
> > >> > >>>> > > > > > >>> > trouble sending it. It contains the
relative
> > >> humidity
> > >> > >>>> and
> > >> > >>>> > wind
> > >> > >>>> > > > > data.
> > >> > >>>> > > > > > >>> > Please,
> > >> > >>>> > > > > > >>> > just tell me how to do it because I can
not
> send
> > >> this
> > >> > >>>> file.
> > >> > >>>> > > There
> > >> > >>>> > > > > are
> > >> > >>>> > > > > > >>> two
> > >> > >>>> > > > > > >>> > wrfout files because my forecasts are
made over
> > 24
> > >> > >>>> hours or
> > >> > >>>> > > more.
> > >> > >>>> > > > > My
> > >> > >>>> > > > > > >>> raw
> > >> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can not
send
> > them.
> > >> > >>>> That's
> > >> > >>>> > why I
> > >> > >>>> > > > > sent
> > >> > >>>> > > > > > >>> those
> > >> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for the
other
> > >> files
> > >> > to
> > >> > >>>> be
> > >> > >>>> > > sent,
> > >> > >>>> > > > > the
> > >> > >>>> > > > > > >>> time
> > >> > >>>> > > > > > >>> > to deposit my memory will expire.
> > >> > >>>> > > > > > >>> > Thank you very much for helping me.
> > >> > >>>> > > > > > >>> > Yours sincerely.
> > >> > >>>> > > > > > >>> > Dores
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John
Halley
> Gotway
> > >> via
> > >> > RT
> > >> > >>>> <
> > >> > >>>> > > > > > >>> met_help at ucar.edu
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > a écrit :
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>> > > Dores,
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > Were you able to post any data to the
ftp
> site?
> > >> You
> > >> > >>>> could
> > >> > >>>> > > try
> > >> > >>>> > > > > > >>> sending
> > >> > >>>> > > > > > >>> > via
> > >> > >>>> > > > > > >>> > > email but I worry that the data files
will be
> > too
> > >> > >>>> large to
> > >> > >>>> > > > > transfer
> > >> > >>>> > > > > > >>> that
> > >> > >>>> > > > > > >>> > > way.
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > Stephen is right... you need to put
the files
> > >> one by
> > >> > >>>> way.
> > >> > >>>> > By
> > >> > >>>> > > > way
> > >> > >>>> > > > > > of
> > >> > >>>> > > > > > >>> > > example, here are commands to create a
file
> > named
> > >> > >>>> > > > hello_world.txt
> > >> > >>>> > > > > > and
> > >> > >>>> > > > > > >>> > post
> > >> > >>>> > > > > > >>> > > it to our ftp site.
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > cd /home/johnhg
> > >> > >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
> > >> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> > >> > >>>> > > > > > >>> > > username = anonymous
> > >> > >>>> > > > > > >>> > > password = "my email address"
> > >> > >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> > >> > >>>> > > > > > >>> > > put hello_world.txt
> > >> > >>>> > > > > > >>> > > bye
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > And then checking the ftp via a web
browser:
> > >> > >>>> > > > > > >>> > >
> > >> > >>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > I see that file now exists. Just be
sure
> that
> > >> > you're
> > >> > >>>> in
> > >> > >>>> > the
> > >> > >>>> > > > > > >>> directory
> > >> > >>>> > > > > > >>> > > which contains the files you want to
send
> > before
> > >> > >>>> running
> > >> > >>>> > ftp.
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > Thanks,
> > >> > >>>> > > > > > >>> > > John
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM
Stephen Dowdy
> > via
> > >> > RT <
> > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > >> > >>>> > > > > > >>> > > wrote:
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > > <URL:
> > >> > >>>> > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > >> > >>>> > > > > >
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > > John,
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP ticket
from
> > Dores
> > >> > into
> > >> > >>>> this
> > >> > >>>> > > > ticket
> > >> > >>>> > > > > > >>> with
> > >> > >>>> > > > > > >>> > > > explanation of what i think the
problem is
> > >> > >>>> (specifying
> > >> > >>>> > full
> > >> > >>>> > > > > paths
> > >> > >>>> > > > > > >>> on
> > >> > >>>> > > > > > >>> > the
> > >> > >>>> > > > > > >>> > > > files w/o telling the FTP server to
rename
> to
> > >> > >>>> non-pathed
> > >> > >>>> > > > > > filename.
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > > If you want, it might be helpful to
add
> > >> something
> > >> > >>>> about
> > >> > >>>> > > that
> > >> > >>>> > > > to
> > >> > >>>> > > > > > >>> your
> > >> > >>>> > > > > > >>> > Met
> > >> > >>>> > > > > > >>> > > > Help FTP upload page.
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > > > thanks,
> > >> > >>>> > > > > > >>> > > > --stephen
> > >> > >>>> > > > > > >>> > > >
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> > >
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>> >
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > > >>>
> > >> > >>>> > > > > >
> > >> > >>>> > > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > > >
> > >> > >>>> > > >
> > >> > >>>> > > >
> > >> > >>>> > >
> > >> > >>>> > >
> > >> > >>>> >
> > >> > >>>> >
> > >> > >>>>
> > >> > >>>>
> > >> >
> > >> >
> > >>
> > >>
> >
> >
>
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Tue Nov 05 09:25:27 2019
Dores,
In the past, we've recommended that user's cite the User's Guide.
Look on
page 17 of the User's Guide:
https://dtcenter.org/sites/default/files/community-code/met/docs/user-
guide/MET_Users_Guide_v8.1.1.pdf
There the citation is listed as:
K. Newman, T. Jensen, Brown, B., R. Bullock, T. Fowler, 2018, and J.
Halley
Gotway: The Model Evaluation Tools v8.1 (METv8.1) User's Guide.
Developmental Testbed Center. Available at:
https://dtcenter.org/community-code/model-evaluation-tools-
met/documentation/MET_Users_Guide_v8.1.pdf
437 pp.
Thanks,
John
On Tue, Nov 5, 2019 at 8:13 AM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
> Hello John
> Thank you for your help. I will try again until I have the solution.
> Please,
> can you tell me how to refer to MET ?
> Best regards
> Dorès
>
> Le lun. 4 nov. 2019 à 17:28, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
> > Dores,
> >
> > I see that you are getting the following error message:
> > *ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> file
> > "wrfout_20_2.nc <http://wrfout_20_2.nc>"*
> >
> > Of course there is not enough information in that single ERROR
message
> line
> > to diagnose the source of the problem. Looking back at the
history on
> this
> > ticket, I see that you've sent me two wrfout files, named "
> wrfout_19_2.nc"
> > and "wrfout_25_2.nc". I do not have the file named wrfout_20_2.nc
which
> > is
> > the source of the problem.
> >
> > But I'm making the assumption here that wrfout_20_2.nc is
formatted
> > *exactly* the same way as wrfout_19_2.nc but just contains
different
> > dates. So demonstrating that the MET software can run on
wrfout_19_2.nc
> > should be sufficient. If those two files are formatted
differently, then
> > you should figure out why and fix that issue.
> >
> > No, I am not able to process this data for you. The MET-Help
email
> support
> > is intended to answer clarifying questions and point users in the
right
> > direction. But we do not have the time or funding to support
users at
> the
> > level you're requesting.
> >
> > Let me demonstrate how I am able to run grid_stat to compare the
files
> > wrfout_19_2.nc and ERAI_pw.nc. And that should give you enough
> > information
> > to run grid_stat yourself on the other data. Please copy and
paste the
> > following commands (of course you'll need to update the path to
the
> > grid_stat executable):
> >
> > *wget
> >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > <
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > >*
> >
> > *wget
> >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> > <
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> > >*
> >
> > *wget
> >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > <
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > >*
> > *mkdir out*
> > *setenv VXTIME "20180719"*
> > */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> http://wrfout_19_2.nc>
> > ERAI_pw.nc GridStatConfig_pw -outdir out*
> >
> > I've attached a tarball of the resulting output files
"out.tar.gz".
> Notice
> > that I set VXTIME to "20180719" for the file named wrfout_19_2.nc.
Your
> > wrfout_20_2.nc will contain data starting on the "20180720". So
you
> > should
> > change the VXTIME environment variable to match the timestamps of
the
> data
> > you're processing.
> >
> > John
> >
> > On Sun, Nov 3, 2019 at 10:29 PM Das Dores Ngamini via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > >
> > > Hello John
> > > Since my gridstat tool is not running, can you please run it for
me and
> > > send me the .txt, .stat output files? I have 6 wrfout left to
execute.
> If
> > > you agree, I send you the other files.
> > > However, I would like if possible to execute myself. That is why
I ask
> > you
> > > to look very carefully at the errors I am getting and to propose
a
> > > solution.
> > > Attached is the type of error obtained for each data, including
> > > wrfout_19_2.nc which gave first and the files used.
> > >
> > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> > > VXTIME=2018072000
> > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > > DEBUG 1: Default Config File:
> > >
> > >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > > DEBUG 1: User Config File: GridStatConfig_pw
> > > ERROR :
> > > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> > file
> > > "
> > > wrfout_20_2.nc"
> > > ERROR :
> > > ERROR :
> > > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> > file
> > > "wrfout_20_2.nc"
> > > ERROR :
> > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >
> > > Thank you in advance
> > > Dorès
> > >
> > >
> > > Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini
<ngaminidas at gmail.com>
> a
> > > écrit :
> > >
> > > > Hello John,
> > > > Thank you for your reply.
> > > > ncdump -h wrfout_20_2.nc gives all the variables normally.
However,
> > > > plot_data_plane does not run. At this point, grid_stat is not
running
> > any
> > > > of my wrf output files, not even wrfout_19_2.nc that was
working
> > first.
> > > > Thank you in advance
> > > > Dorès
> > > >
> > > > Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > > a écrit :
> > > >
> > > >> Dores,
> > > >>
> > > >> In the GridStatConfig_pw file, we requested data from the
> > > >> forecast/observation files as shown below. Note that we used
an
> > > >> environment variable named "VXTIME" to define the timestamp
of the
> > data
> > > we
> > > >> want to retrieve:
> > > >>
> > > >> fcst = {
> > > >> file_type = NETCDF_NCCF;
> > > >> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)"
]; } ];
> > > >> }
> > > >> obs = {
> > > >> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)"
]; } ];
> > > >> }
> > > >>
> > > >> You indicated that the script worked fine for the WRF file
named "
> > > >> wrfout_19_2.nc" but errors out when processing
"wrfout_20_2.nc".
> > > >> Presumably the timestamps differ between these two files. I
suggest
> > > that
> > > >> you:
> > > >>
> > > >> (1) Make sure that wrfout_20_2.nc exists and is a valid
NetCDF file
> > > (run
> > > >> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
> results).
> > > >> (2) Set the VXTIME environment variable to a timestamp which
> actually
> > > >> exists in that file.
> > > >> (3) Run plot_data_plane to confirm that MET processes this
data
> fine.
> > > For
> > > >> example:
> > > >>
> > > >>
> > > >> *setenv VXTIME 20180725*
> > > >> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc> 25.ps
> > > >> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)";
file_type =
> > > >> NETCDF_NCCF;' -v 4*
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
> > > >> met_help at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > > >> >
> > > >> > Hello John,
> > > >> > Please, help me to run grid_stat for my another wrfout
files. I
> > don't
> > > >> know
> > > >> > what to change in the files I used to run the first wrfout.
> > > >> >
> > > >> > Cordially
> > > >> > Dorès
> > > >> >
> > > >> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini <
> > ngaminidas at gmail.com
> > > >
> > > >> a
> > > >> > écrit :
> > > >> >
> > > >> > > Hello John,
> > > >> > > I use the same config file and the same test_grid_stat.sh
file.
> > > >> > >
> > > >> > >
> > > >> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <
> > > ngaminidas at gmail.com>
> > > >> a
> > > >> > > écrit :
> > > >> > >
> > > >> > >> Hello John,
> > > >> > >> Another problem that I have now is I am not able to run
another
> > > >> wrfout
> > > >> > >> with the same command. What should I change? I have
several
> > wrfout
> > > >> files
> > > >> > >> that I want to fill the CTC.
> > > >> > >> Here the error that I have.
> > > >> > >>
> > > >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >> > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > >> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > > >> > >> DEBUG 1: Default Config File:
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > > >> > >> DEBUG 1: User Config File: GridStatConfig_pw
> > > >> > >> ERROR :
> > > >> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable
to open
> > > NetCDF
> > > >> > >> file "wrfout_20_2.nc"
> > > >> > >> ERROR :
> > > >> > >> ERROR :
> > > >> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file() ->
error
> > > >> opening
> > > >> > >> file "wrfout_20_2.nc"
> > > >> > >> ERROR :
> > > >> > >> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >> > >>
> > > >> > >> Best regards
> > > >> > >> Dorès
> > > >> > >>
> > > >> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
> > > >> ngaminidas at gmail.com>
> > > >> > a
> > > >> > >> écrit :
> > > >> > >>
> > > >> > >>> Hello John,
> > > >> > >>> FCST_VALID_BEG = 20180719_000000
> > > >> > >>> FCST_VALID_END = 20180719_000000
> > > >> > >>> It is the same for OBS.
> > > >> > >>> I want to have
> > > >> > >>> FCST_VALID_BEG = 20180719_000000
> > > >> > >>> FCST_VALID_END = 20180726_000000
> > > >> > >>>
> > > >> > >>> My another problem is how to cite MET.
> > > >> > >>>
> > > >> > >>> Cordially
> > > >> > >>> Dorès
> > > >> > >>>
> > > >> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via RT
<
> > > >> > >>> met_help at ucar.edu> a écrit :
> > > >> > >>>
> > > >> > >>>> Dores,
> > > >> > >>>>
> > > >> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
> > information
> > > is
> > > >> > >>>> extracted from the metadata of the data files. And
that
> timing
> > > >> > >>>> information
> > > >> > >>>> is written to the header columns of the output files.
There
> > is,
> > > in
> > > >> > >>>> general, no easy way of modifying the timing
information of
> the
> > > >> data
> > > >> > >>>> you're
> > > >> > >>>> processing.
> > > >> > >>>>
> > > >> > >>>> And I don't really understand why you would want to
change
> that
> > > >> timing
> > > >> > >>>> info.
> > > >> > >>>>
> > > >> > >>>> We actually do have a development issue defined that
would
> > enable
> > > >> this
> > > >> > >>>> in
> > > >> > >>>> the future, but that work has not been done yet.
> > > >> > >>>> https://github.com/NCAR/MET/issues/1020
> > > >> > >>>>
> > > >> > >>>> Thanks,
> > > >> > >>>> John
> > > >> > >>>>
> > > >> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini via
RT <
> > > >> > >>>> met_help at ucar.edu>
> > > >> > >>>> wrote:
> > > >> > >>>>
> > > >> > >>>> >
> > > >> > >>>> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > >
> > > >> > >>>> >
> > > >> > >>>> > Hello John,
> > > >> > >>>> > Thanks a lot for your help.
> > > >> > >>>> > I can already see something interesting. But, I have
> another
> > > >> > problem.
> > > >> > >>>> I
> > > >> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
> FCST_VALID_END
> > > >> > OBS_LEAD
> > > >> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where to
find
> > them
> > > >> and
> > > >> > >>>> how to
> > > >> > >>>> > take them into account when running. I predict 24
hours to
> > 144
> > > >> hours
> > > >> > >>>> (0 to
> > > >> > >>>> > 6 days). Please help me.
> > > >> > >>>> >
> > > >> > >>>> > Thank you in advance.
> > > >> > >>>> >
> > > >> > >>>> > Dorès
> > > >> > >>>> >
> > > >> > >>>> >
> > > >> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway via
RT <
> > > >> > >>>> met_help at ucar.edu
> > > >> > >>>> > >
> > > >> > >>>> > a écrit :
> > > >> > >>>> >
> > > >> > >>>> > > Dores,
> > > >> > >>>> > >
> > > >> > >>>> > > It looks like you're running Grid-Stat in this
way:
> > > >> > >>>> > >
> > > >> > >>>> > >
> > > >> > >>>> > >
> > > >> > >>>> > > *dores at dores
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> >
> > > >>
> > >
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > > >> > >>>> > > grid_statwrfout_19_2.nc
> > > >> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> > > >> > >>>> > >
> > > >> > >>>> > > And Grid-Stat is printing out the usage statement
to
> > indicate
> > > >> that
> > > >> > >>>> you
> > > >> > >>>> > have
> > > >> > >>>> > > provided the correct input arguments.
> > > >> > >>>> > >
> > > >> > >>>> > > Grid-Stat has 3 required arguments on the command
line:
> > > >> > >>>> > > (1) the path to the forecast file
> > > >> > >>>> > > (2) the path to the observation file
> > > >> > >>>> > > (3) the path the grid_stat configuration file
> > > >> > >>>> > >
> > > >> > >>>> > > You have provided the first 2 but not the 3rd.
Please
> try
> > > >> running
> > > >> > >>>> > > grid_stat will all 3 required arguments:
> > > >> > >>>> > >
> > > >> > >>>> > >
> > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > >> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> > > >> > >>>> > >
> > > >> > >>>> > > And there is no requirement for the directory
structure
> to
> > be
> > > >> > >>>> used. You
> > > >> > >>>> > > can either provide the full absolute path the the
input
> > > files,
> > > >> or
> > > >> > >>>> the
> > > >> > >>>> > > relative path. If these files are all in your
current
> > > working
> > > >> > >>>> directory,
> > > >> > >>>> > > you just list the filenames.
> > > >> > >>>> > >
> > > >> > >>>> > > John
> > > >> > >>>> > >
> > > >> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores Ngamini
via RT
> <
> > > >> > >>>> > > met_help at ucar.edu>
> > > >> > >>>> > > wrote:
> > > >> > >>>> > >
> > > >> > >>>> > > >
> > > >> > >>>> > > > <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > > >> > >>>> > > >
> > > >> > >>>> > > > Hello John,
> > > >> > >>>> > > > Excuse me for not understanding. I would like to
> > > interpolate
> > > >> on
> > > >> > >>>> the
> > > >> > >>>> > grid
> > > >> > >>>> > > > points in order to also have the "RMSE" and the
> "Pearson
> > > >> > >>>> correlation
> > > >> > >>>> > > > coefficient" in addition to the contingency
table. For
> > this
> > > >> > fact,
> > > >> > >>>> I put
> > > >> > >>>> > > > ctc, cts and cnt at BOTH.
> > > >> > >>>> > > > But, my problem remains the same: how do I
execute my
> > > >> grid-stat
> > > >> > >>>> and in
> > > >> > >>>> > > what
> > > >> > >>>> > > > directory. In fact, I would like to know which
files to
> > > use,
> > > >> > >>>> where to
> > > >> > >>>> > put
> > > >> > >>>> > > > these files and how to handle them. For the
moment, I
> > have
> > > >> > >>>> created a
> > > >> > >>>> > > > symbolic link between the directory containing
my data
> > and
> > > >> the
> > > >> > >>>> > directory
> > > >> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in the
config
> > > >> directory
> > > >> > >>>> and
> > > >> > >>>> > also
> > > >> > >>>> > > > in bin. I modify the test_grid_stat.sh and I
left it in
> > the
> > > >> > >>>> examples
> > > >> > >>>> > > > directory. When I run in bin following the
command you
> > sent
> > > >> me,
> > > >> > I
> > > >> > >>>> have
> > > >> > >>>> > > > these errors.
> > > >> > >>>> > > >
> > > >> > >>>> > > > dores at dores
> :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >> > >>>> > > >
> > > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > >> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> > > >> > >>>> > > >
> > > >> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> > > >> > >>>> > > >
> > > >> > >>>> > > > Usage: grid_stat
> > > >> > >>>> > > > fcst_file
> > > >> > >>>> > > > obs_file
> > > >> > >>>> > > > config_file
> > > >> > >>>> > > > [-outdir path]
> > > >> > >>>> > > > [-log file]
> > > >> > >>>> > > > [-v level]
> > > >> > >>>> > > > [-compress level]
> > > >> > >>>> > > >
> > > >> > >>>> > > > where "fcst_file" is a gridded
forecast file
> > > >> > containing
> > > >> > >>>> the
> > > >> > >>>> > > > field(s) to be verified (required).
> > > >> > >>>> > > > "obs_file" is a gridded
observation
> file
> > > >> > >>>> containing the
> > > >> > >>>> > > > verifying field(s) (required).
> > > >> > >>>> > > > "config_file" is a
GridStatConfig file
> > > >> > containing
> > > >> > >>>> the
> > > >> > >>>> > > > desired configuration settings (required).
> > > >> > >>>> > > > "-outdir path" overrides the
default
> > output
> > > >> > >>>> directory
> > > >> > >>>> > (.)
> > > >> > >>>> > > > (optional).
> > > >> > >>>> > > > "-log file" outputs log messages
to the
> > > >> > specified
> > > >> > >>>> file
> > > >> > >>>> > > > (optional).
> > > >> > >>>> > > > "-v level" overrides the default
level
> of
> > > >> > logging
> > > >> > >>>> (2)
> > > >> > >>>> > > > (optional).
> > > >> > >>>> > > > "-compress level" overrides the
> > compression
> > > >> > level
> > > >> > >>>> of
> > > >> > >>>> > > NetCDF
> > > >> > >>>> > > > variable (0) (optional).
> > > >> > >>>> > > >
> > > >> > >>>> > > > dores at dores
> :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >> > >>>> > > >
> > > >> > >>>> > > > Here is my test_grid_stat.sh file
> > > >> > >>>> > > > Cordially Dores.
> > > >> > >>>> > > >
> > > >> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley Gotway
via
> RT <
> > > >> > >>>> > > met_help at ucar.edu
> > > >> > >>>> > > > >
> > > >> > >>>> > > > a écrit :
> > > >> > >>>> > > >
> > > >> > >>>> > > > > Das,
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > Good news. It is very easy to configure Grid-
Stat to
> > > >> compute
> > > >> > >>>> 2x2
> > > >> > >>>> > > > > contingency tables. We just need to edit the
config
> > file
> > > >> > to...
> > > >> > >>>> > > > > (1) Define the categorical thresholds that
should be
> > > >> applied
> > > >> > >>>> > > (cat_thresh
> > > >> > >>>> > > > =
> > > >> > >>>> > > > > [ >20, >30, >40, >50 ];)
> > > >> > >>>> > > > > (2) Turn on the CTC and CTS output line types
(ctc =
> > > BOTH;
> > > >> > cts =
> > > >> > >>>> > BOTH;)
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > You can of course change those thresholds
however
> you'd
> > > >> like.
> > > >> > >>>> Here
> > > >> > >>>> > are
> > > >> > >>>> > > > > more commands to illustrate this:
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > # Pull sample data from ftp site
> > > >> > >>>> > > > > wget
> > > >> > >>>> > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > >
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> >
> > > >>
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > >> > >>>> > > > > wget
> > > >> > >>>> > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > >
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> >
> > > >>
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > >> > >>>> > > > > wget
> > > >> > >>>> > >
> > > >> >
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > > >> > >>>> > > > > GridStatConfig_pw
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > # Create output directory and run Grid-Stat
> > > >> > >>>> > > > > mkdir -p out
> > > >> > >>>> > > > > export VXTIME=2018071900
> > > >> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
> > > >> ERAI_pw.nc
> > > >> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > Then take a look at the output files:
> > > >> > >>>> > > > > out/grid_stat_000000L_20180719_000000V_ctc.txt
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > The _ctc.txt file contains the counts for the
2x2
> > > >> contingency
> > > >> > >>>> table
> > > >> > >>>> > for
> > > >> > >>>> > > > > each of the 4 thresholds we specified.
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > Hope this helps get you going.
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > Thanks,
> > > >> > >>>> > > > > John
> > > >> > >>>> > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores
Ngamini via
> > RT
> > > <
> > > >> > >>>> > > > > met_help at ucar.edu>
> > > >> > >>>> > > > > wrote:
> > > >> > >>>> > > > >
> > > >> > >>>> > > > > > hello John,
> > > >> > >>>> > > > > > Excuse me, I beg you, to bother you.
> > > >> > >>>> > > > > > I created a symbolic link between my data
and the
> > > >> > pcp-combines
> > > >> > >>>> > > > > directory. I
> > > >> > >>>> > > > > > used test_grid_stat.sh which I modified. I
compile
> > it,
> > > it
> > > >> > did
> > > >> > >>>> not
> > > >> > >>>> > > > produce
> > > >> > >>>> > > > > > anything. I tried the command lines you sent
me
> and I
> > > get
> > > >> > the
> > > >> > >>>> > errors
> > > >> > >>>> > > I
> > > >> > >>>> > > > > sent
> > > >> > >>>> > > > > > you. I really have no idea to get me out. I
beg
> you,
> > > >> please,
> > > >> > >>>> to
> > > >> > >>>> > help
> > > >> > >>>> > > > me.
> > > >> > >>>> > > > > > Attaching my test_grid_stat.sh file.
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores
Ngamini <
> > > >> > >>>> > > ngaminidas at gmail.com>
> > > >> > >>>> > > > a
> > > >> > >>>> > > > > > écrit :
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > > > > Hello John,
> > > >> > >>>> > > > > > > I am still unable to pull out my
contingency
> table
> > > >> (CTC)
> > > >> > >>>> with
> > > >> > >>>> > MET.
> > > >> > >>>> > > I
> > > >> > >>>> > > > > have
> > > >> > >>>> > > > > > > read your email, the user guide, the
online
> > tutorial,
> > > >> but
> > > >> > I
> > > >> > >>>> still
> > > >> > >>>> > > do
> > > >> > >>>> > > > > not
> > > >> > >>>> > > > > > > understand how I should run.
> > > >> > >>>> > > > > > > I see the lines of code:
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > Use: grid_stat
> > > >> > >>>> > > > > > > fcst_file
> > > >> > >>>> > > > > > > obs_file
> > > >> > >>>> > > > > > > config_file
> > > >> > >>>> > > > > > > [-outdir path]
> > > >> > >>>> > > > > > > [-log file]
> > > >> > >>>> > > > > > > [-v level]
> > > >> > >>>> > > > > > > [-compress level]
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > And, I do not know where I have to write
them.
> > > >> > >>>> > > > > > > I see your run command lines:
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > * mkdir -p out *
> > > >> > >>>> > > > > > > * setenv VXTIME "2018071900" *
> > > >> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin /
grid_stat
> > > >> > >>>> wrfout_19_2.nc <
> > > >> > >>>> > > > > > > http://wrfout_19_2.nc>
> > > >> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out
-v 3 *
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > "setenv" did not give, I had to install
"getenv".
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > Command 'setenv' not found, did you mean:
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > command 'getenv' from snap getenv
(0.2.0)
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > See 'snap info <snapname>' for additional
> versions.
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > But when I try to run, I have errors:
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $ getenv
VXTIME
> > > >> "2018071900"
> > > >> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f] [-o
> > > >> <project_name>]
> > > >> > >>>> [-s
> > > >> > >>>> > > > > > > <source_dir>]
> > > >> > >>>> > > > > > > getenv: error: unrecognized arguments:
VXTIME
> > > >> 2018071900
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > >> > >>>> > > > > > > wrfout_19_2.nc
> > > >> > >>>> > > > > > > bash: /usr/local/met-8.1.1/bin/grid_stat:
No such
> > > file
> > > >> or
> > > >> > >>>> > directory
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > >
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> >
> > > >>
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > >> > >>>> > > > > > > .nc
> > > >> > >>>> > > > > > > bash:
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > >
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> >
> > > >>
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > >> > >>>> > > > > > > Is a directory
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
> > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> TP_Prevision /
> > > >> MET /
> > > >> > >>>> 8.1 /
> > > >> > >>>> > > > > met-8.1.1
> > > >> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
> > > >> GridStatConfig_pw
> > > >> > >>>> > -outdir
> > > >> > >>>> > > > out
> > > >> > >>>> > > > > > -v 3
> > > >> > >>>> > > > > > > ERAI_pw.nc: command not found
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > Can you please, send me your execution
script.
> > > >> > >>>> > > > > > > I may not be performing them properly.
Please
> help
> > > me.
> > > >> I'm
> > > >> > >>>> lost.
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > Best regards
> > > >> > >>>> > > > > > > Dores
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores
Ngamini <
> > > >> > >>>> > > > ngaminidas at gmail.com>
> > > >> > >>>> > > > > a
> > > >> > >>>> > > > > > > écrit :
> > > >> > >>>> > > > > > >
> > > >> > >>>> > > > > > >> Thank you very much.
> > > >> > >>>> > > > > > >>
> > > >> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John Halley
Gotway
> > via
> > > >> RT <
> > > >> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
> > > >> > >>>> > > > > > >>
> > > >> > >>>> > > > > > >>> Dores,
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> OK, great. Thanks for sending some
sample
> data.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> When getting started with new datasets
in MET,
> I
> > > >> always
> > > >> > >>>> start
> > > >> > >>>> > by
> > > >> > >>>> > > > > > running
> > > >> > >>>> > > > > > >>> the plot_data_plane tool to make sure
MET can
> > read
> > > >> the
> > > >> > >>>> data and
> > > >> > >>>> > > > place
> > > >> > >>>> > > > > > it
> > > >> > >>>> > > > > > >>> on
> > > >> > >>>> > > > > > >>> the earth correctly.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant NetCDF
> format,
> > > and
> > > >> MET
> > > >> > >>>> can
> > > >> > >>>> > > easily
> > > >> > >>>> > > > > > read
> > > >> > >>>> > > > > > >>> that:
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane
> > > >> **ERAI_pw.nc
> > > >> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> > > >> > >>>> > level="(2018071900,*,*)";'
> > > >> > >>>> > > -v
> > > >> > >>>> > > > > 4*
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Next for the WRF output. When I try
passing it
> > to
> > > >> MET
> > > >> > >>>> > directly,
> > > >> > >>>> > > I
> > > >> > >>>> > > > > get
> > > >> > >>>> > > > > > an
> > > >> > >>>> > > > > > >>> error message:
> > > >> > >>>> > > > > > >>> ERROR : plot_data_plane -> file "
> wrfout_19_2.nc
> > "
> > > >> not a
> > > >> > >>>> valid
> > > >> > >>>> > > data
> > > >> > >>>> > > > > > file
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> However, since this is on a lat/lon
grid, we
> can
> > > just
> > > >> > >>>> tell MET
> > > >> > >>>> > to
> > > >> > >>>> > > > > > >>> interpret
> > > >> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like
this
> > > >> "file_type =
> > > >> > >>>> > > > > NETCDF_NCCF;":
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane **
> > > >> > >>>> wrfout_19_2.nc
> > > >> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
> wrfout_pw_2018071900.ps
> > > >> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps>
**'name="pw";
> > > >> > >>>> > > > > > level="(2018071900,*,*)";
> > > >> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> PNG versions of the resulting images are
> > attached.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Looking at these images, we see that MET
is
> able
> > to
> > > >> read
> > > >> > >>>> data
> > > >> > >>>> > > from
> > > >> > >>>> > > > > > them.
> > > >> > >>>> > > > > > >>> And I'll leave it to you to confirm that
MET is
> > > >> placing
> > > >> > >>>> them in
> > > >> > >>>> > > the
> > > >> > >>>> > > > > > right
> > > >> > >>>> > > > > > >>> spot on earth, but I assume it is.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
statistics
> > on
> > > >> them.
> > > >> > >>>> I've
> > > >> > >>>> > > set
> > > >> > >>>> > > > up
> > > >> > >>>> > > > > > the
> > > >> > >>>> > > > > > >>> attached Grid-Stat config file to...
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model
domain
> > using
> > > >> the
> > > >> > >>>> budget
> > > >> > >>>> > > > > > >>> interpolation
> > > >> > >>>> > > > > > >>> method
> > > >> > >>>> > > > > > >>> regrid = {
> > > >> > >>>> > > > > > >>> to_grid = FCST;
> > > >> > >>>> > > > > > >>> method = BUDGET;
> > > >> > >>>> > > > > > >>> width = 2;
> > > >> > >>>> > > > > > >>> vld_thresh = 0.5;
> > > >> > >>>> > > > > > >>> shape = SQUARE;
> > > >> > >>>> > > > > > >>> }
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> (2) Transfer the config options from the
> > > >> plot_data_plane
> > > >> > >>>> > command
> > > >> > >>>> > > > line
> > > >> > >>>> > > > > > to
> > > >> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries. For
> > > convenience,
> > > >> I
> > > >> > >>>> defined
> > > >> > >>>> > > the
> > > >> > >>>> > > > > time
> > > >> > >>>> > > > > > >>> as
> > > >> > >>>> > > > > > >>> an environment variable named $VXTIME:
> > > >> > >>>> > > > > > >>> fcst = {
> > > >> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
> > > >> > >>>> > > > > > >>> field = [ { name = "pw"; level=
[
> > > >> > >>>> "(${VXTIME},*,*)" ];
> > > >> > >>>> > }
> > > >> > >>>> > > ];
> > > >> > >>>> > > > > > >>> }
> > > >> > >>>> > > > > > >>> obs = {
> > > >> > >>>> > > > > > >>> field = [ { name = "tcw"; level=
[
> > > >> > >>>> "(${VXTIME},*,*)" ];
> > > >> > >>>> > }
> > > >> > >>>> > > ];
> > > >> > >>>> > > > > > >>> }
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> (3) Compute stats over the FULL model
domain.
> > > >> > >>>> > > > > > >>> mask = {
> > > >> > >>>> > > > > > >>> grid = [ "FULL" ];
> > > >> > >>>> > > > > > >>> poly = [];
> > > >> > >>>> > > > > > >>> }
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> (4) And just compute continuous stats.
> > > >> > >>>> > > > > > >>> output_flag = {
> > > >> > >>>> > > > > > >>> ...
> > > >> > >>>> > > > > > >>> cnt = BOTH;
> > > >> > >>>> > > > > > >>> ...
> > > >> > >>>> > > > > > >>> }
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Finally, run Grid-Stat on the command
line like
> > > this:
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> *mkdir -p out*
> > > >> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> > > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
> > wrfout_19_2.nc
> > > <
> > > >> > >>>> > > > > > >>> http://wrfout_19_2.nc>
> > > >> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir out
-v 3*
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> And that run successfully and creates
output
> > files:
> > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > >> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
> > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for
example, the
> > > RMSE
> > > >> > >>>> value =
> > > >> > >>>> > > > 3.39378.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Hope this helps get you up and running
with
> MET.
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> Thanks,
> > > >> > >>>> > > > > > >>> John Halley Gotway
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das
Dores
> > Ngamini
> > > >> via
> > > >> > RT
> > > >> > >>>> <
> > > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > > >> > >>>> > > > > > >>> wrote:
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>> > <URL:
> > > >> > >>>> >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > >> > >>>> > > >
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>> > Hello John,
> > > >> > >>>> > > > > > >>> > I have already sent my data to my ftp
site.
> In
> > > >> these
> > > >> > >>>> files, I
> > > >> > >>>> > > > want
> > > >> > >>>> > > > > to
> > > >> > >>>> > > > > > >>> > extract the pw. There is another
missing ERAI
> > > file.
> > > >> > That
> > > >> > >>>> > one, I
> > > >> > >>>> > > > > have
> > > >> > >>>> > > > > > >>> > trouble sending it. It contains the
relative
> > > >> humidity
> > > >> > >>>> and
> > > >> > >>>> > wind
> > > >> > >>>> > > > > data.
> > > >> > >>>> > > > > > >>> > Please,
> > > >> > >>>> > > > > > >>> > just tell me how to do it because I
can not
> > send
> > > >> this
> > > >> > >>>> file.
> > > >> > >>>> > > There
> > > >> > >>>> > > > > are
> > > >> > >>>> > > > > > >>> two
> > > >> > >>>> > > > > > >>> > wrfout files because my forecasts are
made
> over
> > > 24
> > > >> > >>>> hours or
> > > >> > >>>> > > more.
> > > >> > >>>> > > > > My
> > > >> > >>>> > > > > > >>> raw
> > > >> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can
not send
> > > them.
> > > >> > >>>> That's
> > > >> > >>>> > why I
> > > >> > >>>> > > > > sent
> > > >> > >>>> > > > > > >>> those
> > > >> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for
the
> other
> > > >> files
> > > >> > to
> > > >> > >>>> be
> > > >> > >>>> > > sent,
> > > >> > >>>> > > > > the
> > > >> > >>>> > > > > > >>> time
> > > >> > >>>> > > > > > >>> > to deposit my memory will expire.
> > > >> > >>>> > > > > > >>> > Thank you very much for helping me.
> > > >> > >>>> > > > > > >>> > Yours sincerely.
> > > >> > >>>> > > > > > >>> > Dores
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John
Halley
> > Gotway
> > > >> via
> > > >> > RT
> > > >> > >>>> <
> > > >> > >>>> > > > > > >>> met_help at ucar.edu
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > a écrit :
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>> > > Dores,
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > Were you able to post any data to
the ftp
> > site?
> > > >> You
> > > >> > >>>> could
> > > >> > >>>> > > try
> > > >> > >>>> > > > > > >>> sending
> > > >> > >>>> > > > > > >>> > via
> > > >> > >>>> > > > > > >>> > > email but I worry that the data
files will
> be
> > > too
> > > >> > >>>> large to
> > > >> > >>>> > > > > transfer
> > > >> > >>>> > > > > > >>> that
> > > >> > >>>> > > > > > >>> > > way.
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > Stephen is right... you need to put
the
> files
> > > >> one by
> > > >> > >>>> way.
> > > >> > >>>> > By
> > > >> > >>>> > > > way
> > > >> > >>>> > > > > > of
> > > >> > >>>> > > > > > >>> > > example, here are commands to create
a file
> > > named
> > > >> > >>>> > > > hello_world.txt
> > > >> > >>>> > > > > > and
> > > >> > >>>> > > > > > >>> > post
> > > >> > >>>> > > > > > >>> > > it to our ftp site.
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > cd /home/johnhg
> > > >> > >>>> > > > > > >>> > > echo "hello world" > hello_world.txt
> > > >> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> > > >> > >>>> > > > > > >>> > > username = anonymous
> > > >> > >>>> > > > > > >>> > > password = "my email address"
> > > >> > >>>> > > > > > >>> > > cd incoming/irap/met_help/dores_data
> > > >> > >>>> > > > > > >>> > > put hello_world.txt
> > > >> > >>>> > > > > > >>> > > bye
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > And then checking the ftp via a web
> browser:
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > I see that file now exists. Just be
sure
> > that
> > > >> > you're
> > > >> > >>>> in
> > > >> > >>>> > the
> > > >> > >>>> > > > > > >>> directory
> > > >> > >>>> > > > > > >>> > > which contains the files you want to
send
> > > before
> > > >> > >>>> running
> > > >> > >>>> > ftp.
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > Thanks,
> > > >> > >>>> > > > > > >>> > > John
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM
Stephen
> Dowdy
> > > via
> > > >> > RT <
> > > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > > >> > >>>> > > > > > >>> > > wrote:
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > > <URL:
> > > >> > >>>> > > >
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > > John,
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP
ticket from
> > > Dores
> > > >> > into
> > > >> > >>>> this
> > > >> > >>>> > > > ticket
> > > >> > >>>> > > > > > >>> with
> > > >> > >>>> > > > > > >>> > > > explanation of what i think the
problem
> is
> > > >> > >>>> (specifying
> > > >> > >>>> > full
> > > >> > >>>> > > > > paths
> > > >> > >>>> > > > > > >>> on
> > > >> > >>>> > > > > > >>> > the
> > > >> > >>>> > > > > > >>> > > > files w/o telling the FTP server
to
> rename
> > to
> > > >> > >>>> non-pathed
> > > >> > >>>> > > > > > filename.
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > > If you want, it might be helpful
to add
> > > >> something
> > > >> > >>>> about
> > > >> > >>>> > > that
> > > >> > >>>> > > > to
> > > >> > >>>> > > > > > >>> your
> > > >> > >>>> > > > > > >>> > Met
> > > >> > >>>> > > > > > >>> > > > Help FTP upload page.
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > > > thanks,
> > > >> > >>>> > > > > > >>> > > > --stephen
> > > >> > >>>> > > > > > >>> > > >
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> > >
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>> >
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > > >>>
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > > >
> > > >> > >>>> > > >
> > > >> > >>>> > > >
> > > >> > >>>> > >
> > > >> > >>>> > >
> > > >> > >>>> >
> > > >> > >>>> >
> > > >> > >>>>
> > > >> > >>>>
> > > >> >
> > > >> >
> > > >>
> > > >>
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Wed Nov 06 00:55:08 2019
Thank you very much.
Dorès
Le mar. 5 nov. 2019 à 17:25, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> In the past, we've recommended that user's cite the User's Guide.
Look on
> page 17 of the User's Guide:
>
> https://dtcenter.org/sites/default/files/community-
code/met/docs/user-guide/MET_Users_Guide_v8.1.1.pdf
>
> There the citation is listed as:
> K. Newman, T. Jensen, Brown, B., R. Bullock, T. Fowler, 2018, and J.
Halley
> Gotway: The Model Evaluation Tools v8.1 (METv8.1) User's Guide.
> Developmental Testbed Center. Available at:
>
> https://dtcenter.org/community-code/model-evaluation-tools-
met/documentation/MET_Users_Guide_v8.1.pdf
> 437 pp.
>
> Thanks,
> John
>
> On Tue, Nov 5, 2019 at 8:13 AM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hello John
> > Thank you for your help. I will try again until I have the
solution.
> > Please,
> > can you tell me how to refer to MET ?
> > Best regards
> > Dorès
> >
> > Le lun. 4 nov. 2019 à 17:28, John Halley Gotway via RT <
> met_help at ucar.edu>
> > a écrit :
> >
> > > Dores,
> > >
> > > I see that you are getting the following error message:
> > > *ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> > file
> > > "wrfout_20_2.nc <http://wrfout_20_2.nc>"*
> > >
> > > Of course there is not enough information in that single ERROR
message
> > line
> > > to diagnose the source of the problem. Looking back at the
history on
> > this
> > > ticket, I see that you've sent me two wrfout files, named "
> > wrfout_19_2.nc"
> > > and "wrfout_25_2.nc". I do not have the file named
wrfout_20_2.nc
> which
> > > is
> > > the source of the problem.
> > >
> > > But I'm making the assumption here that wrfout_20_2.nc is
formatted
> > > *exactly* the same way as wrfout_19_2.nc but just contains
different
> > > dates. So demonstrating that the MET software can run on
> wrfout_19_2.nc
> > > should be sufficient. If those two files are formatted
differently,
> then
> > > you should figure out why and fix that issue.
> > >
> > > No, I am not able to process this data for you. The MET-Help
email
> > support
> > > is intended to answer clarifying questions and point users in
the right
> > > direction. But we do not have the time or funding to support
users at
> > the
> > > level you're requesting.
> > >
> > > Let me demonstrate how I am able to run grid_stat to compare the
files
> > > wrfout_19_2.nc and ERAI_pw.nc. And that should give you enough
> > > information
> > > to run grid_stat yourself on the other data. Please copy and
paste the
> > > following commands (of course you'll need to update the path to
the
> > > grid_stat executable):
> > >
> > > *wget
> > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > <
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > >*
> > >
> > > *wget
> > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> > > <
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
> > > >*
> > >
> > > *wget
> > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > <
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > >*
> > > *mkdir out*
> > > *setenv VXTIME "20180719"*
> > > */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
> > http://wrfout_19_2.nc>
> > > ERAI_pw.nc GridStatConfig_pw -outdir out*
> > >
> > > I've attached a tarball of the resulting output files
"out.tar.gz".
> > Notice
> > > that I set VXTIME to "20180719" for the file named
wrfout_19_2.nc.
> Your
> > > wrfout_20_2.nc will contain data starting on the "20180720". So
you
> > > should
> > > change the VXTIME environment variable to match the timestamps
of the
> > data
> > > you're processing.
> > >
> > > John
> > >
> > > On Sun, Nov 3, 2019 at 10:29 PM Das Dores Ngamini via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
> > > >
> > > > Hello John
> > > > Since my gridstat tool is not running, can you please run it
for me
> and
> > > > send me the .txt, .stat output files? I have 6 wrfout left to
> execute.
> > If
> > > > you agree, I send you the other files.
> > > > However, I would like if possible to execute myself. That is
why I
> ask
> > > you
> > > > to look very carefully at the errors I am getting and to
propose a
> > > > solution.
> > > > Attached is the type of error obtained for each data,
including
> > > > wrfout_19_2.nc which gave first and the files used.
> > > >
> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> > > > VXTIME=2018072000
> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > > wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > > > DEBUG 1: Default Config File:
> > > >
> > > >
> > >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > > > DEBUG 1: User Config File: GridStatConfig_pw
> > > > ERROR :
> > > > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> > > file
> > > > "
> > > > wrfout_20_2.nc"
> > > > ERROR :
> > > > ERROR :
> > > > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
> opening
> > > file
> > > > "wrfout_20_2.nc"
> > > > ERROR :
> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > >
> > > > Thank you in advance
> > > > Dorès
> > > >
> > > >
> > > > Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini
<ngaminidas at gmail.com
> >
> > a
> > > > écrit :
> > > >
> > > > > Hello John,
> > > > > Thank you for your reply.
> > > > > ncdump -h wrfout_20_2.nc gives all the variables normally.
> However,
> > > > > plot_data_plane does not run. At this point, grid_stat is
not
> running
> > > any
> > > > > of my wrf output files, not even wrfout_19_2.nc that was
working
> > > first.
> > > > > Thank you in advance
> > > > > Dorès
> > > > >
> > > > > Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > > a écrit :
> > > > >
> > > > >> Dores,
> > > > >>
> > > > >> In the GridStatConfig_pw file, we requested data from the
> > > > >> forecast/observation files as shown below. Note that we
used an
> > > > >> environment variable named "VXTIME" to define the timestamp
of the
> > > data
> > > > we
> > > > >> want to retrieve:
> > > > >>
> > > > >> fcst = {
> > > > >> file_type = NETCDF_NCCF;
> > > > >> field = [ { name = "pw"; level= [ "(${VXTIME},*,*)"
]; }
> ];
> > > > >> }
> > > > >> obs = {
> > > > >> field = [ { name = "tcw"; level= [ "(${VXTIME},*,*)"
]; }
> ];
> > > > >> }
> > > > >>
> > > > >> You indicated that the script worked fine for the WRF file
named "
> > > > >> wrfout_19_2.nc" but errors out when processing
"wrfout_20_2.nc".
> > > > >> Presumably the timestamps differ between these two files.
I
> suggest
> > > > that
> > > > >> you:
> > > > >>
> > > > >> (1) Make sure that wrfout_20_2.nc exists and is a valid
NetCDF
> file
> > > > (run
> > > > >> "ncdump -h wrfout_20_2.nc" and make sure it prints sensible
> > results).
> > > > >> (2) Set the VXTIME environment variable to a timestamp
which
> > actually
> > > > >> exists in that file.
> > > > >> (3) Run plot_data_plane to confirm that MET processes this
data
> > fine.
> > > > For
> > > > >> example:
> > > > >>
> > > > >>
> > > > >> *setenv VXTIME 20180725*
> > > > >> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc>
25.ps
> > > > >> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)";
> file_type =
> > > > >> NETCDF_NCCF;' -v 4*
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
> > > > >> met_help at ucar.edu>
> > > > >> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > > > >> >
> > > > >> > Hello John,
> > > > >> > Please, help me to run grid_stat for my another wrfout
files. I
> > > don't
> > > > >> know
> > > > >> > what to change in the files I used to run the first
wrfout.
> > > > >> >
> > > > >> > Cordially
> > > > >> > Dorès
> > > > >> >
> > > > >> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini <
> > > ngaminidas at gmail.com
> > > > >
> > > > >> a
> > > > >> > écrit :
> > > > >> >
> > > > >> > > Hello John,
> > > > >> > > I use the same config file and the same
test_grid_stat.sh
> file.
> > > > >> > >
> > > > >> > >
> > > > >> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <
> > > > ngaminidas at gmail.com>
> > > > >> a
> > > > >> > > écrit :
> > > > >> > >
> > > > >> > >> Hello John,
> > > > >> > >> Another problem that I have now is I am not able to
run
> another
> > > > >> wrfout
> > > > >> > >> with the same command. What should I change? I have
several
> > > wrfout
> > > > >> files
> > > > >> > >> that I want to fill the CTC.
> > > > >> > >> Here the error that I have.
> > > > >> > >>
> > > > >> > >>
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > >> > >>
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > > >> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
> > > > >> > >> DEBUG 1: Default Config File:
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > > > >> > >> DEBUG 1: User Config File: GridStatConfig_pw
> > > > >> > >> ERROR :
> > > > >> > >> ERROR : MetNcCFDataFile::open(const char *) -> unable
to
> open
> > > > NetCDF
> > > > >> > >> file "wrfout_20_2.nc"
> > > > >> > >> ERROR :
> > > > >> > >> ERROR :
> > > > >> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file()
->
> error
> > > > >> opening
> > > > >> > >> file "wrfout_20_2.nc"
> > > > >> > >> ERROR :
> > > > >> > >>
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > >> > >>
> > > > >> > >> Best regards
> > > > >> > >> Dorès
> > > > >> > >>
> > > > >> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
> > > > >> ngaminidas at gmail.com>
> > > > >> > a
> > > > >> > >> écrit :
> > > > >> > >>
> > > > >> > >>> Hello John,
> > > > >> > >>> FCST_VALID_BEG = 20180719_000000
> > > > >> > >>> FCST_VALID_END = 20180719_000000
> > > > >> > >>> It is the same for OBS.
> > > > >> > >>> I want to have
> > > > >> > >>> FCST_VALID_BEG = 20180719_000000
> > > > >> > >>> FCST_VALID_END = 20180726_000000
> > > > >> > >>>
> > > > >> > >>> My another problem is how to cite MET.
> > > > >> > >>>
> > > > >> > >>> Cordially
> > > > >> > >>> Dorès
> > > > >> > >>>
> > > > >> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via
RT <
> > > > >> > >>> met_help at ucar.edu> a écrit :
> > > > >> > >>>
> > > > >> > >>>> Dores,
> > > > >> > >>>>
> > > > >> > >>>> Each time Grid-Stat or Point-Stat is run, the timing
> > > information
> > > > is
> > > > >> > >>>> extracted from the metadata of the data files. And
that
> > timing
> > > > >> > >>>> information
> > > > >> > >>>> is written to the header columns of the output
files.
> There
> > > is,
> > > > in
> > > > >> > >>>> general, no easy way of modifying the timing
information of
> > the
> > > > >> data
> > > > >> > >>>> you're
> > > > >> > >>>> processing.
> > > > >> > >>>>
> > > > >> > >>>> And I don't really understand why you would want to
change
> > that
> > > > >> timing
> > > > >> > >>>> info.
> > > > >> > >>>>
> > > > >> > >>>> We actually do have a development issue defined that
would
> > > enable
> > > > >> this
> > > > >> > >>>> in
> > > > >> > >>>> the future, but that work has not been done yet.
> > > > >> > >>>> https://github.com/NCAR/MET/issues/1020
> > > > >> > >>>>
> > > > >> > >>>> Thanks,
> > > > >> > >>>> John
> > > > >> > >>>>
> > > > >> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini
via RT <
> > > > >> > >>>> met_help at ucar.edu>
> > > > >> > >>>> wrote:
> > > > >> > >>>>
> > > > >> > >>>> >
> > > > >> > >>>> > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > > >
> > > > >> > >>>> >
> > > > >> > >>>> > Hello John,
> > > > >> > >>>> > Thanks a lot for your help.
> > > > >> > >>>> > I can already see something interesting. But, I
have
> > another
> > > > >> > problem.
> > > > >> > >>>> I
> > > > >> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
> > FCST_VALID_END
> > > > >> > OBS_LEAD
> > > > >> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where
to find
> > > them
> > > > >> and
> > > > >> > >>>> how to
> > > > >> > >>>> > take them into account when running. I predict 24
hours
> to
> > > 144
> > > > >> hours
> > > > >> > >>>> (0 to
> > > > >> > >>>> > 6 days). Please help me.
> > > > >> > >>>> >
> > > > >> > >>>> > Thank you in advance.
> > > > >> > >>>> >
> > > > >> > >>>> > Dorès
> > > > >> > >>>> >
> > > > >> > >>>> >
> > > > >> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway
via RT <
> > > > >> > >>>> met_help at ucar.edu
> > > > >> > >>>> > >
> > > > >> > >>>> > a écrit :
> > > > >> > >>>> >
> > > > >> > >>>> > > Dores,
> > > > >> > >>>> > >
> > > > >> > >>>> > > It looks like you're running Grid-Stat in this
way:
> > > > >> > >>>> > >
> > > > >> > >>>> > >
> > > > >> > >>>> > >
> > > > >> > >>>> > > *dores at dores
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
> > > > >> > >>>> > > grid_statwrfout_19_2.nc
> > > > >> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
> > > > >> > >>>> > >
> > > > >> > >>>> > > And Grid-Stat is printing out the usage
statement to
> > > indicate
> > > > >> that
> > > > >> > >>>> you
> > > > >> > >>>> > have
> > > > >> > >>>> > > provided the correct input arguments.
> > > > >> > >>>> > >
> > > > >> > >>>> > > Grid-Stat has 3 required arguments on the
command line:
> > > > >> > >>>> > > (1) the path to the forecast file
> > > > >> > >>>> > > (2) the path to the observation file
> > > > >> > >>>> > > (3) the path the grid_stat configuration file
> > > > >> > >>>> > >
> > > > >> > >>>> > > You have provided the first 2 but not the 3rd.
Please
> > try
> > > > >> running
> > > > >> > >>>> > > grid_stat will all 3 required arguments:
> > > > >> > >>>> > >
> > > > >> > >>>> > >
> > > > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > > >> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
> > > > >> > >>>> > >
> > > > >> > >>>> > > And there is no requirement for the directory
structure
> > to
> > > be
> > > > >> > >>>> used. You
> > > > >> > >>>> > > can either provide the full absolute path the
the input
> > > > files,
> > > > >> or
> > > > >> > >>>> the
> > > > >> > >>>> > > relative path. If these files are all in your
current
> > > > working
> > > > >> > >>>> directory,
> > > > >> > >>>> > > you just list the filenames.
> > > > >> > >>>> > >
> > > > >> > >>>> > > John
> > > > >> > >>>> > >
> > > > >> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores
Ngamini via
> RT
> > <
> > > > >> > >>>> > > met_help at ucar.edu>
> > > > >> > >>>> > > wrote:
> > > > >> > >>>> > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > Hello John,
> > > > >> > >>>> > > > Excuse me for not understanding. I would like
to
> > > > interpolate
> > > > >> on
> > > > >> > >>>> the
> > > > >> > >>>> > grid
> > > > >> > >>>> > > > points in order to also have the "RMSE" and
the
> > "Pearson
> > > > >> > >>>> correlation
> > > > >> > >>>> > > > coefficient" in addition to the contingency
table.
> For
> > > this
> > > > >> > fact,
> > > > >> > >>>> I put
> > > > >> > >>>> > > > ctc, cts and cnt at BOTH.
> > > > >> > >>>> > > > But, my problem remains the same: how do I
execute my
> > > > >> grid-stat
> > > > >> > >>>> and in
> > > > >> > >>>> > > what
> > > > >> > >>>> > > > directory. In fact, I would like to know which
files
> to
> > > > use,
> > > > >> > >>>> where to
> > > > >> > >>>> > put
> > > > >> > >>>> > > > these files and how to handle them. For the
moment, I
> > > have
> > > > >> > >>>> created a
> > > > >> > >>>> > > > symbolic link between the directory containing
my
> data
> > > and
> > > > >> the
> > > > >> > >>>> > directory
> > > > >> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in
the
> config
> > > > >> directory
> > > > >> > >>>> and
> > > > >> > >>>> > also
> > > > >> > >>>> > > > in bin. I modify the test_grid_stat.sh and I
left it
> in
> > > the
> > > > >> > >>>> examples
> > > > >> > >>>> > > > directory. When I run in bin following the
command
> you
> > > sent
> > > > >> me,
> > > > >> > I
> > > > >> > >>>> have
> > > > >> > >>>> > > > these errors.
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > dores at dores
> > :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > >> > >>>> > > >
> > > > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > > > >> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > Usage: grid_stat
> > > > >> > >>>> > > > fcst_file
> > > > >> > >>>> > > > obs_file
> > > > >> > >>>> > > > config_file
> > > > >> > >>>> > > > [-outdir path]
> > > > >> > >>>> > > > [-log file]
> > > > >> > >>>> > > > [-v level]
> > > > >> > >>>> > > > [-compress level]
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > where "fcst_file" is a gridded
forecast
> file
> > > > >> > containing
> > > > >> > >>>> the
> > > > >> > >>>> > > > field(s) to be verified (required).
> > > > >> > >>>> > > > "obs_file" is a gridded
observation
> > file
> > > > >> > >>>> containing the
> > > > >> > >>>> > > > verifying field(s) (required).
> > > > >> > >>>> > > > "config_file" is a
GridStatConfig
> file
> > > > >> > containing
> > > > >> > >>>> the
> > > > >> > >>>> > > > desired configuration settings (required).
> > > > >> > >>>> > > > "-outdir path" overrides the
default
> > > output
> > > > >> > >>>> directory
> > > > >> > >>>> > (.)
> > > > >> > >>>> > > > (optional).
> > > > >> > >>>> > > > "-log file" outputs log
messages to
> the
> > > > >> > specified
> > > > >> > >>>> file
> > > > >> > >>>> > > > (optional).
> > > > >> > >>>> > > > "-v level" overrides the
default
> level
> > of
> > > > >> > logging
> > > > >> > >>>> (2)
> > > > >> > >>>> > > > (optional).
> > > > >> > >>>> > > > "-compress level" overrides
the
> > > compression
> > > > >> > level
> > > > >> > >>>> of
> > > > >> > >>>> > > NetCDF
> > > > >> > >>>> > > > variable (0) (optional).
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > dores at dores
> > :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > Here is my test_grid_stat.sh file
> > > > >> > >>>> > > > Cordially Dores.
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley
Gotway via
> > RT <
> > > > >> > >>>> > > met_help at ucar.edu
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > a écrit :
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > > Das,
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > Good news. It is very easy to configure
Grid-Stat
> to
> > > > >> compute
> > > > >> > >>>> 2x2
> > > > >> > >>>> > > > > contingency tables. We just need to edit
the
> config
> > > file
> > > > >> > to...
> > > > >> > >>>> > > > > (1) Define the categorical thresholds that
should
> be
> > > > >> applied
> > > > >> > >>>> > > (cat_thresh
> > > > >> > >>>> > > > =
> > > > >> > >>>> > > > > [ >20, >30, >40, >50 ];)
> > > > >> > >>>> > > > > (2) Turn on the CTC and CTS output line
types (ctc
> =
> > > > BOTH;
> > > > >> > cts =
> > > > >> > >>>> > BOTH;)
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > You can of course change those thresholds
however
> > you'd
> > > > >> like.
> > > > >> > >>>> Here
> > > > >> > >>>> > are
> > > > >> > >>>> > > > > more commands to illustrate this:
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > # Pull sample data from ftp site
> > > > >> > >>>> > > > > wget
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
> > > > >> > >>>> > > > > wget
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
> > > > >> > >>>> > > > > wget
> > > > >> > >>>> > >
> > > > >> >
> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
> > > > >> > >>>> > > > > GridStatConfig_pw
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > # Create output directory and run Grid-Stat
> > > > >> > >>>> > > > > mkdir -p out
> > > > >> > >>>> > > > > export VXTIME=2018071900
> > > > >> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
> > > > >> ERAI_pw.nc
> > > > >> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > Then take a look at the output files:
> > > > >> > >>>> > > > >
out/grid_stat_000000L_20180719_000000V_ctc.txt
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > The _ctc.txt file contains the counts for
the 2x2
> > > > >> contingency
> > > > >> > >>>> table
> > > > >> > >>>> > for
> > > > >> > >>>> > > > > each of the 4 thresholds we specified.
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > Hope this helps get you going.
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > Thanks,
> > > > >> > >>>> > > > > John
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores
Ngamini
> via
> > > RT
> > > > <
> > > > >> > >>>> > > > > met_help at ucar.edu>
> > > > >> > >>>> > > > > wrote:
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > > > hello John,
> > > > >> > >>>> > > > > > Excuse me, I beg you, to bother you.
> > > > >> > >>>> > > > > > I created a symbolic link between my data
and the
> > > > >> > pcp-combines
> > > > >> > >>>> > > > > directory. I
> > > > >> > >>>> > > > > > used test_grid_stat.sh which I modified. I
> compile
> > > it,
> > > > it
> > > > >> > did
> > > > >> > >>>> not
> > > > >> > >>>> > > > produce
> > > > >> > >>>> > > > > > anything. I tried the command lines you
sent me
> > and I
> > > > get
> > > > >> > the
> > > > >> > >>>> > errors
> > > > >> > >>>> > > I
> > > > >> > >>>> > > > > sent
> > > > >> > >>>> > > > > > you. I really have no idea to get me out.
I beg
> > you,
> > > > >> please,
> > > > >> > >>>> to
> > > > >> > >>>> > help
> > > > >> > >>>> > > > me.
> > > > >> > >>>> > > > > > Attaching my test_grid_stat.sh file.
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores
Ngamini <
> > > > >> > >>>> > > ngaminidas at gmail.com>
> > > > >> > >>>> > > > a
> > > > >> > >>>> > > > > > écrit :
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > > > > Hello John,
> > > > >> > >>>> > > > > > > I am still unable to pull out my
contingency
> > table
> > > > >> (CTC)
> > > > >> > >>>> with
> > > > >> > >>>> > MET.
> > > > >> > >>>> > > I
> > > > >> > >>>> > > > > have
> > > > >> > >>>> > > > > > > read your email, the user guide, the
online
> > > tutorial,
> > > > >> but
> > > > >> > I
> > > > >> > >>>> still
> > > > >> > >>>> > > do
> > > > >> > >>>> > > > > not
> > > > >> > >>>> > > > > > > understand how I should run.
> > > > >> > >>>> > > > > > > I see the lines of code:
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > Use: grid_stat
> > > > >> > >>>> > > > > > > fcst_file
> > > > >> > >>>> > > > > > > obs_file
> > > > >> > >>>> > > > > > > config_file
> > > > >> > >>>> > > > > > > [-outdir path]
> > > > >> > >>>> > > > > > > [-log file]
> > > > >> > >>>> > > > > > > [-v level]
> > > > >> > >>>> > > > > > > [-compress level]
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > And, I do not know where I have to write
them.
> > > > >> > >>>> > > > > > > I see your run command lines:
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > * mkdir -p out *
> > > > >> > >>>> > > > > > > * setenv VXTIME "2018071900" *
> > > > >> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin /
grid_stat
> > > > >> > >>>> wrfout_19_2.nc <
> > > > >> > >>>> > > > > > > http://wrfout_19_2.nc>
> > > > >> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir out
-v 3 *
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > "setenv" did not give, I had to install
> "getenv".
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > Command 'setenv' not found, did you
mean:
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > command 'getenv' from snap getenv
(0.2.0)
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > See 'snap info <snapname>' for
additional
> > versions.
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > But when I try to run, I have errors:
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $ getenv
VXTIME
> > > > >> "2018071900"
> > > > >> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f]
[-o
> > > > >> <project_name>]
> > > > >> > >>>> [-s
> > > > >> > >>>> > > > > > > <source_dir>]
> > > > >> > >>>> > > > > > > getenv: error: unrecognized arguments:
VXTIME
> > > > >> 2018071900
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > > >> > >>>> > > > > > > wrfout_19_2.nc
> > > > >> > >>>> > > > > > > bash: /usr/local/met-
8.1.1/bin/grid_stat: No
> such
> > > > file
> > > > >> or
> > > > >> > >>>> > directory
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
> > > > >> > >>>> > > > > > > .nc
> > > > >> > >>>> > > > > > > bash:
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
> > > > >> > >>>> > > > > > > Is a directory
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $
> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
> > > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2. n>
> > > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
> > TP_Prevision /
> > > > >> MET /
> > > > >> > >>>> 8.1 /
> > > > >> > >>>> > > > > met-8.1.1
> > > > >> > >>>> > > > > > > / scripts / examples / exem $ ERAI_pw.nc
> > > > >> GridStatConfig_pw
> > > > >> > >>>> > -outdir
> > > > >> > >>>> > > > out
> > > > >> > >>>> > > > > > -v 3
> > > > >> > >>>> > > > > > > ERAI_pw.nc: command not found
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > Can you please, send me your execution
script.
> > > > >> > >>>> > > > > > > I may not be performing them properly.
Please
> > help
> > > > me.
> > > > >> I'm
> > > > >> > >>>> lost.
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > Best regards
> > > > >> > >>>> > > > > > > Dores
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores
> Ngamini <
> > > > >> > >>>> > > > ngaminidas at gmail.com>
> > > > >> > >>>> > > > > a
> > > > >> > >>>> > > > > > > écrit :
> > > > >> > >>>> > > > > > >
> > > > >> > >>>> > > > > > >> Thank you very much.
> > > > >> > >>>> > > > > > >>
> > > > >> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John
Halley
> Gotway
> > > via
> > > > >> RT <
> > > > >> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
> > > > >> > >>>> > > > > > >>
> > > > >> > >>>> > > > > > >>> Dores,
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> OK, great. Thanks for sending some
sample
> > data.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> When getting started with new datasets
in
> MET,
> > I
> > > > >> always
> > > > >> > >>>> start
> > > > >> > >>>> > by
> > > > >> > >>>> > > > > > running
> > > > >> > >>>> > > > > > >>> the plot_data_plane tool to make sure
MET can
> > > read
> > > > >> the
> > > > >> > >>>> data and
> > > > >> > >>>> > > > place
> > > > >> > >>>> > > > > > it
> > > > >> > >>>> > > > > > >>> on
> > > > >> > >>>> > > > > > >>> the earth correctly.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant
NetCDF
> > format,
> > > > and
> > > > >> MET
> > > > >> > >>>> can
> > > > >> > >>>> > > easily
> > > > >> > >>>> > > > > > read
> > > > >> > >>>> > > > > > >>> that:
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane
> > > > >> **ERAI_pw.nc
> > > > >> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
> > > > >> > >>>> > level="(2018071900,*,*)";'
> > > > >> > >>>> > > -v
> > > > >> > >>>> > > > > 4*
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Next for the WRF output. When I try
passing
> it
> > > to
> > > > >> MET
> > > > >> > >>>> > directly,
> > > > >> > >>>> > > I
> > > > >> > >>>> > > > > get
> > > > >> > >>>> > > > > > an
> > > > >> > >>>> > > > > > >>> error message:
> > > > >> > >>>> > > > > > >>> ERROR : plot_data_plane -> file "
> > wrfout_19_2.nc
> > > "
> > > > >> not a
> > > > >> > >>>> valid
> > > > >> > >>>> > > data
> > > > >> > >>>> > > > > > file
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> However, since this is on a lat/lon
grid, we
> > can
> > > > just
> > > > >> > >>>> tell MET
> > > > >> > >>>> > to
> > > > >> > >>>> > > > > > >>> interpret
> > > > >> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like
this
> > > > >> "file_type =
> > > > >> > >>>> > > > > NETCDF_NCCF;":
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane **
> > > > >> > >>>> wrfout_19_2.nc
> > > > >> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
> > wrfout_pw_2018071900.ps
> > > > >> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps>
> **'name="pw";
> > > > >> > >>>> > > > > > level="(2018071900,*,*)";
> > > > >> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> PNG versions of the resulting images
are
> > > attached.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Looking at these images, we see that
MET is
> > able
> > > to
> > > > >> read
> > > > >> > >>>> data
> > > > >> > >>>> > > from
> > > > >> > >>>> > > > > > them.
> > > > >> > >>>> > > > > > >>> And I'll leave it to you to confirm
that MET
> is
> > > > >> placing
> > > > >> > >>>> them in
> > > > >> > >>>> > > the
> > > > >> > >>>> > > > > > right
> > > > >> > >>>> > > > > > >>> spot on earth, but I assume it is.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
> statistics
> > > on
> > > > >> them.
> > > > >> > >>>> I've
> > > > >> > >>>> > > set
> > > > >> > >>>> > > > up
> > > > >> > >>>> > > > > > the
> > > > >> > >>>> > > > > > >>> attached Grid-Stat config file to...
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model
domain
> > > using
> > > > >> the
> > > > >> > >>>> budget
> > > > >> > >>>> > > > > > >>> interpolation
> > > > >> > >>>> > > > > > >>> method
> > > > >> > >>>> > > > > > >>> regrid = {
> > > > >> > >>>> > > > > > >>> to_grid = FCST;
> > > > >> > >>>> > > > > > >>> method = BUDGET;
> > > > >> > >>>> > > > > > >>> width = 2;
> > > > >> > >>>> > > > > > >>> vld_thresh = 0.5;
> > > > >> > >>>> > > > > > >>> shape = SQUARE;
> > > > >> > >>>> > > > > > >>> }
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> (2) Transfer the config options from
the
> > > > >> plot_data_plane
> > > > >> > >>>> > command
> > > > >> > >>>> > > > line
> > > > >> > >>>> > > > > > to
> > > > >> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries.
For
> > > > convenience,
> > > > >> I
> > > > >> > >>>> defined
> > > > >> > >>>> > > the
> > > > >> > >>>> > > > > time
> > > > >> > >>>> > > > > > >>> as
> > > > >> > >>>> > > > > > >>> an environment variable named $VXTIME:
> > > > >> > >>>> > > > > > >>> fcst = {
> > > > >> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
> > > > >> > >>>> > > > > > >>> field = [ { name = "pw";
level= [
> > > > >> > >>>> "(${VXTIME},*,*)" ];
> > > > >> > >>>> > }
> > > > >> > >>>> > > ];
> > > > >> > >>>> > > > > > >>> }
> > > > >> > >>>> > > > > > >>> obs = {
> > > > >> > >>>> > > > > > >>> field = [ { name = "tcw";
level= [
> > > > >> > >>>> "(${VXTIME},*,*)" ];
> > > > >> > >>>> > }
> > > > >> > >>>> > > ];
> > > > >> > >>>> > > > > > >>> }
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> (3) Compute stats over the FULL model
domain.
> > > > >> > >>>> > > > > > >>> mask = {
> > > > >> > >>>> > > > > > >>> grid = [ "FULL" ];
> > > > >> > >>>> > > > > > >>> poly = [];
> > > > >> > >>>> > > > > > >>> }
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> (4) And just compute continuous stats.
> > > > >> > >>>> > > > > > >>> output_flag = {
> > > > >> > >>>> > > > > > >>> ...
> > > > >> > >>>> > > > > > >>> cnt = BOTH;
> > > > >> > >>>> > > > > > >>> ...
> > > > >> > >>>> > > > > > >>> }
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Finally, run Grid-Stat on the command
line
> like
> > > > this:
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> *mkdir -p out*
> > > > >> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
> > > > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
> > > wrfout_19_2.nc
> > > > <
> > > > >> > >>>> > > > > > >>> http://wrfout_19_2.nc>
> > > > >> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir
out -v
> 3*
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> And that run successfully and creates
output
> > > files:
> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > > >> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > > >> > >>>> > > > out/grid_stat_000000L_20180719_000000V_cnt.txt
> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
> > > > >> > >>>> > > >
out/grid_stat_000000L_20180719_000000V_pairs.nc
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for
example,
> the
> > > > RMSE
> > > > >> > >>>> value =
> > > > >> > >>>> > > > 3.39378.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Hope this helps get you up and running
with
> > MET.
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> Thanks,
> > > > >> > >>>> > > > > > >>> John Halley Gotway
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das
Dores
> > > Ngamini
> > > > >> via
> > > > >> > RT
> > > > >> > >>>> <
> > > > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > > > >> > >>>> > > > > > >>> wrote:
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>> > <URL:
> > > > >> > >>>> >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > > >> > >>>> > > >
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>> > Hello John,
> > > > >> > >>>> > > > > > >>> > I have already sent my data to my
ftp site.
> > In
> > > > >> these
> > > > >> > >>>> files, I
> > > > >> > >>>> > > > want
> > > > >> > >>>> > > > > to
> > > > >> > >>>> > > > > > >>> > extract the pw. There is another
missing
> ERAI
> > > > file.
> > > > >> > That
> > > > >> > >>>> > one, I
> > > > >> > >>>> > > > > have
> > > > >> > >>>> > > > > > >>> > trouble sending it. It contains the
> relative
> > > > >> humidity
> > > > >> > >>>> and
> > > > >> > >>>> > wind
> > > > >> > >>>> > > > > data.
> > > > >> > >>>> > > > > > >>> > Please,
> > > > >> > >>>> > > > > > >>> > just tell me how to do it because I
can not
> > > send
> > > > >> this
> > > > >> > >>>> file.
> > > > >> > >>>> > > There
> > > > >> > >>>> > > > > are
> > > > >> > >>>> > > > > > >>> two
> > > > >> > >>>> > > > > > >>> > wrfout files because my forecasts
are made
> > over
> > > > 24
> > > > >> > >>>> hours or
> > > > >> > >>>> > > more.
> > > > >> > >>>> > > > > My
> > > > >> > >>>> > > > > > >>> raw
> > > > >> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can
not
> send
> > > > them.
> > > > >> > >>>> That's
> > > > >> > >>>> > why I
> > > > >> > >>>> > > > > sent
> > > > >> > >>>> > > > > > >>> those
> > > > >> > >>>> > > > > > >>> > in NetCDF. If I continue to wait for
the
> > other
> > > > >> files
> > > > >> > to
> > > > >> > >>>> be
> > > > >> > >>>> > > sent,
> > > > >> > >>>> > > > > the
> > > > >> > >>>> > > > > > >>> time
> > > > >> > >>>> > > > > > >>> > to deposit my memory will expire.
> > > > >> > >>>> > > > > > >>> > Thank you very much for helping me.
> > > > >> > >>>> > > > > > >>> > Yours sincerely.
> > > > >> > >>>> > > > > > >>> > Dores
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John
Halley
> > > Gotway
> > > > >> via
> > > > >> > RT
> > > > >> > >>>> <
> > > > >> > >>>> > > > > > >>> met_help at ucar.edu
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > a écrit :
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>> > > Dores,
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > Were you able to post any data to
the ftp
> > > site?
> > > > >> You
> > > > >> > >>>> could
> > > > >> > >>>> > > try
> > > > >> > >>>> > > > > > >>> sending
> > > > >> > >>>> > > > > > >>> > via
> > > > >> > >>>> > > > > > >>> > > email but I worry that the data
files
> will
> > be
> > > > too
> > > > >> > >>>> large to
> > > > >> > >>>> > > > > transfer
> > > > >> > >>>> > > > > > >>> that
> > > > >> > >>>> > > > > > >>> > > way.
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > Stephen is right... you need to
put the
> > files
> > > > >> one by
> > > > >> > >>>> way.
> > > > >> > >>>> > By
> > > > >> > >>>> > > > way
> > > > >> > >>>> > > > > > of
> > > > >> > >>>> > > > > > >>> > > example, here are commands to
create a
> file
> > > > named
> > > > >> > >>>> > > > hello_world.txt
> > > > >> > >>>> > > > > > and
> > > > >> > >>>> > > > > > >>> > post
> > > > >> > >>>> > > > > > >>> > > it to our ftp site.
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > cd /home/johnhg
> > > > >> > >>>> > > > > > >>> > > echo "hello world" >
hello_world.txt
> > > > >> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
> > > > >> > >>>> > > > > > >>> > > username = anonymous
> > > > >> > >>>> > > > > > >>> > > password = "my email address"
> > > > >> > >>>> > > > > > >>> > > cd
incoming/irap/met_help/dores_data
> > > > >> > >>>> > > > > > >>> > > put hello_world.txt
> > > > >> > >>>> > > > > > >>> > > bye
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > And then checking the ftp via a
web
> > browser:
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > I see that file now exists. Just
be sure
> > > that
> > > > >> > you're
> > > > >> > >>>> in
> > > > >> > >>>> > the
> > > > >> > >>>> > > > > > >>> directory
> > > > >> > >>>> > > > > > >>> > > which contains the files you want
to send
> > > > before
> > > > >> > >>>> running
> > > > >> > >>>> > ftp.
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > Thanks,
> > > > >> > >>>> > > > > > >>> > > John
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM
Stephen
> > Dowdy
> > > > via
> > > > >> > RT <
> > > > >> > >>>> > > > > > >>> met_help at ucar.edu>
> > > > >> > >>>> > > > > > >>> > > wrote:
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > > <URL:
> > > > >> > >>>> > > >
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > > John,
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP
ticket
> from
> > > > Dores
> > > > >> > into
> > > > >> > >>>> this
> > > > >> > >>>> > > > ticket
> > > > >> > >>>> > > > > > >>> with
> > > > >> > >>>> > > > > > >>> > > > explanation of what i think the
problem
> > is
> > > > >> > >>>> (specifying
> > > > >> > >>>> > full
> > > > >> > >>>> > > > > paths
> > > > >> > >>>> > > > > > >>> on
> > > > >> > >>>> > > > > > >>> > the
> > > > >> > >>>> > > > > > >>> > > > files w/o telling the FTP server
to
> > rename
> > > to
> > > > >> > >>>> non-pathed
> > > > >> > >>>> > > > > > filename.
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > > If you want, it might be helpful
to add
> > > > >> something
> > > > >> > >>>> about
> > > > >> > >>>> > > that
> > > > >> > >>>> > > > to
> > > > >> > >>>> > > > > > >>> your
> > > > >> > >>>> > > > > > >>> > Met
> > > > >> > >>>> > > > > > >>> > > > Help FTP upload page.
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > > > thanks,
> > > > >> > >>>> > > > > > >>> > > > --stephen
> > > > >> > >>>> > > > > > >>> > > >
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> > >
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>> >
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > > >>>
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > > >
> > > > >> > >>>> > >
> > > > >> > >>>> > >
> > > > >> > >>>> >
> > > > >> > >>>> >
> > > > >> > >>>>
> > > > >> > >>>>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Thu Nov 07 21:39:48 2019
Hello John.
I still have this problem with my files. What can I do there, please?
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
VXTIME=20180725
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
DEBUG 1: Default Config File:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_pw
ERROR :
ERROR : MetNcCFDataFile::open(const char *) -> unable to open NetCDF
file "
wrfout_25_2.nc"
ERROR :
ERROR :
ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error opening
file
"wrfout_25_2.nc"
ERROR :
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
Thank you in advance
Dorès
Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Fri Nov 08 08:52:41 2019
Dores,
I really have no idea. When I run those commands with the data you
sent to
me, it all runs fine. Perhaps you're having issues with your Linux
environment and could seek help from a local systems adminstrator.
John
johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$ export
VXTIME=20180725
johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
/usr/local/met-8.1.1/bin/grid_stat wrfout_25_2.nc ERAI_pw.nc
GridStatConfig_pw -outdir out
DEBUG 1: Default Config File:
/usr/local/met-8.1.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_pw
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744073702131037
DEBUG 1: Forecast File: wrfout_25_2.nc
DEBUG 1: Observation File: ERAI_pw.nc
DEBUG 2:
DEBUG 2: NcCfFile::getData(NcVar *, const LongArray &, DataPlane &)
const
-> data was flipped to north.
DEBUG 1: Regridding field tcw(20180725,*,*) to the verification grid.
DEBUG 2: Processing masking regions.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing pw(20180725,*,*) versus tcw(20180725,*,*), for
smoothing method NEAREST(1), over region FULL, using 3055 matched
pairs.
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V.stat
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_ctc.txt
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_cts.txt
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_cnt.txt
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_sl1l2.txt
DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_pairs.nc
On Thu, Nov 7, 2019 at 9:40 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
> Hello John.
> I still have this problem with my files. What can I do there,
please?
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> VXTIME=20180725
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
> DEBUG 1: Default Config File:
>
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_pw
> ERROR :
> ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF file
> "
> wrfout_25_2.nc"
> ERROR :
> ERROR :
> ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening file
> "wrfout_25_2.nc"
> ERROR :
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>
> Thank you in advance
> Dorès
>
> Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
> > According to our records, your request has been resolved. If you
have any
> > further questions or concerns, please respond to this message.
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Fri Nov 08 22:18:14 2019
Hello John
Please, may-you send me your output files for 201801725.
Best regards
Dorès
Le ven. 8 nov. 2019 à 16:52, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> I really have no idea. When I run those commands with the data you
sent to
> me, it all runs fine. Perhaps you're having issues with your Linux
> environment and could seek help from a local systems adminstrator.
>
> John
>
> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$ export
> VXTIME=20180725
> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
> /usr/local/met-8.1.1/bin/grid_stat wrfout_25_2.nc ERAI_pw.nc
> GridStatConfig_pw -outdir out
> DEBUG 1: Default Config File:
> /usr/local/met-8.1.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_pw
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=18446744073702131037
> DEBUG 1: Forecast File: wrfout_25_2.nc
> DEBUG 1: Observation File: ERAI_pw.nc
> DEBUG 2:
> DEBUG 2: NcCfFile::getData(NcVar *, const LongArray &, DataPlane &)
const
> -> data was flipped to north.
> DEBUG 1: Regridding field tcw(20180725,*,*) to the verification
grid.
> DEBUG 2: Processing masking regions.
> DEBUG 2:
> DEBUG 2:
>
>
--------------------------------------------------------------------------------
>
> DEBUG 2:
> DEBUG 2: Processing pw(20180725,*,*) versus tcw(20180725,*,*), for
> smoothing method NEAREST(1), over region FULL, using 3055 matched
pairs.
> DEBUG 2: Computing Categorical Statistics.
> DEBUG 2: Computing Continuous Statistics.
> DEBUG 2: Computing Scalar Partial Sums.
> DEBUG 2:
> DEBUG 2:
>
>
--------------------------------------------------------------------------------
>
> DEBUG 2:
> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V.stat
> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_ctc.txt
> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_cts.txt
> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V_cnt.txt
> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_sl1l2.txt
> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_pairs.nc
>
>
>
> On Thu, Nov 7, 2019 at 9:40 PM Das Dores Ngamini via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hello John.
> > I still have this problem with my files. What can I do there,
please?
> >
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> > VXTIME=20180725
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
> > DEBUG 1: Default Config File:
> >
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > DEBUG 1: User Config File: GridStatConfig_pw
> > ERROR :
> > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> file
> > "
> > wrfout_25_2.nc"
> > ERROR :
> > ERROR :
> > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> file
> > "wrfout_25_2.nc"
> > ERROR :
> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >
> > Thank you in advance
> > Dorès
> >
> > Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT <
> met_help at ucar.edu>
> > a écrit :
> >
> > > According to our records, your request has been resolved. If you
have
> any
> > > further questions or concerns, please respond to this message.
> > >
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sun Nov 10 23:58:55 2019
Hello John
Could you, please, send me the files you used to run grid_stat with my
data? I'm using test_grid_stat.sh and GridStatConfig_pw. But, I do not
know
if my files are damaged or if I do not use everything. Please, send me
the
files you use to run grid_stat with my data.
Best regards
Dorès
Le sam. 9 nov. 2019 à 06:17, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John
> Please, may-you send me your output files for 201801725.
>
> Best regards
> Dorès
>
> Le ven. 8 nov. 2019 à 16:52, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> Dores,
>>
>> I really have no idea. When I run those commands with the data you
sent
>> to
>> me, it all runs fine. Perhaps you're having issues with your Linux
>> environment and could seek help from a local systems adminstrator.
>>
>> John
>>
>> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$ export
>> VXTIME=20180725
>> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
>> /usr/local/met-8.1.1/bin/grid_stat wrfout_25_2.nc ERAI_pw.nc
>> GridStatConfig_pw -outdir out
>> DEBUG 1: Default Config File:
>> /usr/local/met-8.1.1/share/met/config/GridStatConfig_default
>> DEBUG 1: User Config File: GridStatConfig_pw
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=18446744073702131037
>> DEBUG 1: Forecast File: wrfout_25_2.nc
>> DEBUG 1: Observation File: ERAI_pw.nc
>> DEBUG 2:
>> DEBUG 2: NcCfFile::getData(NcVar *, const LongArray &, DataPlane &)
const
>> -> data was flipped to north.
>> DEBUG 1: Regridding field tcw(20180725,*,*) to the verification
grid.
>> DEBUG 2: Processing masking regions.
>> DEBUG 2:
>> DEBUG 2:
>>
>>
--------------------------------------------------------------------------------
>>
>> DEBUG 2:
>> DEBUG 2: Processing pw(20180725,*,*) versus tcw(20180725,*,*), for
>> smoothing method NEAREST(1), over region FULL, using 3055 matched
pairs.
>> DEBUG 2: Computing Categorical Statistics.
>> DEBUG 2: Computing Continuous Statistics.
>> DEBUG 2: Computing Scalar Partial Sums.
>> DEBUG 2:
>> DEBUG 2:
>>
>>
--------------------------------------------------------------------------------
>>
>> DEBUG 2:
>> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V.stat
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_ctc.txt
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cts.txt
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cnt.txt
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_sl1l2.txt
>> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_pairs.nc
>>
>>
>>
>> On Thu, Nov 7, 2019 at 9:40 PM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Hello John.
>> > I still have this problem with my files. What can I do there,
please?
>> >
>> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
>> > VXTIME=20180725
>> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
>> > DEBUG 1: Default Config File:
>> >
>> >
>>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
>> > DEBUG 1: User Config File: GridStatConfig_pw
>> > ERROR :
>> > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
>> file
>> > "
>> > wrfout_25_2.nc"
>> > ERROR :
>> > ERROR :
>> > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
>> file
>> > "wrfout_25_2.nc"
>> > ERROR :
>> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> >
>> > Thank you in advance
>> > Dorès
>> >
>> > Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT <
>> met_help at ucar.edu>
>> > a écrit :
>> >
>> > > According to our records, your request has been resolved. If
you have
>> any
>> > > further questions or concerns, please respond to this message.
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject: Help
From: John Halley Gotway
Time: Mon Nov 11 10:11:00 2019
Dores,
I posted a tarball with the data you requested here:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/to_dores.tar.gz
John
On Sun, Nov 10, 2019 at 11:59 PM Das Dores Ngamini via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>
> Hello John
> Could you, please, send me the files you used to run grid_stat with
my
> data? I'm using test_grid_stat.sh and GridStatConfig_pw. But, I do
not know
> if my files are damaged or if I do not use everything. Please, send
me the
> files you use to run grid_stat with my data.
>
> Best regards
> Dorès
>
> Le sam. 9 nov. 2019 à 06:17, Das Dores Ngamini
<ngaminidas at gmail.com> a
> écrit :
>
> > Hello John
> > Please, may-you send me your output files for 201801725.
> >
> > Best regards
> > Dorès
> >
> > Le ven. 8 nov. 2019 à 16:52, John Halley Gotway via RT <
> met_help at ucar.edu>
> > a écrit :
> >
> >> Dores,
> >>
> >> I really have no idea. When I run those commands with the data
you sent
> >> to
> >> me, it all runs fine. Perhaps you're having issues with your
Linux
> >> environment and could seek help from a local systems
adminstrator.
> >>
> >> John
> >>
> >> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
export
> >> VXTIME=20180725
> >> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
> >> /usr/local/met-8.1.1/bin/grid_stat wrfout_25_2.nc ERAI_pw.nc
> >> GridStatConfig_pw -outdir out
> >> DEBUG 1: Default Config File:
> >> /usr/local/met-8.1.1/share/met/config/GridStatConfig_default
> >> DEBUG 1: User Config File: GridStatConfig_pw
> >> GSL_RNG_TYPE=mt19937
> >> GSL_RNG_SEED=18446744073702131037
> >> DEBUG 1: Forecast File: wrfout_25_2.nc
> >> DEBUG 1: Observation File: ERAI_pw.nc
> >> DEBUG 2:
> >> DEBUG 2: NcCfFile::getData(NcVar *, const LongArray &, DataPlane
&)
> const
> >> -> data was flipped to north.
> >> DEBUG 1: Regridding field tcw(20180725,*,*) to the verification
grid.
> >> DEBUG 2: Processing masking regions.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
> >>
>
--------------------------------------------------------------------------------
> >>
> >> DEBUG 2:
> >> DEBUG 2: Processing pw(20180725,*,*) versus tcw(20180725,*,*),
for
> >> smoothing method NEAREST(1), over region FULL, using 3055 matched
pairs.
> >> DEBUG 2: Computing Categorical Statistics.
> >> DEBUG 2: Computing Continuous Statistics.
> >> DEBUG 2: Computing Scalar Partial Sums.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
> >>
>
--------------------------------------------------------------------------------
> >>
> >> DEBUG 2:
> >> DEBUG 1: Output file: out/grid_stat_000000L_20180725_000000V.stat
> >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_ctc.txt
> >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cts.txt
> >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cnt.txt
> >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_sl1l2.txt
> >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_pairs.nc
> >>
> >>
> >>
> >> On Thu, Nov 7, 2019 at 9:40 PM Das Dores Ngamini via RT <
> >> met_help at ucar.edu>
> >> wrote:
> >>
> >> > Hello John.
> >> > I still have this problem with my files. What can I do there,
please?
> >> >
> >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$ export
> >> > VXTIME=20180725
> >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> > /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> >> > wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
> >> > DEBUG 1: Default Config File:
> >> >
> >> >
> >>
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> >> > DEBUG 1: User Config File: GridStatConfig_pw
> >> > ERROR :
> >> > ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
> >> file
> >> > "
> >> > wrfout_25_2.nc"
> >> > ERROR :
> >> > ERROR :
> >> > ERROR : Met2dDataFileFactory::new_met_2d_data_file() -> error
opening
> >> file
> >> > "wrfout_25_2.nc"
> >> > ERROR :
> >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> >> >
> >> > Thank you in advance
> >> > Dorès
> >> >
> >> > Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT <
> >> met_help at ucar.edu>
> >> > a écrit :
> >> >
> >> > > According to our records, your request has been resolved. If
you
> have
> >> any
> >> > > further questions or concerns, please respond to this
message.
> >> > >
> >> >
> >> >
> >>
> >>
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Nov 11 13:24:06 2019
Hello John
The pleasure is given to me today to tell you that I was able to
obtain my
scores via the data you sent me. Thank you a lot for your help.
Best regards
Dorès
Le lun. 11 nov. 2019 à 18:11, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> Dores,
>
> I posted a tarball with the data you requested here:
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/to_dores.tar.gz
>
> John
>
> On Sun, Nov 10, 2019 at 11:59 PM Das Dores Ngamini via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
> >
> > Hello John
> > Could you, please, send me the files you used to run grid_stat
with my
> > data? I'm using test_grid_stat.sh and GridStatConfig_pw. But, I do
not
> know
> > if my files are damaged or if I do not use everything. Please,
send me
> the
> > files you use to run grid_stat with my data.
> >
> > Best regards
> > Dorès
> >
> > Le sam. 9 nov. 2019 à 06:17, Das Dores Ngamini
<ngaminidas at gmail.com> a
> > écrit :
> >
> > > Hello John
> > > Please, may-you send me your output files for 201801725.
> > >
> > > Best regards
> > > Dorès
> > >
> > > Le ven. 8 nov. 2019 à 16:52, John Halley Gotway via RT <
> > met_help at ucar.edu>
> > > a écrit :
> > >
> > >> Dores,
> > >>
> > >> I really have no idea. When I run those commands with the data
you
> sent
> > >> to
> > >> me, it all runs fine. Perhaps you're having issues with your
Linux
> > >> environment and could seek help from a local systems
adminstrator.
> > >>
> > >> John
> > >>
> > >> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
export
> > >> VXTIME=20180725
> > >> johnhg at number5:/d1/johnhg/MET/MET_Help/dores_data_20191025$
> > >> /usr/local/met-8.1.1/bin/grid_stat wrfout_25_2.nc ERAI_pw.nc
> > >> GridStatConfig_pw -outdir out
> > >> DEBUG 1: Default Config File:
> > >> /usr/local/met-8.1.1/share/met/config/GridStatConfig_default
> > >> DEBUG 1: User Config File: GridStatConfig_pw
> > >> GSL_RNG_TYPE=mt19937
> > >> GSL_RNG_SEED=18446744073702131037
> > >> DEBUG 1: Forecast File: wrfout_25_2.nc
> > >> DEBUG 1: Observation File: ERAI_pw.nc
> > >> DEBUG 2:
> > >> DEBUG 2: NcCfFile::getData(NcVar *, const LongArray &,
DataPlane &)
> > const
> > >> -> data was flipped to north.
> > >> DEBUG 1: Regridding field tcw(20180725,*,*) to the verification
grid.
> > >> DEBUG 2: Processing masking regions.
> > >> DEBUG 2:
> > >> DEBUG 2:
> > >>
> > >>
> >
>
--------------------------------------------------------------------------------
> > >>
> > >> DEBUG 2:
> > >> DEBUG 2: Processing pw(20180725,*,*) versus tcw(20180725,*,*),
for
> > >> smoothing method NEAREST(1), over region FULL, using 3055
matched
> pairs.
> > >> DEBUG 2: Computing Categorical Statistics.
> > >> DEBUG 2: Computing Continuous Statistics.
> > >> DEBUG 2: Computing Scalar Partial Sums.
> > >> DEBUG 2:
> > >> DEBUG 2:
> > >>
> > >>
> >
>
--------------------------------------------------------------------------------
> > >>
> > >> DEBUG 2:
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V.stat
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_ctc.txt
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cts.txt
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_cnt.txt
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_sl1l2.txt
> > >> DEBUG 1: Output file:
out/grid_stat_000000L_20180725_000000V_pairs.nc
> > >>
> > >>
> > >>
> > >> On Thu, Nov 7, 2019 at 9:40 PM Das Dores Ngamini via RT <
> > >> met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> > Hello John.
> > >> > I still have this problem with my files. What can I do there,
> please?
> > >> >
> > >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
export
> > >> > VXTIME=20180725
> > >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> > >> > wrfout_25_2.nc ERAI_pw.nc GridStatConfig_pw -outdir out
> > >> > DEBUG 1: Default Config File:
> > >> >
> > >> >
> > >>
> >
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> > >> > DEBUG 1: User Config File: GridStatConfig_pw
> > >> > ERROR :
> > >> > ERROR : MetNcCFDataFile::open(const char *) -> unable to
open
> NetCDF
> > >> file
> > >> > "
> > >> > wrfout_25_2.nc"
> > >> > ERROR :
> > >> > ERROR :
> > >> > ERROR : Met2dDataFileFactory::new_met_2d_data_file() ->
error
> opening
> > >> file
> > >> > "wrfout_25_2.nc"
> > >> > ERROR :
> > >> > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> > >> >
> > >> > Thank you in advance
> > >> > Dorès
> > >> >
> > >> > Le mer. 6 nov. 2019 à 18:55, John Halley Gotway via RT <
> > >> met_help at ucar.edu>
> > >> > a écrit :
> > >> >
> > >> > > According to our records, your request has been resolved.
If you
> > have
> > >> any
> > >> > > further questions or concerns, please respond to this
message.
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> >
> >
>
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Sat Nov 16 01:56:21 2019
Hello John,
I have a new problem. I need to extract the "RAIN_SUM" variable from
my
wrfout files to compare it to the "est_prcp" variable in the
"ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" file and fill in my contingency
table. I tried to edit the file "GridStatConfig_pw" that I renamed
"GridStatConfig_precip". When I try to run "run_gs.sh" which I also
modify,
I get the error:
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_19_2.nc ARC2_data_1-Jul_31-Jul_0p25_Camer.nc
GridStatConfig_precip
-outdir out1
DEBUG 1: Default Config File:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_precip
ERROR :
ERROR : Trouble reading observation file
"ARC2_data_1-Jul_31-Jul_0p25_Camer.nc"
ERROR :
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
I sent the file "ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" in
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
Please help me. And, if it works well , I beg you to send me the files
"GridStatConfig_precip" and "run_gs.sh" that you used, like the last
time.
Thank you in advance,
Dorès
Le lun. 11 nov. 2019 à 22:16, John Halley Gotway via RT
<met_help at ucar.edu>
a écrit :
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Mon Nov 18 09:00:40 2019
Hello John,
I have a new problem. I need to extract the "RAIN_SUM" variable from
my
wrfout files to compare it to the "est_prcp" variable in the
"ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" file and fill in my contingency
table. I tried to edit the file "GridStatConfig_pw" that I renamed
"GridStatConfig_precip". When I try to run "run_gs.sh" which I also
modify,
I get the error:
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
wrfout_19_2.nc ARC2_data_1-Jul_31-Jul_0p25_Camer.nc
GridStatConfig_precip
-outdir out1
DEBUG 1: Default Config File:
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_precip
ERROR :
ERROR : Trouble reading observation file
"ARC2_data_1-Jul_31-Jul_0p25_Camer.nc"
ERROR :
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
I sent the file "ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" in
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
Please help me. And, if it works well , I beg you to send me the files
"GridStatConfig_precip" and "run_gs.sh" that you used, like the last
time.
Thank you in advance,
Dorès
Le mer. 6 nov. 2019 à 08:54, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Thank you very much.
> Dorès
>
> Le mar. 5 nov. 2019 à 17:25, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> Dores,
>>
>> In the past, we've recommended that user's cite the User's Guide.
Look on
>> page 17 of the User's Guide:
>>
>> https://dtcenter.org/sites/default/files/community-
code/met/docs/user-guide/MET_Users_Guide_v8.1.1.pdf
>>
>> There the citation is listed as:
>> K. Newman, T. Jensen, Brown, B., R. Bullock, T. Fowler, 2018, and
J.
>> Halley
>> Gotway: The Model Evaluation Tools v8.1 (METv8.1) User's Guide.
>> Developmental Testbed Center. Available at:
>>
>> https://dtcenter.org/community-code/model-evaluation-tools-
met/documentation/MET_Users_Guide_v8.1.pdf
>> 437 pp.
>>
>> Thanks,
>> John
>>
>> On Tue, Nov 5, 2019 at 8:13 AM Das Dores Ngamini via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> > Hello John
>> > Thank you for your help. I will try again until I have the
solution.
>> > Please,
>> > can you tell me how to refer to MET ?
>> > Best regards
>> > Dorès
>> >
>> > Le lun. 4 nov. 2019 à 17:28, John Halley Gotway via RT <
>> met_help at ucar.edu>
>> > a écrit :
>> >
>> > > Dores,
>> > >
>> > > I see that you are getting the following error message:
>> > > *ERROR : MetNcCFDataFile::open(const char *) -> unable to open
NetCDF
>> > file
>> > > "wrfout_20_2.nc <http://wrfout_20_2.nc>"*
>> > >
>> > > Of course there is not enough information in that single ERROR
message
>> > line
>> > > to diagnose the source of the problem. Looking back at the
history on
>> > this
>> > > ticket, I see that you've sent me two wrfout files, named "
>> > wrfout_19_2.nc"
>> > > and "wrfout_25_2.nc". I do not have the file named
wrfout_20_2.nc
>> which
>> > > is
>> > > the source of the problem.
>> > >
>> > > But I'm making the assumption here that wrfout_20_2.nc is
formatted
>> > > *exactly* the same way as wrfout_19_2.nc but just contains
different
>> > > dates. So demonstrating that the MET software can run on
>> wrfout_19_2.nc
>> > > should be sufficient. If those two files are formatted
differently,
>> then
>> > > you should figure out why and fix that issue.
>> > >
>> > > No, I am not able to process this data for you. The MET-Help
email
>> > support
>> > > is intended to answer clarifying questions and point users in
the
>> right
>> > > direction. But we do not have the time or funding to support
users at
>> > the
>> > > level you're requesting.
>> > >
>> > > Let me demonstrate how I am able to run grid_stat to compare
the files
>> > > wrfout_19_2.nc and ERAI_pw.nc. And that should give you enough
>> > > information
>> > > to run grid_stat yourself on the other data. Please copy and
paste
>> the
>> > > following commands (of course you'll need to update the path to
the
>> > > grid_stat executable):
>> > >
>> > > *wget
>> > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>> > > <
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>> > > >*
>> > >
>> > > *wget
>> > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
>> > > <
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/GridStatConfig_pw
>> > > >*
>> > >
>> > > *wget
>> > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>> > > <
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>> > > >*
>> > > *mkdir out*
>> > > *setenv VXTIME "20180719"*
>> > > */usr/local/met-8.1.1/bin/grid_stat wrfout_19_2.nc <
>> > http://wrfout_19_2.nc>
>> > > ERAI_pw.nc GridStatConfig_pw -outdir out*
>> > >
>> > > I've attached a tarball of the resulting output files
"out.tar.gz".
>> > Notice
>> > > that I set VXTIME to "20180719" for the file named
wrfout_19_2.nc.
>> Your
>> > > wrfout_20_2.nc will contain data starting on the "20180720".
So you
>> > > should
>> > > change the VXTIME environment variable to match the timestamps
of the
>> > data
>> > > you're processing.
>> > >
>> > > John
>> > >
>> > > On Sun, Nov 3, 2019 at 10:29 PM Das Dores Ngamini via RT <
>> > > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>
>> > > >
>> > > > Hello John
>> > > > Since my gridstat tool is not running, can you please run it
for me
>> and
>> > > > send me the .txt, .stat output files? I have 6 wrfout left to
>> execute.
>> > If
>> > > > you agree, I send you the other files.
>> > > > However, I would like if possible to execute myself. That is
why I
>> ask
>> > > you
>> > > > to look very carefully at the errors I am getting and to
propose a
>> > > > solution.
>> > > > Attached is the type of error obtained for each data,
including
>> > > > wrfout_19_2.nc which gave first and the files used.
>> > > >
>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
export
>> > > > VXTIME=2018072000
>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > > wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
>> > > > DEBUG 1: Default Config File:
>> > > >
>> > > >
>> > >
>> >
>>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
>> > > > DEBUG 1: User Config File: GridStatConfig_pw
>> > > > ERROR :
>> > > > ERROR : MetNcCFDataFile::open(const char *) -> unable to
open
>> NetCDF
>> > > file
>> > > > "
>> > > > wrfout_20_2.nc"
>> > > > ERROR :
>> > > > ERROR :
>> > > > ERROR : Met2dDataFileFactory::new_met_2d_data_file() ->
error
>> opening
>> > > file
>> > > > "wrfout_20_2.nc"
>> > > > ERROR :
>> > > > dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > >
>> > > > Thank you in advance
>> > > > Dorès
>> > > >
>> > > >
>> > > > Le ven. 1 nov. 2019 à 05:57, Das Dores Ngamini <
>> ngaminidas at gmail.com>
>> > a
>> > > > écrit :
>> > > >
>> > > > > Hello John,
>> > > > > Thank you for your reply.
>> > > > > ncdump -h wrfout_20_2.nc gives all the variables normally.
>> However,
>> > > > > plot_data_plane does not run. At this point, grid_stat is
not
>> running
>> > > any
>> > > > > of my wrf output files, not even wrfout_19_2.nc that was
working
>> > > first.
>> > > > > Thank you in advance
>> > > > > Dorès
>> > > > >
>> > > > > Le jeu. 31 oct. 2019 à 22:19, John Halley Gotway via RT <
>> > > > met_help at ucar.edu>
>> > > > > a écrit :
>> > > > >
>> > > > >> Dores,
>> > > > >>
>> > > > >> In the GridStatConfig_pw file, we requested data from the
>> > > > >> forecast/observation files as shown below. Note that we
used an
>> > > > >> environment variable named "VXTIME" to define the
timestamp of
>> the
>> > > data
>> > > > we
>> > > > >> want to retrieve:
>> > > > >>
>> > > > >> fcst = {
>> > > > >> file_type = NETCDF_NCCF;
>> > > > >> field = [ { name = "pw"; level= [
"(${VXTIME},*,*)" ]; }
>> ];
>> > > > >> }
>> > > > >> obs = {
>> > > > >> field = [ { name = "tcw"; level= [
"(${VXTIME},*,*)" ]; }
>> ];
>> > > > >> }
>> > > > >>
>> > > > >> You indicated that the script worked fine for the WRF file
named
>> "
>> > > > >> wrfout_19_2.nc" but errors out when processing
"wrfout_20_2.nc".
>> > > > >> Presumably the timestamps differ between these two files.
I
>> suggest
>> > > > that
>> > > > >> you:
>> > > > >>
>> > > > >> (1) Make sure that wrfout_20_2.nc exists and is a valid
NetCDF
>> file
>> > > > (run
>> > > > >> "ncdump -h wrfout_20_2.nc" and make sure it prints
sensible
>> > results).
>> > > > >> (2) Set the VXTIME environment variable to a timestamp
which
>> > actually
>> > > > >> exists in that file.
>> > > > >> (3) Run plot_data_plane to confirm that MET processes this
data
>> > fine.
>> > > > For
>> > > > >> example:
>> > > > >>
>> > > > >>
>> > > > >> *setenv VXTIME 20180725*
>> > > > >> *plot_data_plane wrfout_25_2.nc <http://wrfout_25_2.nc>
25.ps
>> > > > >> <http://25.ps> 'name="TemC"; level="(${VXTIME},0,*,*)";
>> file_type =
>> > > > >> NETCDF_NCCF;' -v 4*
>> > > > >>
>> > > > >> Thanks,
>> > > > >> John
>> > > > >>
>> > > > >> On Wed, Oct 30, 2019 at 2:00 PM Das Dores Ngamini via RT <
>> > > > >> met_help at ucar.edu>
>> > > > >> wrote:
>> > > > >>
>> > > > >> >
>> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> >
>> > > > >> >
>> > > > >> > Hello John,
>> > > > >> > Please, help me to run grid_stat for my another wrfout
files. I
>> > > don't
>> > > > >> know
>> > > > >> > what to change in the files I used to run the first
wrfout.
>> > > > >> >
>> > > > >> > Cordially
>> > > > >> > Dorès
>> > > > >> >
>> > > > >> > Le mar. 29 oct. 2019 à 21:39, Das Dores Ngamini <
>> > > ngaminidas at gmail.com
>> > > > >
>> > > > >> a
>> > > > >> > écrit :
>> > > > >> >
>> > > > >> > > Hello John,
>> > > > >> > > I use the same config file and the same
test_grid_stat.sh
>> file.
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > Le mar. 29 oct. 2019 à 21:25, Das Dores Ngamini <
>> > > > ngaminidas at gmail.com>
>> > > > >> a
>> > > > >> > > écrit :
>> > > > >> > >
>> > > > >> > >> Hello John,
>> > > > >> > >> Another problem that I have now is I am not able to
run
>> another
>> > > > >> wrfout
>> > > > >> > >> with the same command. What should I change? I have
several
>> > > wrfout
>> > > > >> files
>> > > > >> > >> that I want to fill the CTC.
>> > > > >> > >> Here the error that I have.
>> > > > >> > >>
>> > > > >> > >>
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > > >> > >>
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > > >> > >> wrfout_20_2.nc ERAI_pw.nc GridStatConfig_pw
>> > > > >> > >> DEBUG 1: Default Config File:
>> > > > >> > >>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
>> > > > >> > >> DEBUG 1: User Config File: GridStatConfig_pw
>> > > > >> > >> ERROR :
>> > > > >> > >> ERROR : MetNcCFDataFile::open(const char *) ->
unable to
>> open
>> > > > NetCDF
>> > > > >> > >> file "wrfout_20_2.nc"
>> > > > >> > >> ERROR :
>> > > > >> > >> ERROR :
>> > > > >> > >> ERROR : Met2dDataFileFactory::new_met_2d_data_file()
->
>> error
>> > > > >> opening
>> > > > >> > >> file "wrfout_20_2.nc"
>> > > > >> > >> ERROR :
>> > > > >> > >>
dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > > >> > >>
>> > > > >> > >> Best regards
>> > > > >> > >> Dorès
>> > > > >> > >>
>> > > > >> > >> Le mar. 29 oct. 2019 à 20:53, Das Dores Ngamini <
>> > > > >> ngaminidas at gmail.com>
>> > > > >> > a
>> > > > >> > >> écrit :
>> > > > >> > >>
>> > > > >> > >>> Hello John,
>> > > > >> > >>> FCST_VALID_BEG = 20180719_000000
>> > > > >> > >>> FCST_VALID_END = 20180719_000000
>> > > > >> > >>> It is the same for OBS.
>> > > > >> > >>> I want to have
>> > > > >> > >>> FCST_VALID_BEG = 20180719_000000
>> > > > >> > >>> FCST_VALID_END = 20180726_000000
>> > > > >> > >>>
>> > > > >> > >>> My another problem is how to cite MET.
>> > > > >> > >>>
>> > > > >> > >>> Cordially
>> > > > >> > >>> Dorès
>> > > > >> > >>>
>> > > > >> > >>> Le mar. 29 oct. 2019 à 16:45, John Halley Gotway via
RT <
>> > > > >> > >>> met_help at ucar.edu> a écrit :
>> > > > >> > >>>
>> > > > >> > >>>> Dores,
>> > > > >> > >>>>
>> > > > >> > >>>> Each time Grid-Stat or Point-Stat is run, the
timing
>> > > information
>> > > > is
>> > > > >> > >>>> extracted from the metadata of the data files. And
that
>> > timing
>> > > > >> > >>>> information
>> > > > >> > >>>> is written to the header columns of the output
files.
>> There
>> > > is,
>> > > > in
>> > > > >> > >>>> general, no easy way of modifying the timing
information
>> of
>> > the
>> > > > >> data
>> > > > >> > >>>> you're
>> > > > >> > >>>> processing.
>> > > > >> > >>>>
>> > > > >> > >>>> And I don't really understand why you would want to
change
>> > that
>> > > > >> timing
>> > > > >> > >>>> info.
>> > > > >> > >>>>
>> > > > >> > >>>> We actually do have a development issue defined
that would
>> > > enable
>> > > > >> this
>> > > > >> > >>>> in
>> > > > >> > >>>> the future, but that work has not been done yet.
>> > > > >> > >>>> https://github.com/NCAR/MET/issues/1020
>> > > > >> > >>>>
>> > > > >> > >>>> Thanks,
>> > > > >> > >>>> John
>> > > > >> > >>>>
>> > > > >> > >>>> On Tue, Oct 29, 2019 at 1:37 AM Das Dores Ngamini
via RT <
>> > > > >> > >>>> met_help at ucar.edu>
>> > > > >> > >>>> wrote:
>> > > > >> > >>>>
>> > > > >> > >>>> >
>> > > > >> > >>>> > <URL:
>> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > > > >
>> > > > >> > >>>> >
>> > > > >> > >>>> > Hello John,
>> > > > >> > >>>> > Thanks a lot for your help.
>> > > > >> > >>>> > I can already see something interesting. But, I
have
>> > another
>> > > > >> > problem.
>> > > > >> > >>>> I
>> > > > >> > >>>> > would like to modify "FCST_LEAD FCST_VALID_BEG
>> > FCST_VALID_END
>> > > > >> > OBS_LEAD
>> > > > >> > >>>> > OBS_VALID_BEG OBS_VALID_END". I do not know where
to
>> find
>> > > them
>> > > > >> and
>> > > > >> > >>>> how to
>> > > > >> > >>>> > take them into account when running. I predict 24
hours
>> to
>> > > 144
>> > > > >> hours
>> > > > >> > >>>> (0 to
>> > > > >> > >>>> > 6 days). Please help me.
>> > > > >> > >>>> >
>> > > > >> > >>>> > Thank you in advance.
>> > > > >> > >>>> >
>> > > > >> > >>>> > Dorès
>> > > > >> > >>>> >
>> > > > >> > >>>> >
>> > > > >> > >>>> > Le lun. 28 oct. 2019 à 21:18, John Halley Gotway
via RT
>> <
>> > > > >> > >>>> met_help at ucar.edu
>> > > > >> > >>>> > >
>> > > > >> > >>>> > a écrit :
>> > > > >> > >>>> >
>> > > > >> > >>>> > > Dores,
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > It looks like you're running Grid-Stat in this
way:
>> > > > >> > >>>> > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > *dores at dores
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>>
:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/
>> > > > >> > >>>> > > grid_statwrfout_19_2.nc
>> > > > >> > >>>> > > <http://wrfout_19_2.nc/> ERAI_pw.nc*
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > And Grid-Stat is printing out the usage
statement to
>> > > indicate
>> > > > >> that
>> > > > >> > >>>> you
>> > > > >> > >>>> > have
>> > > > >> > >>>> > > provided the correct input arguments.
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > Grid-Stat has 3 required arguments on the
command
>> line:
>> > > > >> > >>>> > > (1) the path to the forecast file
>> > > > >> > >>>> > > (2) the path to the observation file
>> > > > >> > >>>> > > (3) the path the grid_stat configuration file
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > You have provided the first 2 but not the 3rd.
Please
>> > try
>> > > > >> running
>> > > > >> > >>>> > > grid_stat will all 3 required arguments:
>> > > > >> > >>>> > >
>> > > > >> > >>>> > >
>> > > >
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > > >> > >>>> > > wrfout_19_2.nc ERAI_pw.nc GridStatConfig_pw
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > And there is no requirement for the directory
>> structure
>> > to
>> > > be
>> > > > >> > >>>> used. You
>> > > > >> > >>>> > > can either provide the full absolute path the
the
>> input
>> > > > files,
>> > > > >> or
>> > > > >> > >>>> the
>> > > > >> > >>>> > > relative path. If these files are all in your
current
>> > > > working
>> > > > >> > >>>> directory,
>> > > > >> > >>>> > > you just list the filenames.
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > John
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > On Mon, Oct 28, 2019 at 1:45 PM Das Dores
Ngamini via
>> RT
>> > <
>> > > > >> > >>>> > > met_help at ucar.edu>
>> > > > >> > >>>> > > wrote:
>> > > > >> > >>>> > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > <URL:
>> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412 >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > Hello John,
>> > > > >> > >>>> > > > Excuse me for not understanding. I would like
to
>> > > > interpolate
>> > > > >> on
>> > > > >> > >>>> the
>> > > > >> > >>>> > grid
>> > > > >> > >>>> > > > points in order to also have the "RMSE" and
the
>> > "Pearson
>> > > > >> > >>>> correlation
>> > > > >> > >>>> > > > coefficient" in addition to the contingency
table.
>> For
>> > > this
>> > > > >> > fact,
>> > > > >> > >>>> I put
>> > > > >> > >>>> > > > ctc, cts and cnt at BOTH.
>> > > > >> > >>>> > > > But, my problem remains the same: how do I
execute
>> my
>> > > > >> grid-stat
>> > > > >> > >>>> and in
>> > > > >> > >>>> > > what
>> > > > >> > >>>> > > > directory. In fact, I would like to know
which
>> files to
>> > > > use,
>> > > > >> > >>>> where to
>> > > > >> > >>>> > put
>> > > > >> > >>>> > > > these files and how to handle them. For the
moment,
>> I
>> > > have
>> > > > >> > >>>> created a
>> > > > >> > >>>> > > > symbolic link between the directory
containing my
>> data
>> > > and
>> > > > >> the
>> > > > >> > >>>> > directory
>> > > > >> > >>>> > > > pcp-combines. I put my GridStatConfig_pw in
the
>> config
>> > > > >> directory
>> > > > >> > >>>> and
>> > > > >> > >>>> > also
>> > > > >> > >>>> > > > in bin. I modify the test_grid_stat.sh and I
left
>> it in
>> > > the
>> > > > >> > >>>> examples
>> > > > >> > >>>> > > > directory. When I run in bin following the
command
>> you
>> > > sent
>> > > > >> me,
>> > > > >> > I
>> > > > >> > >>>> have
>> > > > >> > >>>> > > > these errors.
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > dores at dores
>> > :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > > >> > >>>> > > >
>> > > > >>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
>> > > > >> > >>>> > > > wrfout_19_2.nc ERAI_pw.nc
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > *** Model Evaluation Tools (METV8.1.1) ***
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > Usage: grid_stat
>> > > > >> > >>>> > > > fcst_file
>> > > > >> > >>>> > > > obs_file
>> > > > >> > >>>> > > > config_file
>> > > > >> > >>>> > > > [-outdir path]
>> > > > >> > >>>> > > > [-log file]
>> > > > >> > >>>> > > > [-v level]
>> > > > >> > >>>> > > > [-compress level]
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > where "fcst_file" is a gridded
forecast
>> file
>> > > > >> > containing
>> > > > >> > >>>> the
>> > > > >> > >>>> > > > field(s) to be verified (required).
>> > > > >> > >>>> > > > "obs_file" is a gridded
observation
>> > file
>> > > > >> > >>>> containing the
>> > > > >> > >>>> > > > verifying field(s) (required).
>> > > > >> > >>>> > > > "config_file" is a
GridStatConfig
>> file
>> > > > >> > containing
>> > > > >> > >>>> the
>> > > > >> > >>>> > > > desired configuration settings (required).
>> > > > >> > >>>> > > > "-outdir path" overrides the
default
>> > > output
>> > > > >> > >>>> directory
>> > > > >> > >>>> > (.)
>> > > > >> > >>>> > > > (optional).
>> > > > >> > >>>> > > > "-log file" outputs log
messages to
>> the
>> > > > >> > specified
>> > > > >> > >>>> file
>> > > > >> > >>>> > > > (optional).
>> > > > >> > >>>> > > > "-v level" overrides the
default
>> level
>> > of
>> > > > >> > logging
>> > > > >> > >>>> (2)
>> > > > >> > >>>> > > > (optional).
>> > > > >> > >>>> > > > "-compress level" overrides
the
>> > > compression
>> > > > >> > level
>> > > > >> > >>>> of
>> > > > >> > >>>> > > NetCDF
>> > > > >> > >>>> > > > variable (0) (optional).
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > dores at dores
>> > :~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > Here is my test_grid_stat.sh file
>> > > > >> > >>>> > > > Cordially Dores.
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > Le lun. 28 oct. 2019 à 19:10, John Halley
Gotway via
>> > RT <
>> > > > >> > >>>> > > met_help at ucar.edu
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > a écrit :
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > > Das,
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > Good news. It is very easy to configure
>> Grid-Stat to
>> > > > >> compute
>> > > > >> > >>>> 2x2
>> > > > >> > >>>> > > > > contingency tables. We just need to edit
the
>> config
>> > > file
>> > > > >> > to...
>> > > > >> > >>>> > > > > (1) Define the categorical thresholds that
should
>> be
>> > > > >> applied
>> > > > >> > >>>> > > (cat_thresh
>> > > > >> > >>>> > > > =
>> > > > >> > >>>> > > > > [ >20, >30, >40, >50 ];)
>> > > > >> > >>>> > > > > (2) Turn on the CTC and CTS output line
types
>> (ctc =
>> > > > BOTH;
>> > > > >> > cts =
>> > > > >> > >>>> > BOTH;)
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > You can of course change those thresholds
however
>> > you'd
>> > > > >> like.
>> > > > >> > >>>> Here
>> > > > >> > >>>> > are
>> > > > >> > >>>> > > > > more commands to illustrate this:
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > # Pull sample data from ftp site
>> > > > >> > >>>> > > > > wget
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/wrfout_19_2.nc
>> > > > >> > >>>> > > > > wget
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/ERAI_pw.nc
>> > > > >> > >>>> > > > > wget
>> > > > >> > >>>> > >
>> > > > >> >
>> >
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/from_john/
>> > > > >> > >>>> > > > > GridStatConfig_pw
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > # Create output directory and run Grid-Stat
>> > > > >> > >>>> > > > > mkdir -p out
>> > > > >> > >>>> > > > > export VXTIME=2018071900
>> > > > >> > >>>> > > > > /usr/local/met-8.1.1/bin/grid_stat
wrfout_19_2.nc
>> > > > >> ERAI_pw.nc
>> > > > >> > >>>> > > > > GridStatConfig_pw -outdir out -v 3
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > Then take a look at the output files:
>> > > > >> > >>>> > > > >
out/grid_stat_000000L_20180719_000000V_ctc.txt
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > The _ctc.txt file contains the counts for
the 2x2
>> > > > >> contingency
>> > > > >> > >>>> table
>> > > > >> > >>>> > for
>> > > > >> > >>>> > > > > each of the 4 thresholds we specified.
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > Hope this helps get you going.
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > Thanks,
>> > > > >> > >>>> > > > > John
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > On Sun, Oct 27, 2019 at 9:39 AM Das Dores
Ngamini
>> via
>> > > RT
>> > > > <
>> > > > >> > >>>> > > > > met_help at ucar.edu>
>> > > > >> > >>>> > > > > wrote:
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > > > hello John,
>> > > > >> > >>>> > > > > > Excuse me, I beg you, to bother you.
>> > > > >> > >>>> > > > > > I created a symbolic link between my data
and
>> the
>> > > > >> > pcp-combines
>> > > > >> > >>>> > > > > directory. I
>> > > > >> > >>>> > > > > > used test_grid_stat.sh which I modified.
I
>> compile
>> > > it,
>> > > > it
>> > > > >> > did
>> > > > >> > >>>> not
>> > > > >> > >>>> > > > produce
>> > > > >> > >>>> > > > > > anything. I tried the command lines you
sent me
>> > and I
>> > > > get
>> > > > >> > the
>> > > > >> > >>>> > errors
>> > > > >> > >>>> > > I
>> > > > >> > >>>> > > > > sent
>> > > > >> > >>>> > > > > > you. I really have no idea to get me out.
I beg
>> > you,
>> > > > >> please,
>> > > > >> > >>>> to
>> > > > >> > >>>> > help
>> > > > >> > >>>> > > > me.
>> > > > >> > >>>> > > > > > Attaching my test_grid_stat.sh file.
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > > > Le dim. 27 oct. 2019 à 12:35, Das Dores
Ngamini
>> <
>> > > > >> > >>>> > > ngaminidas at gmail.com>
>> > > > >> > >>>> > > > a
>> > > > >> > >>>> > > > > > écrit :
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > > > > Hello John,
>> > > > >> > >>>> > > > > > > I am still unable to pull out my
contingency
>> > table
>> > > > >> (CTC)
>> > > > >> > >>>> with
>> > > > >> > >>>> > MET.
>> > > > >> > >>>> > > I
>> > > > >> > >>>> > > > > have
>> > > > >> > >>>> > > > > > > read your email, the user guide, the
online
>> > > tutorial,
>> > > > >> but
>> > > > >> > I
>> > > > >> > >>>> still
>> > > > >> > >>>> > > do
>> > > > >> > >>>> > > > > not
>> > > > >> > >>>> > > > > > > understand how I should run.
>> > > > >> > >>>> > > > > > > I see the lines of code:
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > Use: grid_stat
>> > > > >> > >>>> > > > > > > fcst_file
>> > > > >> > >>>> > > > > > > obs_file
>> > > > >> > >>>> > > > > > > config_file
>> > > > >> > >>>> > > > > > > [-outdir path]
>> > > > >> > >>>> > > > > > > [-log file]
>> > > > >> > >>>> > > > > > > [-v level]
>> > > > >> > >>>> > > > > > > [-compress level]
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > And, I do not know where I have to
write them.
>> > > > >> > >>>> > > > > > > I see your run command lines:
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > * mkdir -p out *
>> > > > >> > >>>> > > > > > > * setenv VXTIME "2018071900" *
>> > > > >> > >>>> > > > > > > * / usr / local / met-8.1.1 / bin /
grid_stat
>> > > > >> > >>>> wrfout_19_2.nc <
>> > > > >> > >>>> > > > > > > http://wrfout_19_2.nc>
>> > > > >> > >>>> > > > > > > ERAI_pw.nc GridStatConfig_pw -outdir
out -v 3
>> *
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > "setenv" did not give, I had to install
>> "getenv".
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > Command 'setenv' not found, did you
mean:
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > command 'getenv' from snap getenv
(0.2.0)
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > See 'snap info <snapname>' for
additional
>> > versions.
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > But when I try to run, I have errors:
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $ getenv
VXTIME
>> > > > >> "2018071900"
>> > > > >> > >>>> > > > > > > usage: getenv [-h] [-v] [-c] [-l] [-f]
[-o
>> > > > >> <project_name>]
>> > > > >> > >>>> [-s
>> > > > >> > >>>> > > > > > > <source_dir>]
>> > > > >> > >>>> > > > > > > getenv: error: unrecognized arguments:
VXTIME
>> > > > >> 2018071900
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $
>> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2.
n>
>> > > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $
>> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > >> > >>>> > > > > > > wrfout_19_2.nc
>> > > > >> > >>>> > > > > > > bash: /usr/local/met-
8.1.1/bin/grid_stat: No
>> such
>> > > > file
>> > > > >> or
>> > > > >> > >>>> > directory
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/wrfout_19_2
>> > > > >> > >>>> > > > > > > .nc
>> > > > >> > >>>> > > > > > > bash:
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> >
>> > > > >>
>> > > >
>> > >
>> >
>> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/met-
8.1.1/out/pcp_combine/:
>> > > > >> > >>>> > > > > > > Is a directory
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $
>> > > > >> > >>>> /usr/local/met-8.1.1/bin/grid_stat
>> > > > >> > >>>> > > > > > > wrfout_19_2.nc <http: // wrfout_19_2.
n>
>> > > > >> > >>>> > > > > > > bash: syntax error near unexpected
`newline '
>> > > > >> > >>>> > > > > > > dores @ dores: ~ / Tutorial_Master /
>> > TP_Prevision /
>> > > > >> MET /
>> > > > >> > >>>> 8.1 /
>> > > > >> > >>>> > > > > met-8.1.1
>> > > > >> > >>>> > > > > > > / scripts / examples / exem $
ERAI_pw.nc
>> > > > >> GridStatConfig_pw
>> > > > >> > >>>> > -outdir
>> > > > >> > >>>> > > > out
>> > > > >> > >>>> > > > > > -v 3
>> > > > >> > >>>> > > > > > > ERAI_pw.nc: command not found
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > Can you please, send me your execution
>> script.
>> > > > >> > >>>> > > > > > > I may not be performing them properly.
Please
>> > help
>> > > > me.
>> > > > >> I'm
>> > > > >> > >>>> lost.
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > Best regards
>> > > > >> > >>>> > > > > > > Dores
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > > Le ven. 25 oct. 2019 à 18:01, Das Dores
>> Ngamini <
>> > > > >> > >>>> > > > ngaminidas at gmail.com>
>> > > > >> > >>>> > > > > a
>> > > > >> > >>>> > > > > > > écrit :
>> > > > >> > >>>> > > > > > >
>> > > > >> > >>>> > > > > > >> Thank you very much.
>> > > > >> > >>>> > > > > > >>
>> > > > >> > >>>> > > > > > >> Le ven. 25 oct. 2019 à 17:08, John
Halley
>> Gotway
>> > > via
>> > > > >> RT <
>> > > > >> > >>>> > > > > > >> met_help at ucar.edu> a écrit :
>> > > > >> > >>>> > > > > > >>
>> > > > >> > >>>> > > > > > >>> Dores,
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> OK, great. Thanks for sending some
sample
>> > data.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> When getting started with new
datasets in
>> MET,
>> > I
>> > > > >> always
>> > > > >> > >>>> start
>> > > > >> > >>>> > by
>> > > > >> > >>>> > > > > > running
>> > > > >> > >>>> > > > > > >>> the plot_data_plane tool to make sure
MET
>> can
>> > > read
>> > > > >> the
>> > > > >> > >>>> data and
>> > > > >> > >>>> > > > place
>> > > > >> > >>>> > > > > > it
>> > > > >> > >>>> > > > > > >>> on
>> > > > >> > >>>> > > > > > >>> the earth correctly.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> The ERAI_pw.nc is in CF-compliant
NetCDF
>> > format,
>> > > > and
>> > > > >> MET
>> > > > >> > >>>> can
>> > > > >> > >>>> > > easily
>> > > > >> > >>>> > > > > > read
>> > > > >> > >>>> > > > > > >>> that:
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane
>> > > > >> **ERAI_pw.nc
>> > > > >> > >>>> > > > > > >>> ERAI_pw_2018071900.ps **'name="tcw";
>> > > > >> > >>>> > level="(2018071900,*,*)";'
>> > > > >> > >>>> > > -v
>> > > > >> > >>>> > > > > 4*
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Next for the WRF output. When I try
>> passing it
>> > > to
>> > > > >> MET
>> > > > >> > >>>> > directly,
>> > > > >> > >>>> > > I
>> > > > >> > >>>> > > > > get
>> > > > >> > >>>> > > > > > an
>> > > > >> > >>>> > > > > > >>> error message:
>> > > > >> > >>>> > > > > > >>> ERROR : plot_data_plane -> file "
>> > wrfout_19_2.nc
>> > > "
>> > > > >> not a
>> > > > >> > >>>> valid
>> > > > >> > >>>> > > data
>> > > > >> > >>>> > > > > > file
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> However, since this is on a lat/lon
grid, we
>> > can
>> > > > just
>> > > > >> > >>>> tell MET
>> > > > >> > >>>> > to
>> > > > >> > >>>> > > > > > >>> interpret
>> > > > >> > >>>> > > > > > >>> it as being CF-compliant NetCDF, like
this
>> > > > >> "file_type =
>> > > > >> > >>>> > > > > NETCDF_NCCF;":
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> */usr/local/met-
8.1.1/bin/plot_data_plane **
>> > > > >> > >>>> wrfout_19_2.nc
>> > > > >> > >>>> > > > > > >>> <http://wrfout_19_2.nc>
>> > wrfout_pw_2018071900.ps
>> > > > >> > >>>> > > > > > >>> <http://wrfout_pw_2018071900.ps>
>> **'name="pw";
>> > > > >> > >>>> > > > > > level="(2018071900,*,*)";
>> > > > >> > >>>> > > > > > >>> file_type=NETCDF_NCCF;' -v 4*
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> PNG versions of the resulting images
are
>> > > attached.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Looking at these images, we see that
MET is
>> > able
>> > > to
>> > > > >> read
>> > > > >> > >>>> data
>> > > > >> > >>>> > > from
>> > > > >> > >>>> > > > > > them.
>> > > > >> > >>>> > > > > > >>> And I'll leave it to you to confirm
that
>> MET is
>> > > > >> placing
>> > > > >> > >>>> them in
>> > > > >> > >>>> > > the
>> > > > >> > >>>> > > > > > right
>> > > > >> > >>>> > > > > > >>> spot on earth, but I assume it is.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Next, let's run Grid-Stat to compute
>> statistics
>> > > on
>> > > > >> them.
>> > > > >> > >>>> I've
>> > > > >> > >>>> > > set
>> > > > >> > >>>> > > > up
>> > > > >> > >>>> > > > > > the
>> > > > >> > >>>> > > > > > >>> attached Grid-Stat config file to...
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> (1) Regrid the ERAI data to the model
domain
>> > > using
>> > > > >> the
>> > > > >> > >>>> budget
>> > > > >> > >>>> > > > > > >>> interpolation
>> > > > >> > >>>> > > > > > >>> method
>> > > > >> > >>>> > > > > > >>> regrid = {
>> > > > >> > >>>> > > > > > >>> to_grid = FCST;
>> > > > >> > >>>> > > > > > >>> method = BUDGET;
>> > > > >> > >>>> > > > > > >>> width = 2;
>> > > > >> > >>>> > > > > > >>> vld_thresh = 0.5;
>> > > > >> > >>>> > > > > > >>> shape = SQUARE;
>> > > > >> > >>>> > > > > > >>> }
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> (2) Transfer the config options from
the
>> > > > >> plot_data_plane
>> > > > >> > >>>> > command
>> > > > >> > >>>> > > > line
>> > > > >> > >>>> > > > > > to
>> > > > >> > >>>> > > > > > >>> the "fcst" and "obs" dictionaries.
For
>> > > > convenience,
>> > > > >> I
>> > > > >> > >>>> defined
>> > > > >> > >>>> > > the
>> > > > >> > >>>> > > > > time
>> > > > >> > >>>> > > > > > >>> as
>> > > > >> > >>>> > > > > > >>> an environment variable named
$VXTIME:
>> > > > >> > >>>> > > > > > >>> fcst = {
>> > > > >> > >>>> > > > > > >>> file_type = NETCDF_NCCF;
>> > > > >> > >>>> > > > > > >>> field = [ { name = "pw";
level= [
>> > > > >> > >>>> "(${VXTIME},*,*)" ];
>> > > > >> > >>>> > }
>> > > > >> > >>>> > > ];
>> > > > >> > >>>> > > > > > >>> }
>> > > > >> > >>>> > > > > > >>> obs = {
>> > > > >> > >>>> > > > > > >>> field = [ { name = "tcw";
level= [
>> > > > >> > >>>> "(${VXTIME},*,*)" ];
>> > > > >> > >>>> > }
>> > > > >> > >>>> > > ];
>> > > > >> > >>>> > > > > > >>> }
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> (3) Compute stats over the FULL model
>> domain.
>> > > > >> > >>>> > > > > > >>> mask = {
>> > > > >> > >>>> > > > > > >>> grid = [ "FULL" ];
>> > > > >> > >>>> > > > > > >>> poly = [];
>> > > > >> > >>>> > > > > > >>> }
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> (4) And just compute continuous
stats.
>> > > > >> > >>>> > > > > > >>> output_flag = {
>> > > > >> > >>>> > > > > > >>> ...
>> > > > >> > >>>> > > > > > >>> cnt = BOTH;
>> > > > >> > >>>> > > > > > >>> ...
>> > > > >> > >>>> > > > > > >>> }
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Finally, run Grid-Stat on the command
line
>> like
>> > > > this:
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> *mkdir -p out*
>> > > > >> > >>>> > > > > > >>> *setenv VXTIME "2018071900"*
>> > > > >> > >>>> > > > > > >>> */usr/local/met-8.1.1/bin/grid_stat
>> > > wrfout_19_2.nc
>> > > > <
>> > > > >> > >>>> > > > > > >>> http://wrfout_19_2.nc>
>> > > > >> > >>>> > > > > > >>> ERAI_pw.nc GridStatConfig_pw -outdir
out -v
>> 3*
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> And that run successfully and creates
output
>> > > files:
>> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > > > >> > >>>> > out/grid_stat_000000L_20180719_000000V.stat
>> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > > > >> > >>>> > > >
out/grid_stat_000000L_20180719_000000V_cnt.txt
>> > > > >> > >>>> > > > > > >>> DEBUG 1: Output file:
>> > > > >> > >>>> > > >
out/grid_stat_000000L_20180719_000000V_pairs.nc
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Looking in the "_cnt.txt" file for
example,
>> the
>> > > > RMSE
>> > > > >> > >>>> value =
>> > > > >> > >>>> > > > 3.39378.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Hope this helps get you up and
running with
>> > MET.
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> Thanks,
>> > > > >> > >>>> > > > > > >>> John Halley Gotway
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> On Thu, Oct 24, 2019 at 10:17 PM Das
Dores
>> > > Ngamini
>> > > > >> via
>> > > > >> > RT
>> > > > >> > >>>> <
>> > > > >> > >>>> > > > > > >>> met_help at ucar.edu>
>> > > > >> > >>>> > > > > > >>> wrote:
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>> > <URL:
>> > > > >> > >>>> >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>> > Hello John,
>> > > > >> > >>>> > > > > > >>> > I have already sent my data to my
ftp
>> site.
>> > In
>> > > > >> these
>> > > > >> > >>>> files, I
>> > > > >> > >>>> > > > want
>> > > > >> > >>>> > > > > to
>> > > > >> > >>>> > > > > > >>> > extract the pw. There is another
missing
>> ERAI
>> > > > file.
>> > > > >> > That
>> > > > >> > >>>> > one, I
>> > > > >> > >>>> > > > > have
>> > > > >> > >>>> > > > > > >>> > trouble sending it. It contains the
>> relative
>> > > > >> humidity
>> > > > >> > >>>> and
>> > > > >> > >>>> > wind
>> > > > >> > >>>> > > > > data.
>> > > > >> > >>>> > > > > > >>> > Please,
>> > > > >> > >>>> > > > > > >>> > just tell me how to do it because I
can
>> not
>> > > send
>> > > > >> this
>> > > > >> > >>>> file.
>> > > > >> > >>>> > > There
>> > > > >> > >>>> > > > > are
>> > > > >> > >>>> > > > > > >>> two
>> > > > >> > >>>> > > > > > >>> > wrfout files because my forecasts
are made
>> > over
>> > > > 24
>> > > > >> > >>>> hours or
>> > > > >> > >>>> > > more.
>> > > > >> > >>>> > > > > My
>> > > > >> > >>>> > > > > > >>> raw
>> > > > >> > >>>> > > > > > >>> > wrf outputs are in "HDF", and I can
not
>> send
>> > > > them.
>> > > > >> > >>>> That's
>> > > > >> > >>>> > why I
>> > > > >> > >>>> > > > > sent
>> > > > >> > >>>> > > > > > >>> those
>> > > > >> > >>>> > > > > > >>> > in NetCDF. If I continue to wait
for the
>> > other
>> > > > >> files
>> > > > >> > to
>> > > > >> > >>>> be
>> > > > >> > >>>> > > sent,
>> > > > >> > >>>> > > > > the
>> > > > >> > >>>> > > > > > >>> time
>> > > > >> > >>>> > > > > > >>> > to deposit my memory will expire.
>> > > > >> > >>>> > > > > > >>> > Thank you very much for helping me.
>> > > > >> > >>>> > > > > > >>> > Yours sincerely.
>> > > > >> > >>>> > > > > > >>> > Dores
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>> > Le mar. 22 oct. 2019 à 20:49, John
Halley
>> > > Gotway
>> > > > >> via
>> > > > >> > RT
>> > > > >> > >>>> <
>> > > > >> > >>>> > > > > > >>> met_help at ucar.edu
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > a écrit :
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>> > > Dores,
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > Were you able to post any data to
the
>> ftp
>> > > site?
>> > > > >> You
>> > > > >> > >>>> could
>> > > > >> > >>>> > > try
>> > > > >> > >>>> > > > > > >>> sending
>> > > > >> > >>>> > > > > > >>> > via
>> > > > >> > >>>> > > > > > >>> > > email but I worry that the data
files
>> will
>> > be
>> > > > too
>> > > > >> > >>>> large to
>> > > > >> > >>>> > > > > transfer
>> > > > >> > >>>> > > > > > >>> that
>> > > > >> > >>>> > > > > > >>> > > way.
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > Stephen is right... you need to
put the
>> > files
>> > > > >> one by
>> > > > >> > >>>> way.
>> > > > >> > >>>> > By
>> > > > >> > >>>> > > > way
>> > > > >> > >>>> > > > > > of
>> > > > >> > >>>> > > > > > >>> > > example, here are commands to
create a
>> file
>> > > > named
>> > > > >> > >>>> > > > hello_world.txt
>> > > > >> > >>>> > > > > > and
>> > > > >> > >>>> > > > > > >>> > post
>> > > > >> > >>>> > > > > > >>> > > it to our ftp site.
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > cd /home/johnhg
>> > > > >> > >>>> > > > > > >>> > > echo "hello world" >
hello_world.txt
>> > > > >> > >>>> > > > > > >>> > > ftp ftp.rap.ucar.edu
>> > > > >> > >>>> > > > > > >>> > > username = anonymous
>> > > > >> > >>>> > > > > > >>> > > password = "my email address"
>> > > > >> > >>>> > > > > > >>> > > cd
incoming/irap/met_help/dores_data
>> > > > >> > >>>> > > > > > >>> > > put hello_world.txt
>> > > > >> > >>>> > > > > > >>> > > bye
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > And then checking the ftp via a
web
>> > browser:
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>>
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > I see that file now exists. Just
be
>> sure
>> > > that
>> > > > >> > you're
>> > > > >> > >>>> in
>> > > > >> > >>>> > the
>> > > > >> > >>>> > > > > > >>> directory
>> > > > >> > >>>> > > > > > >>> > > which contains the files you want
to
>> send
>> > > > before
>> > > > >> > >>>> running
>> > > > >> > >>>> > ftp.
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > Thanks,
>> > > > >> > >>>> > > > > > >>> > > John
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > On Tue, Oct 22, 2019 at 8:51 AM
Stephen
>> > Dowdy
>> > > > via
>> > > > >> > RT <
>> > > > >> > >>>> > > > > > >>> met_help at ucar.edu>
>> > > > >> > >>>> > > > > > >>> > > wrote:
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > > <URL:
>> > > > >> > >>>> > > >
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=92412
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > > John,
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > > I'm merging in a non MET FTP
ticket
>> from
>> > > > Dores
>> > > > >> > into
>> > > > >> > >>>> this
>> > > > >> > >>>> > > > ticket
>> > > > >> > >>>> > > > > > >>> with
>> > > > >> > >>>> > > > > > >>> > > > explanation of what i think the
>> problem
>> > is
>> > > > >> > >>>> (specifying
>> > > > >> > >>>> > full
>> > > > >> > >>>> > > > > paths
>> > > > >> > >>>> > > > > > >>> on
>> > > > >> > >>>> > > > > > >>> > the
>> > > > >> > >>>> > > > > > >>> > > > files w/o telling the FTP
server to
>> > rename
>> > > to
>> > > > >> > >>>> non-pathed
>> > > > >> > >>>> > > > > > filename.
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > > If you want, it might be
helpful to
>> add
>> > > > >> something
>> > > > >> > >>>> about
>> > > > >> > >>>> > > that
>> > > > >> > >>>> > > > to
>> > > > >> > >>>> > > > > > >>> your
>> > > > >> > >>>> > > > > > >>> > Met
>> > > > >> > >>>> > > > > > >>> > > > Help FTP upload page.
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > > > thanks,
>> > > > >> > >>>> > > > > > >>> > > > --stephen
>> > > > >> > >>>> > > > > > >>> > > >
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> > >
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>> >
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > > >>>
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> > >
>> > > > >> > >>>> >
>> > > > >> > >>>> >
>> > > > >> > >>>>
>> > > > >> > >>>>
>> > > > >> >
>> > > > >> >
>> > > > >>
>> > > > >>
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject: Help
From: Das Dores Ngamini
Time: Wed Nov 20 23:25:15 2019
Hello met_help,
Indeed, the error was related to my machine. Today, I can solve the
problem. Thank
you very much for your help to both of you, thanks to you I can
dispose of
my work on time. Still sorry for all the times I disturbed you with
simple
problems to solve.
Cordially
Dorès
Le sam. 16 nov. 2019 à 09:56, Das Dores Ngamini <ngaminidas at gmail.com>
a
écrit :
> Hello John,
> I have a new problem. I need to extract the "RAIN_SUM" variable from
my
> wrfout files to compare it to the "est_prcp" variable in the
> "ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" file and fill in my
contingency
> table. I tried to edit the file "GridStatConfig_pw" that I renamed
> "GridStatConfig_precip". When I try to run "run_gs.sh" which I also
modify,
> I get the error:
>
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
> /home/dores/Tutorial_Master/TP_Prevision/MET/8.1/bin/grid_stat
> wrfout_19_2.nc ARC2_data_1-Jul_31-Jul_0p25_Camer.nc
GridStatConfig_precip
> -outdir out1
> DEBUG 1: Default Config File:
>
/home/dores/Tutorial_Master/TP_Prevision/MET/8.1/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: GridStatConfig_precip
> ERROR :
> ERROR : Trouble reading observation file
> "ARC2_data_1-Jul_31-Jul_0p25_Camer.nc"
> ERROR :
> dores at dores:~/Tutorial_Master/TP_Prevision/MET/8.1/bin$
>
> I sent the file "ARC2_data_1-Jul_31-Jul_0p25_Camer.nc" in
> ftp://ftp.rap.ucar.edu/incoming/irap/met_help/dores_data/
> Please help me. And, if it works well , I beg you to send me the
files
> "GridStatConfig_precip" and "run_gs.sh" that you used, like the last
time.
>
> Thank you in advance,
> Dorès
>
> Le lun. 11 nov. 2019 à 22:16, John Halley Gotway via RT
<met_help at ucar.edu>
> a écrit :
>
>> According to our records, your request has been resolved. If you
have any
>> further questions or concerns, please respond to this message.
>>
>
------------------------------------------------
More information about the Met_help
mailing list