[Go-essp-tech] trackback still not working at PCMDI
Sylvia Murphy
Sylvia.Murphy at noaa.gov
Thu Nov 10 09:29:12 MST 2011
HI Cecelia,
The original intent with the table was to indicate whether a particular release was working as expected for a center in order to assist sys admins there in determining whether they have the release installed correctly.
I think I will change the nomenclature to indicate that release is installed but not use red/green as it is confusing and does not mean the overall user experience, merely and installation status.
I will add an overarching summary statement indicating more clearly the bugs in these releases and put the user experience at red. I am disappointed that the record you selected is not working. This means the fix in 1.3.4 is not working for it. We thought that 1.3.4 would hold us for a while until the real fix could be formulated and developed.
Sylvia
On Nov 10, 2011, at 9:11 AM, Cecelia DeLuca wrote:
> Hi Sylvia,
>
> I am getting errors at NCAR, which is marked as working on your table
> for 1.3.4.
> The very first result (MPI) returns the same internal server error.
> With this
> error present it cannot be considered a working system.
>
> Any 1.3.2 system should also not be considered "green" and working properly
> because of the serious problem with the physical domain facet. The first
> things users see is a facet that does not work.
>
> I'm afraid your table shows a much better picture than actually exists.
> I have not
> yet seen a gateway where the user would actually experience the metadata
> functions working fully and properly. Those are the only ones that
> should be
> marked green.
>
> Could you please check the gateways again and update the table? The first
> step to fixing these problems will be getting an accurate picture of what is
> happening.
>
> Thanks,
> Cecelia
>
> On 11/9/2011 9:30 AM, Sylvia Murphy wrote:
>> Hi Everyone,
>> First off, I have been listing the known bugs by release on the CMIP5 status page along with the status of all the gateways:
>> http://esgf.org/wiki/Cmip5Status
>> You can always get the latest there. Here is the list:
>>
>> 1.3.2
>>
>> • Depends upon postgres version 8.4
>> • Won't skip malformed feed documents (e.g. with trailing /1 strings in CIM feed) so harvesting fails. Fixed in 1.3.3.
>> 1.3.3
>>
>> • CIM documents that contained % signs or foreign characters (all MPI documents currently contain an umlat in one of the component names) in attribute names used in subsequent triple store queries cause the query to fail. This results in an internal server error when a user clicks on a search result. Fixed in 1.3.4.
>>
>>
>> As indicated, 1.3.4 creates a short-term fix for the unusual characters (e.g. umlats, % signs etc) we are seeing in the MPI simulations. In 1.3.4 the system skips these individual items and displays everything else. A longer term fix will need to deal with how URLs and queries are encoded in the triple store so these items can be displayed. I have been working with each of the centers to get 1.3.4 installed for these reasons.
>>
>> Sylvia
>>
>>
>>
>>
>> On Nov 9, 2011, at 8:47 AM, Cecelia DeLuca wrote:
>>
>>> Bryan, Stephen, Nate -
>>>
>>> Thanks for checking this out.
>>>
>>> The errors that I see at PCMDI are the same as ever, and were the ones
>>> diagnosed as relating to
>>> the postgres update. Maybe that's not the case?
>>>
>>> If I search Simulations at PCMDI, and select the Earth System Realm, I
>>> get 21 results, which produce
>>> an internal server error when they are clicked to get to the trackback.
>>> They are ECHAM runs.
>>>
>>> If I search Simulations at NCAR, and select the Earth System Realm, I
>>> get 37 results. The ECHAM
>>> runs produce the internal server error. HadGem runs do not. Nate,
>>> where are you seeing the
>>> ECHAM runs working?
>>>
>>> So these errors are not an issue with the postgres update, and are
>>> instead an issue with the
>>> MPI model metadata? (Is there still some error that was actually traced
>>> back to postgres?)
>>> I suppose this is good news, but I worry that we will be able to get all
>>> the gateways
>>> up to 1.3.4 to address the problem. Would it be possible to modify the
>>> metadata instead?
>>> When the MPI runs are the only runs there, it has a pretty major impact.
>>>
>>> -- Cecelia
>>>
>>>
>>>
>>>
>>>
>>>
>>> On 11/9/2011 3:09 AM, Bryan Lawrence wrote:
>>>> hi Dean et al
>>>>
>>>> It looks like this now works at PCMDI?
>>>>
>>>> However, at both PCMDI and BADC, I get internal errors from ECHAM simulation descriptions. Do we know what that's about?
>>>>
>>>> Thanks in advance,
>>>> Bryan
>>>>
>>>>> Dear Cecelia,
>>>>>
>>>>> Bob is looking into updating the postgres database...but this is very
>>>>> sensitive work. Under careful consideration, we are afraid that if we
>>>>> update the database, then it may break a number of other things and the
>>>>> entire system may fail. I am told that Bob had to do some special things
>>>>> on our end in order to upgrade to the latest gateway.
>>>>>
>>>>> Let's discuss this at the next go-essp tech call. WE realize that your
>>>>> team has put a lot of effort into this and we want to make sure it is used
>>>>> by the community.
>>>>>
>>>>> Best regards,
>>>>> Dean
>>>>>
>>>>> On 10/27/11 8:23 AM, "Cecelia DeLuca"<Cecelia.DeLuca at noaa.gov> wrote:
>>>>>
>>>>>> Hi Dean and all,
>>>>>>
>>>>>> Just checking - any update on this? I have been away for a while and it
>>>>>> looks like it
>>>>>> is still not working at pcmdi. It's been almost two months now. This
>>>>>> represents a huge
>>>>>> amount of effort and it would be a shame to not offer it to users
>>>>>> because of the lack of a
>>>>>> software update. Is there a new holdup, or anything our team can do to
>>>>>> help move
>>>>>> this along?
>>>>>>
>>>>>> Thanks,
>>>>>> Cecelia
>>>>>>
>>>>>> On 10/11/2011 8:16 AM, Cecelia DeLuca wrote:
>>>>>>> Thanks Dean.
>>>>>>> - Cecelia
>>>>>>>
>>>>>>> On 10/7/2011 3:04 PM, Williams, Dean N. wrote:
>>>>>>>> Dear Cecelia,
>>>>>>>>
>>>>>>>> We apologize for not being able to update the postgres database
>>>>>>>> this week. We are on a deadline to get a number of things done for the
>>>>>>>> CMIP5 archive. Not to say that the trackback isn't high on our list. We
>>>>>>>> have got to start moving data to the core repositories sites and
>>>>>>>> replicating. As stated in an earlier message, the team has accomplished
>>>>>>>> the first task to move and replicate data. Mike is currently working to
>>>>>>>> continue the replication effort.
>>>>>>>>
>>>>>>>> I am hopeful that Bob will be able to look into the postgres upgrade
>>>>>>>> next week. This should allow the trackback...but we want to make sure
>>>>>>>> this upgrade doesn't cause something else to break. We need to be
>>>>>>>> careful here.
>>>>>>>>
>>>>>>>> Again, sorry for the delay...
>>>>>>>>
>>>>>>>> Best regards,
>>>>>>>> Dean
>>>>>>>> ________________________________________
>>>>>>>> From: go-essp-tech-bounces at ucar.edu [go-essp-tech-bounces at ucar.edu] On
>>>>>>>> Behalf Of Cecelia DeLuca [Cecelia.DeLuca at noaa.gov]
>>>>>>>> Sent: Friday, October 07, 2011 8:39 AM
>>>>>>>> To: go-essp-tech at ucar.edu
>>>>>>>> Subject: Re: [Go-essp-tech] trackback still not working at PCMDI
>>>>>>>>
>>>>>>>> Dear all,
>>>>>>>>
>>>>>>>> Please be aware that the trackback is still not working at PCMDI.
>>>>>>>> I think on the call on Tues we were expecting resolution of the issue
>>>>>>>> by
>>>>>>>> today.
>>>>>>>> Can someone please help fix this?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> -- Cecelia
>>>>>>>>
>>>>>>>> On 10/3/2011 8:31 AM, Williams, Dean N. wrote:
>>>>>>>>> Dear Cecelia,
>>>>>>>>>
>>>>>>>>> We have upgraded to the latest version of the gateway 1.3.2
>>>>>>>>> and I believe
>>>>>>>>> Bob has the latest version Postgres for the latest release of the
>>>>>>>>> gateway.
>>>>>>>>>
>>>>>>>>> Let's put this on the agenda for tomorrow's telco. Do you and
>>>>>>>>> Sylvia
>>>>>>>>> still want to have a portion of the telco time to demo CoG?
>>>>>>>>>
>>>>>>>>> Best regards,
>>>>>>>>> Dean
>>>>>>>>>
>>>>>>>>> On 10/3/11 7:16 AM, "Cecelia DeLuca"<Cecelia.DeLuca at noaa.gov>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi everyone,
>>>>>>>>>>
>>>>>>>>>> Sylvia reported early in September that the trackback was not working
>>>>>>>>>> in the PCMDI gateway. It is still not working at all for the CMIP5
>>>>>>>>>> runs.
>>>>>>>>>> It is frustrating to not have this available after so much effort
>>>>>>>>>> went
>>>>>>>>>> into it. It is also making it impossible to report out success on
>>>>>>>>>> milestones
>>>>>>>>>> that we have for getting this running in the production site by the
>>>>>>>>>> end
>>>>>>>>>> of the FY.
>>>>>>>>>>
>>>>>>>>>> Eric has reported that the problem lies with PCMDI not upgrading to
>>>>>>>>>> Postgres
>>>>>>>>>> database version 8.4. Does everyone agree this is all that is
>>>>>>>>>> needed and
>>>>>>>>>> if so is there a timelines for doing this?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Cecelia
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> ===================================================================
>>>>>>>>>> Cecelia DeLuca
>>>>>>>>>> NESII/CIRES/NOAA Earth System Research Laboratory
>>>>>>>>>> 325 Broadway, Boulder 80305-337
>>>>>>>>>> Email: cecelia.deluca at noaa.gov
>>>>>>>>>> Phone: 303-497-3604
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> GO-ESSP-TECH mailing list
>>>>>>>>>> GO-ESSP-TECH at ucar.edu
>>>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>>>>> --
>>>>>>>> ===================================================================
>>>>>>>> Cecelia DeLuca
>>>>>>>> NESII/CIRES/NOAA Earth System Research Laboratory
>>>>>>>> 325 Broadway, Boulder 80305-337
>>>>>>>> Email: cecelia.deluca at noaa.gov
>>>>>>>> Phone: 303-497-3604
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> GO-ESSP-TECH mailing list
>>>>>>>> GO-ESSP-TECH at ucar.edu
>>>>>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>> _______________________________________________
>>>>> GO-ESSP-TECH mailing list
>>>>> GO-ESSP-TECH at ucar.edu
>>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>>>
>>>> --
>>>> Bryan Lawrence
>>>> University of Reading: Professor of Weather and Climate Computing.
>>>> National Centre for Atmospheric Science: Director of Models and Data.
>>>> STFC: Director of the Centre for Environmental Data Archival.
>>>> Ph: +44 118 3786507 or 1235 445012; Web:home.badc.rl.ac.uk/lawrence
>>>> _______________________________________________
>>>> GO-ESSP-TECH mailing list
>>>> GO-ESSP-TECH at ucar.edu
>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>>
>>> --
>>> ===================================================================
>>> Cecelia DeLuca
>>> NESII/CIRES/NOAA Earth System Research Laboratory
>>> 325 Broadway, Boulder 80305-337
>>> Email: cecelia.deluca at noaa.gov
>>> Phone: 303-497-3604
>>>
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>> ***********************************
>> Sylvia Murphy
>> NESII/CIRES/NOAA Earth System Research Laboratory
>> 325 Broadway, Boulder CO 80305
>> Email: sylvia.murphy at noaa.gov
>> Phone: 303-497-7753
>> Fax: 303-497-7649
>>
>>
>>
>>
>>
>>
>>
>
>
> --
> ===================================================================
> Cecelia DeLuca
> NESII/CIRES/NOAA Earth System Research Laboratory
> 325 Broadway, Boulder 80305-337
> Email: cecelia.deluca at noaa.gov
> Phone: 303-497-3604
>
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
***********************************
Sylvia Murphy
NESII/CIRES/NOAA Earth System Research Laboratory
325 Broadway, Boulder CO 80305
Email: sylvia.murphy at noaa.gov
Phone: 303-497-7753
Fax: 303-497-7649
More information about the GO-ESSP-TECH
mailing list