MDM perfSONAR 3.0 Conf call 13 Mar 2008
From GEANT2-JRA1 Wiki
Date and Time: Thursday, the 13 of March 2008, 15:00-16:00 CEST, 14:00-15:00 UTC.
We will use the Hungarnet MCU, * GDS numbering plan JRA1: 0036100309901 * Phone access: +36 1 450 3099 then type the GDS number 0036100309901
Backup DFN * GDS dialstring: 004910091212314***4522 * To connect by phone, see: 0049 30 254 10800 - The dialstring here is also 004910091212314***4522. **https://www.vc.dfn.de/doku/anleitungen/isdn_gateway.html?lang=en * Note: you can´t use it with NAT, unless you use a NAT proxy.
Expected participants: Luís Marta, Roman Lapacz, Maciej Glowiak, Nicolas Simar, Szymon Trocha, Guilherme Fernandes, Loukik Kudarimoti, Prodromos Gerakios, Jeff Boote, Sasa Cavara, Stijn Melis.
Apologies: Jochem, Verena, Maxim, Panagiotis, Michalis, David, Patricia, Cándido.
Relevant Documents:
- Timeline for MDM-perfSONAR 3.0 Bundle release
- MDM-perfSONAR 3.0 Bundle product specification
- Hand-Over Process description
- Product Build Guide document
- MDM perfSONAR 3.0 Test status
- Test Infrastructure
- Bug Reports on Bugzilla
[edit]
Agenda
- Developer status update on Hand-over of software (18 January until 29 February) and all specification documents and change logs:
- ALL - perfSONAR base
- Szymon will be co-ordinating perfSONAR base version consistency at the development level.
- pS base change log - track changes, verify the introducing of new features and check service compatibility (trunk\perfsonar_base\doc\ChangeLog.txt).
- All developers should indicate in their services' change logs the current pSbase version the service is using.
- New message type called ErrorResponse for release 3.0
- ACTION: Szymon to send an email to the developers list saying this change will be implemented and that the impact will be for all services to update RNC files and the testers to update testing scripts accordingly. Maciej will make the change on perfSONAR base. Expected time for changes and tests?
- ALL - Web Admin Jar - 0.7b - supports grouping and description in service.properties.
- All java services must use this version!
- Michalis - new versions expected? - Michalis made some slight changes to the code, which he has not committed yet, needs ok from Loukik first. Probably a new version of the jar will be out on Monday.
- Michalis suggests that the developers write a document with information about the wizard configuration for their services. ACTION ONGOING Michalis will modify the Installation Actions document to include info for the web wizard?
- Candido - Authentication Service
- Documentation and change log complete, available on SVN trunk.
- Software - RC3 is out with echo functionality (EchoRequest message) switched on and Updated web admin jar - 0.7b?
- Testing update (David and Patricia) - scripts are ready, result codes for the AS are here.
- ACTION ONGOING: David to send to Cándido the messages sent to the service, to ensure that they are the ones expected.
- ACTION ONGOING: David to test ANT installation and RPMs.
- ACTION ONGOING: David to do functional test on the AS, including the registration and echo-ping.
- Roman - RRD MA
- Documentation - All documents and change log on SVN trunk.
- Software - 3.0-RC3 is available. Updated web admin jar - 0.7b?
- ACTION Loukik to send the info needed to the list about the Sun server with Solaris for testing.
- Testing update (Michalis) - Scripts are ready. A bug in the authentication process was found and reported on bugzilla and to Candido.
- Testing - Performance
- ACTION ONGOING Roman to read test reports and comment on them.
- Roman - SQL MA
- Documentation - All documents and change log on SVN trunk.
- Software - RC3 is out, Updated web admin jar - 0.7b?
- ACTION ONGOING Roman, Nicholas and Loukik - what needs to be developed from E2EMON MP? - Conf. Call scheduled for last Monday. Updates?
- Testing update (Sasa Cavara) - scripts are ready. Testing for RC3 has started?
- Stijn - SSH-Telnet MP
- All documents and change log on SVN trunk.
- Software - 1.3-RC3 is out, with updated web admin jar - 0.7b?
- Testing Update (Panagiotis)
- Done:
- Well formed requests, all done, problems reported on bugzilla.
- LS registration, not working. Panagiotis has talked with Stijn Melis about this.
- Pending:
- Finish and upload test functional testing specification document
- Test AS
- Work on Almost Well Formed and Malformed requests tests. From what Panagiotis has seen so far, some problems will arise here, but considering the nature of the service they shouldn't be considered as release blockers. This is the reason they are low on Panagiotis' priorities.
- Verena - BWCTL MP
- Documentation and change log available on DFN Erlangen SVN
- Software - RC3 is out with problem registering with LS solved. Problem reported by Stijn under investigation, new release candidate (RC4) will be released soon (today or end of week). WebAdmin configuration tool to configure BWCTL MP is out. WebAdmin tool rework: waiting for visuals from Loukik, as soon as Verena has these, the WebAdmin tool will be adjusted. A running version of the service would help in general.
- Testing update - Stijn is extending the existing java scripts to cover new functionalities. Date for having the scripts ready, and for finishing testing?
- Maciej - Single LS
- Documentation and change log available on SVN trunk.
- Software - New RC (1.2-RC3) is available for testing - fixes problem of RRD MA registration. Updated web admin jar - 0.7b?
- Testing update (Prodromos) - scripts are ready. Started testing on RC3.
- Prodromos is having problems with malformed requests, LS returns invalid responses. This will not be fixed until next release. ACTION ONGOING: Maciej will modify RNC files to make attributes optional, and help remedy this - this will be solved by ErrorResponse message type?
- ACTION ONGOING Michalis to ask developers to send Prodromos the LS Register requests produced by their service - Michalis reminded the developers to send an example LSRegistration Request.
- Guilherme - CLI MP
- Documentation and change logs available on SVN trunk.
- Software - CL-MP 2.0 RC2 is out. AA will be supported? Updated web admin jar - 0.7b?
- Testing (Jochem) - scripts ready to support new features?
- Test scripts and documentation for ping, OWAMP, and BWCTL support are ready. Testing ping, owamp and bwctl functionality is finished. The next release (RC3) should include all fixes for all bugs that were found during testing the ping functionality.
- During testing the traceroute functionality it became apparent that the traceroute of the current RedHat release is incompatible with the traceroute of Debian that was used for developing CL-MP. Guilherme already found the problem and it should be fixed in RC3.
- EchoRequest tests are ok.
- AA support is not yet included in CL-MP. It will be included in RC3.
- LS functionality not tested so far.
- Documentation and test script creation has started for traceroute support. Ready?
- When will Cron functionality be tested?
- Still nothing done about the Schedule functionality. Jochem hopes he can work on it a lot more next week.
- Will test for normal functionality and/or support for AA and/or cron/store functionality (schedule measurement)?
- Jeff and Jason - perfSONOBuoy - if everything is still on track for the end of February, this will be a good enough date to enter the 3.0 Release
- Documentation - first week of March.
- Software - service being tested now.
- Testing - service being tested now.
- Maxim and Yee - Pinger
- Documentation - ready
- Software - PingER is on track. Version bumped to RC 0.08 to be consistent with the rest of ps-ps services. PingER landmarks topology schema (used for loading the list of monitored pairs) were updated and XML binding API was updated as well.PingER MP was tested and reference deployment for US CMS Tier1 -Tier2 monitoring is runnig at http://tukki.fnal.gov:8075/perfSONAR_PS/services/pinger/ma. Current data gathered by MP is availabe on the visualization webpage at http://tukki.fnal.gov/pinger/graph_pings_gd.pl
- Testing - ready and done.
- ACTION:Infrastructure to help functional testing - Test Infrastructure:
- A LS deployed so that people can register the information - DONE According to Michalis, there seems to be a misconfiguration problem and the LS is not working properly. He has notified Szymon about this, but the last time he checked the problem was still there.
- An AS service for people to test the authentication - DONE
- A server with three operating systems to test the installation ONGOING A server is ready and configured with Red-Hat. Debian and Free BSD will be available or not?
- What to use on Debian and Free BSD instead of RPMs? Roman suggested creating WAR files and putting then in Tomcat. Roman has already created war files for RRD-MA and SQL-MA latest RCs. ACTION: Loukik to discuss with Roman about using war files and updating the Product Build Guid document. Guilherme will have a deb_maker script to automatize the process of building deb packages. Ready?
- Each development team will install the latest RC of their services and make them available. Loukik to send an email to the development list asking for this, and then to create a page on the Wiki to place the links to the installed services.
- ALL - perfSONAR base
- Next call
- AOB
[edit]
Minutes
Participants: Luís Marta, Roman Lapacz, Maciej Glowiak, Nicolas Simar, Szymon Trocha, Guilherme Fernandes, Loukik Kudarimoti, Prodromos Gerakios, Jeff Boote, Sasa Cavara, Stijn Melis.
- Developer status update on Hand-over of software and all specification documents and change logs:
- ALL - perfSONAR base
- Szymon will be co-ordinating perfSONAR base version consistency at the development level.
- pS base change log - track changes, verify the introducing of new features and check service compatibility (trunk\perfsonar_base\doc\ChangeLog.txt).
- All developers should indicate in their services' change logs the current pSbase version the service is using.
- New message type called ErrorResponse for release 3.0
- ACTION DONE: Szymon to send an email to the developers list saying this change will be implemented and that the impact will be for all services to update RNC files and the testers to update testing scripts accordingly. Maciej will make the change on perfSONAR base. Expected time for changes and tests - ACTION NEW: Loukik to discuss with Michalis the RNC changes due to ErrorResponse and its effect on testing scripts.
- ALL - Web Admin Jar - 0.7b - supports grouping and description in service.properties.
- All java services must use this version!
- Michalis - new versions expected? - Michalis made some slight changes to the code, which he has not committed yet, needs ok from Loukik first. A new version of the jar will be out on Monday. All java services will need a new RC including this jar.
- ACTION NEW: Loukik to send email asking for change logs to reflect version of web admin to all developers.
- Michalis suggests that the developers write a document with information about the wizard configuration for their services. ACTION NEW Loukik to talk to Michalis and Gina about Installation actions document planning.
- Candido - Authentication Service
- Documentation and change log complete, available on SVN trunk.
- Software - There is a new RC3 in the SVN. Its .tar.gz and .rpm files are available in the wiki in the page 'PerfSONAR downloads'. It fixes a bug validating signatures of saml assertions.
- The AS is using the last perfSONAR base. Cándido added this information to the changelog, as it was required in the mailing list.
- The AS is not using the last web admin jar (still using the 0.5b version) because Michalis is going to release a new version in a few days of the web admin. When this new version will have been released, Cándido will do a new RC with it.
- Cándido is updating the documentation (the result codes page) and adding the common RNC files of perfSONAR base message to the AS (EchoRequest, EchoResponse, ErrorResponse...).
- Testing update (David and Patricia) - scripts are ready, result codes for the AS are here.
- ACTION ONGOING: David to send to Cándido the messages sent to the service, to ensure that they are the ones expected.
- ACTION ONGOING: David to do functional test on the AS, including the registration and echo-ping.
- David and Patricia are testing the RPMs, but they have found a problem with the perfsonar-tomcat rpm file, because its Tomcat doesn't work. Cándido forwarded an email about that to Michalis, Loukik and Guilherme. ACTION NEW: Loukik to dig out email from David/Michalis talking about RPM problems - make it avaiable to Guilherme.
- Roman - RRD MA
- Documentation - All documents and change log on SVN trunk.
- Software - 3.0- RC3 is available, with newest psBase (20080310) and web admin jar(0.7b). Documentation is updated with new message type ErrorResponse and comment lines on configuration files. New RC4 will be available tomorrow.
- ACTION ONGOING Loukik to send the info needed to the list about the Sun server with Solaris for testing - Loukik to Provide full details of Sun server to wiki page and access to Roman.
- Testing update (Michalis) - Scripts are ready. A bug in the authentication process was found and reported on bugzilla and to Candido. Roman says it must be a problem with AS and not RRD-MA.
- Testing - Performance
- ACTION ONGOING Roman to read test reports and comment on them.
- Roman - SQL MA
- Documentation - All documents and change log on SVN trunk.
- Software - RC3 is available, with newest psBase (20080310) and web admin jar(0.7b). Documentation is updated with new message type ErrorResponse and comment lines on configuration files. New RC4 will be available beggining of next week.
- ACTION DONE Roman, Nicholas and Loukik - what needs to be developed from E2EMON MP? - Conf. Call scheduled for last Monday. Updates: Priority for this is not high, so at least the design of the needed features will be ready until the end of March, but the implementation will only be for 3.1.
- Testing update (Sasa Cavara) - scripts are ready. All tests behaved as expected, some minor bugs found and filled in Bugzilla, echo ok, LS registration (with 1 hour interval) ok, and the AS ok as well. This is strange, why did Michalis find problems testing RRD-MA Authentication, and Sasa did not find problems testing the SQL-MA authentication, and they both used the same installed AS?
- ACTION NEW Loukik to discuss SQL MA testing with Michalis - how is it that there are problems with LS and AA for Michalis but not for Sasa - are there configuration issues?
- Stijn - SSH-Telnet MP
- All documents and change log on SVN trunk.
- Software - 1.3-RC3 is out, with updated web admin jar - 0.7b. New RC will be available next week, with bugs corrected and new web admin updated.
- Testing Update (Panagiotis)
- Done:
- Well formed requests, all done, problems reported on bugzilla.
- LS registration, not working. Panagiotis has talked with Stijn Melis about this.
- Pending:
- Finish and upload test functional testing specification document
- Test AS
- Work on Almost Well Formed and Malformed requests tests. From what Panagiotis has seen so far, some problems will arise here, but considering the nature of the service they shouldn't be considered as release blockers. This is the reason they are low on Panagiotis' priorities. Loukik and Nicholas are ok with this.
- Verena - BWCTL MP
- Documentation and change log available on DFN Erlangen SVN
- Software - RC3 is out with problem registering with LS solved. Problem reported by Stijn under investigation, new release candidate (RC4) released soon today. WebAdmin configuration tool to configure BWCTL MP is out. WebAdmin tool rework: waiting for visuals from Loukik, as soon as Verena has these, the WebAdmin tool will be adjusted. A running version of the service would help in general.
- Testing update - Stijn is extending the existing java scripts to cover new functionalities. Stijn has prepared the tests and installed the service. If testing goes without problems, it will be finished by the end of next week.
- Maciej - Single LS
- Documentation and change log available on SVN trunk.
- Software - 1.2-RC3 is available for testing, fixes problem of RRD MA registration. Next week new RC4 will be available, with new psBASE and updated web admin jar. Documentation is being updated to reflect new message type ErrorResponse.
- Testing update (Prodromos) - scripts are ready. Finished testing on RC3.
- Prodromos is having problems with malformed requests, LS returns invalid responses. This will not be fixed until next release. ACTION DONE: This is solved by ErrorResponse message type.
- ACTION ONGOING Michalis to ask developers to send Prodromos the LS Register requests produced by their service - Michalis reminded the developers to send an example LSRegistration Request.
- Guilherme - CLI MP
- Documentation and change logs available on SVN trunk.
- Software - CL-MP 2.0 RC2 is out. RC3 next week, with bugs solved, AA support and updated psBASE and web admin jar.
- Testing (Jochem) - scripts ready to support new features.
- Test scripts and documentation for ping, OWAMP, and BWCTL support are ready. Testing ping, owamp and bwctl functionality is finished. The next release (RC3) should include all fixes for all bugs that were found during testing the ping functionality.
- During testing the traceroute functionality it became apparent that the traceroute of the current RedHat release is incompatible with the traceroute of Debian that was used for developing CL-MP. Guilherme already found the problem and it should be fixed in RC3.
- EchoRequest tests are ok.
- AA support is not yet included in CL-MP. It will be included in RC3.
- LS functionality not tested so far.
- Documentation and test script creation has started for traceroute support. Ready?
- When will Cron functionality be tested?
- Still nothing done about the Schedule functionality. Jochem hopes he can work on it a lot more next week.
- Will test for normal functionality and/or support for AA and/or cron/store functionality (schedule measurement)?
- Jeff and Jason - perfSONOBuoy - if everything is still on track for the end of February, this will be a good enough date to enter the 3.0 Release
- Documentation - first week of March.
- Software - perfSONARBUOY is currently in testing.
- Jeff has a question on the RPM's. Jeff and Jason can create a 'set' of RPM's with dependancies (this way pingER and perfSONARBUOY will have common dependancies). Or, we can create an all-in-one RPM that installs everything in /opt/perfSONARBUOY or something similar. LK suggested to create just 1 as its easy for users. Jeff said he will check with Maxim to see if there are any strong preferences. If not, he will probably create just one.
- Jeff and Jason do not intend to do authentication for this release. This is an archive of previous results, and there is no 'privacy' concerns as such, so the effort does not seem worth the effort. They intend to see how DFN has handled the AA issues, and perhaps work with them as things go forward to get this working in the future.
- Jeff and Jason are beginning work on the web-admin interface while the service is in testing. They intend to re-use as much of Maxim's web-admin software as possible. (also to look at the DFN solution to see if that is more applicable.). Jeff is not sure if web-admin will be available by end of March.
- Testing - service being tested now.
- Maxim and Yee - Pinger
- Documentation - ready
- Software - PingER is on track. Version bumped to RC 0.08 to be consistent with the rest of ps-ps services. PingER landmarks topology schema (used for loading the list of monitored pairs) were updated and XML binding API was updated as well.PingER MP was tested and reference deployment for US CMS Tier1 -Tier2 monitoring is runnig at http://tukki.fnal.gov:8075/perfSONAR_PS/services/pinger/ma. Current data gathered by MP is availabe on the visualization webpage at http://tukki.fnal.gov/pinger/graph_pings_gd.pl
- Testing - ready and done.
- ACTION:Infrastructure to help functional testing - Test Infrastructure:
- A LS deployed so that people can register the information - DONE According to Michalis, there seems to be a misconfiguration problem and the LS is not working properly. He has notified Szymon about this, but the last time he checked the problem was still there. ACTION NEW: Szymon to install the new RC of LS as soon as it is made available, and to follow on this problem with Michalis.
- An AS service for people to test the authentication - DONE
- A server with three operating systems to test the installation ONGOING A server is ready and configured with Red-Hat. Debian and Free BSD will be available if there is a strong need for them.
- What to use on Debian and Free BSD instead of RPMs? Roman suggested creating WAR files and putting then in Tomcat. Roman has already created war files for RRD-MA and SQL-MA latest RCs. ACTION ONGOING: Loukik to discuss with Roman about using war files and updating the Product Build Guid document. Guilherme will have a deb_maker script to automatize the process of building deb packages. ACTION NEW:Loukik to discuss deb maker scripts and update functionality with Guilherme.
- Each development team will install the latest RC of their services and make them available. Loukik to send an email to the development list asking for this, and then to create a page on the Wiki to place the links to the installed services. Hopefully, all developers will have new RCs next week, and will install them as asked. If anyone needs to use DANTE server, just ask.
- ALL - perfSONAR base
- Next call - Wednesday, 19 March, 15h CET, 14h GMT
- AOB
