Blog from September, 2011

Work Completed

  • KISTI
    • Attended Monday staff meeting.
    • Worked on Gondola REST service. I added CET logging plugins to the headless RCP application and added an slf4j to log4j bridge library that now allows us to capture all logging statements. Using the CET logging, we can now control what log level gets written to the log file for each package. I was not able to reproduce an occasional bug I saw with the KISTI gondola service, but once we start using my updated code we should be able to see what is going on when the error happens. I also noted that we will need to improve this service to use the Tupelo Repository for getting the latest user credentials. The current implementation will be prone to failure once the clients cert expires and the job hasn't ran yet because it stores the cert locally inside it's own repository. It would be better if it went out and got the latest cert from Tupelo.
    • Finished up the 3d solver testing. Everything is operating normally and is checked into SVN. The next step is to start wiring this up with the Web interface to setup and launch jobs.
    • Started transitioning my Desktop files to my laptop. It took some time to get the laptop dock to work properly with Linux. I spent most of Friday installing the system and retrieving all required applications. The laptop is considerably faster than my aging Desktop and will improve efficiency (Maven compile/installs would grind my desktop to a halt until it finished, it's barely noticeable on the laptop). The laptop is dual booted win7/ubuntu 11.04.
    • Provided Yong Wook some advice on getting started with transitioning his paw-authentication code to the Model-view-presenter design paradigm.

Work Planned

  • KISTI
    • Work on improving the Gondola REST service. There is an occasional bug that shows up, but no logging is being captured because of the different logging systems among the libraries used
    • Work on finishing up the 3D solver tools and test everything using KISTI-tupelo repository and KISTI-CI server
    • Transition desktop machine to laptop and installed 64 bit Ubuntu on laptop
    • Attend Monday Staff meeting (10am)

Comments

This week went as planned. It took a little longer than anticipated to setup my laptop as my primary workstation since I had to resolve issues with Ubuntu recognizing the dock properly. It took a bios update and some bios tweaking to resolve the problem.

Work Completed

  • KISTI
    • Compiled and tested eAIRS 3D solver. There were some issues getting the code to compile and then some runtime errors due to the environment settings on XSEDE's Ranger resource. I setup my desktop system to compile and run MPI code so I could test runtime errors more quickly by avoiding the gueue time. I sent questions to KISTI involving the code and output files and used the Ranger online manual to change my environment settings and resolved the issues I had. I created a new script for the 3d workflow that loads the correct environment before executing the solver. The solver is tested and a new 3d tool was created and checked into SVN since the 3d solver has different outputs than the 2d solver. It took more time than anticipated to compile and successfully run the 3d solver, but everything is working and tested.
    • Reviewed in more detail the GWT material on the MVP design pattern and sent some questions to Luigi.
    • Attended staff meeting (9-12-11) via skype
  • General
    • Prepared short writeup summarizing TRECC activities

Work Planned

  • KISTI
    • Compile and test eAIRS 3D solver received from KISTI
    • Create new Cyberintegrator tool to execute eAIRS solver
    • Attend KISTI staff meeting (9-12-11)
  • General
    • Prepare short writeup for Terry to summarize TRECC activities

Comments

This week went as planned. I took half of a personal day on Friday September 16, 2011.

Work Completed

  • Cyberintegrator
    • Verified my classloader change with Rob, tested it and checked in my changes. We rebuilt Cyberintegrator server and updated our CI server installation at kisti.ncsa.illinois.edu with the new build
  • KISTI
    • Fixed the issue Yong was having with getting credentials associated with a user. There was a missing Triple in the Utility class
    • Finished updating the eAIRS tools to look for credentials associated with the step or with the user. The first check is for credentials associated with the step, it then falls back on trying to find a credential associated with the creator. We will need something to associate the users credential with the workflow steps so they can access HPC resources. I also checked in a README file with the tools that will help users export the tools as jar files and import them into Cyberintegrator. A workflow for the tool is also checked into the repository. All of these tools were tested with the new CI server to verify correctness
  • General
    • Attended all-staff meeting on Thursday

Work Planned

  • Cyberintegrator
    • Verify new code for DisposeClassLoader with Rob and update CI Server. The server will need to be rebuilt with Jenkins and redeployed.
  • KISTI
    • Fix bug in x509 certificate util where associations returns the empty set
    • Finish updating eAIRS tools to use the new REST client and obtain the credential from Tupelo either by searching for an association with the workflow step or the creator
  • General
    • Attend all staff meeting

Comments

This week went as planned. September 5th was a holiday and I took half of a personal day on September 7th and 8th.

Work Completed

  • KISTI
    • Updated eAIRS tool to use the new PTPFlow-lite version and REST endpoing to submitting jobs. KNSG-107. This took some time due to classloading issues that were slow to track down between the REST client library and also with some of the JAXB classes used by PTPFlow-lite. The primary issues with PTPFlow-lite was fixed by specifying directly the Factory class and it's full path (found online in a forum) for issue encounted when mixing Eclipse Plug-in code and Java Standalone clients.
    • I am in the middle of testing the end to end workflow. My final changes are to update the basic eAIRS script dynamically with information such as which machine to run on, the machine's gridftp URL, etc. Once these tests are complete we can begin working with the front-end client code to setup/launch this workflow.
    • Started looking at Yong Wook's issue with getting the associated certificate, the bean util's look correct. I will continue to look into this.
    • Attended KISTI staff meeting
    • Attended Luigi's GWT-MVP tutorial
  • Cyberintegrator
    • Added an unimplemented findResources(...) method that was not part of Cyberintegrator's DisposeClassLoader. This caused a classloading issue for the REST library eAIRS is using because it's class loading utility class was calling ClassLoader.getResources(...), which would return null since it is unimplemented. I need to verify my changes with Rob before committing it back to the Cyberintegrator.

Work Planned

  • KISTI
    • Update eAIRS tools to use PTPFlow-lite client for submitting jobs.
    • Attend KISTI staff meeting on Monday at 10am.
    • Attend Tutorial on GWT-MVP
  • Cyberintegrator
    • None

Comments

This week went mostly as planned. It took longer to fix classloading issues than anticipated, but they are now resolved and the final code updates are being done for the eAIRS tools. This should be finished early this week so we can begin connecting it to the UI parts. The final issue will be getting the x509 certificate associated with the workflow step so the step can get the correct cert without logging into MyProxy or relying on the user's tupelo username to get at the certificate (in case they are logged out and no cert is associated with their Username).