CCTools 3.6.0 Released!

The Cooperative Computing Lab is pleased to announce the release ofversion 3.6.0 of the Cooperative Computing Tools, including Parrot, Chirp, Makeflow, WorkQueue, SAND, All-Pairs, and other software.

The software may be downloaded here: http://www.cse.nd.edu/~ccl/software/download

This is a minor release which adds numerous features and fixes several bugs:

• [WQ] Added API for logging functionality. [Christopher Bauschka]


• [WQ] Python bindings have more complete access to the API available from C. Documentation has also been improved. [Dinesh Rajan]


• [WQ] No longer manually redirects stdin/stdout/stderr by editing the user provided shell string, it now sets file descriptors directly. User redirections are no longer overridden. [Patrick Donnelly]


• [WQ, Makeflow] The torque batch submission system is now supported. [Michael Albrecht, Douglas Thain]


• [Parrot] Now supports extended attributes. [Patrick Donnelly]


• [Makeflow] Now supports garbage collection of intermediate files. [Peter Bui]


• [Makeflow] Now supports lexical scoping of Makeflow variables. [Peter Bui]


• [Makeflow] New MAKEFLOW keyword for recursive Makeflows. [Peter Bui]


• [WQ] Bindings for WQ now support SWIG versions >= 1.3.29. [Peter Bui]


• [Parrot] iRODS now supports putfile/getfile operations for much faster file copies. [Douglas Thain]


• [Parrot] Now includes watchdog support that runs alongside Parrot. [Douglas Thain, Brian Bockelman]


• [*] CCTools now have been version information from the -v option. Version information is included in debug output with the `-d debug' flag. [Patrick Donnelly]


• [WQ] work_queue_status output has been cosmetically improved. [Douglas Thain]


• [WQ] New $WORK_QUEUE_SANDBOX environment variable. [Dinesh Rajan]

Thanks goes to the contributors for many minor features and bug fixes:

• Michael Albrecht


• Christopher Bauschka


• Brian Bockelman


• Dan Bradley


• Peter Bui


• Iheanyi Ekechukwu


• Patrick Donnelly


• Dinesh Rajan


• Douglas Thain

Please send any feedback to the CCTools discussion mailing list. Enjoy!

Papers at e-Science Conference

Members of the CCL will present two papers and two posters at the upcoming IEEE Conference on e-Science in Chicago:

• 
  Badi Abdul-Wahid, Li Yu, Dinesh Rajan, Haoyun Feng, Eric Darve, Douglas Thain, Jesus A. Izaguirre,
  Folding Proteins at 500 ns/hour with Work Queue
  
  
• Peter Sempolinski, Daniel Wei, Douglas Thain and Ahsan Kareem, A System for Management of Computational Fluid Dynamics Simulations for Civil Engineering
  
  
• Michael Albrecht, John Bent, and Douglas Thain, An Evaluation of Embedded Storage for Exascale and the Value of Asynchronous Data Transfer
  
  
• Dinesh Rajan, Badi Abdul-Wahid, Joe Fetsch, Li Yu, Jesus Izaguirre, Sekou Remy and Douglas Thain, A Case Study in Elastic Scientific Application Design using Work Queue
  

Lecture and Tutorial: Univ. of Arizona

We are doing a guest lecture and tutorial titled Building Scalable Data Intensive Applications with Makeflow and Work Queue at the University of Arizona as part of the Applied CI Concepts class on September 11 and 13, 2012.