CCTools 3.7.0 Released!

The Cooperative Computing Lab is pleased to announce the release of version 3.7.0 of the Cooperative Computing Tools, including Parrot, Chirp, Makeflow, WorkQueue, SAND, All-Pairs, and other software.

The software may be downloaded here.

This is a minor release which adds numerous features and fixes several bugs:

• [WorkQueue] It is now possible to specify chunks (pieces) of an input file to be used as input for worker tasks. [Dinesh Rajan]


• [Chirp] File extended attributes are now supported. [Patrick Donnelly]


• [Makeflow] New -i switch now outputs pre-execution analysis of Makeflow DAG. [Li Yu]


• [WorkQueue/Makeflow] Support for submitting tasks to the PBS batch submission platform added. [Dinesh Rajan]


• [Makeflow] makeflow_log_parser now ignores comments in Makeflow logs. [Andrew Thrasher]


• [Catalog] New catalog_update which reports information to a catalog server. [Peter Bui, Dinesh Rajan]


• [WorkQueue] Various minor tweaks made to the API. [Li Yu, Dinesh Rajan]


• [Catalog/WorkQueue] Support added for querying workers and tasks at run-time. [Douglas Thain]


• [WorkQueue] Many environment variables removed in favor of option manipulation API. [Li Yu]


• [Makeflow] Deprecated -t option (capacity tolerance) removed.


• [WorkQueue] -W (worker status) now has working_dir and current_time fields.


• [WorkQueue] -T (task status) now reports working_dir, current_time, address_port, submit_to_queue_time, send_input_start_time, execute_cmd_start_time. [Li Yu]


• [WorkQueue] -Q (queue status) now reports working_dir.


• [Makeflow] Input file (dependency) renaming supported with new "->" operator. [Michael Albrecht, Ben Tovar]


• [WorkQueue] work_queue_pool now supports a new -L option to specify a log file. [Li Yu]


• [WorkQueue] Tasks are now killed using SIGKILL.


• [WorkQueue] Protocol based keep-alives added to workers. [Dinesh Rajan]

Thanks goes to the contributors for many minor features and bug fixes:

• Michael Albrecht


• Peter Bui


• Patrick Donnelly


• Brian Du Sell


• Kyle Mulholland


• Dinesh Rajan


• Douglas Thain


• Andrew Thrasher


• Ben Tovar


• Li Yu

Please send any feedback to the CCTools discussion mailing list.

CCTools 3.6.2 Released!

The Cooperative Computing Lab is pleased to announce the release of version 3.6.2 of the Cooperative Computing Tools, including Parrot, Chirp, Makeflow, WorkQueue, SAND, All-Pairs, and other software.

This is a bug fix release of version 3.6.1. No new features were added.

The software may be downloaded here:
http://www.cse.nd.edu/~ccl/software/download

Changes:

• [WorkQueue] Corrected memory errors leading to a SEGFAULT. [Li Yu]


• [Makeflow] Properly interpret escape codes in Makeflow files: \n, \t, etc. [Brian Du Sell]


• [Parrot] Watchdog now properly honors minimum wait time. [Li Yu]


• [Parrot] Reports the logical executable name for /proc/self/exe instead of the physical name. [Douglas Thain]


• [WorkQueue] Race conditions in signal handling for workers were corrected. Tasks now have a unique process group to properly kill all task children on abort. [Dinesh Rajan, Li Yu]


• [WorkQueue] Corrected incorrect handling of -C option where worker would not use the same catalog server as work_queue_pool. [Li Yu]

Thanks goes to the contributors for this release: Patrick Donnelly, Brian Du Sell, Dinesh Rajan, Douglas Thain, and Li Yu.

Enjoy!