We are pleased to announce the release of version 7.6.0
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.
- Docs: https://cctools.readthedocs.io
- Download: http://ccl.cse.nd.edu/software/download
- Forum: http://ccl.cse.nd.edu/community/forum
This release introduces a number of performance, usability, and
documentation improvements to the TaskVine workflow executor.
TaskVine -
- Integration with Parsl workflow system. (Thanh Phung)
- Integration with Dask workflow system (Ben Tovar)
- Optimized scheduling performance with large numbers of workers. (Colin Thomas)
- Enhanced dispatch performance for small tasks. (Colin Thomas)
- vine_submit_workers combined tool for submtting workers. (Thanh Phung)
- Improved generation of file cache names (Barry Sly-Delgado)
- fetch_file interface to obtain cached files in the cluster. (Douglas Thain)
- Worker-to-worker authentication for peer transfers.
- Updated documentation. (All)
Work Queue:
- Enhanced dispatch performance for small tasks. (Colin Thomas)
Makeflow:
- Now supports TaskVine as an execution mode. (Douglas Thain)
General:
- TCP catalog updates are performed in a background process to reduce latency.
Thanks goes to the contributors for many features, bug fixes, and tests:
Thanh Son Phung
Barry Sly-Delgado
Colin Thomas
Ben Tovar
Douglas Thain
Enjoy!