Work Queue has historically used a "task" abstraction in which a complete program with its input files is submitted for remote execution. David added a capability in which a coprocessor is attached to each worker, providing a hot function execution environment. Then, lightweight tasks representing single function executions can be sent throughout the distributed system, making use of the existing scheduling, resource management, and data movement capabilities of Work Queue.
This allows for the integrated execution of both conventional whole-process tasks and lightweight functions within the same framework. Check out the full poster here:
No comments:
Post a Comment