Makefile::Parallel - Dependency specification language
?
0 likes?910 views
The document discusses options for running parallel processes on a computing cluster and introduces Makefile::Parallel as a solution. Makefile::Parallel uses a Makefile-like syntax to specify dependencies between processes and can generate profiling data while handling errors. It aims to provide an easy to use and maintain system for defining and running parallel jobs across different computing platforms.
Makefile::Parallel - Dependency specification language
- 1. Makefile::Parallel Dependency Specification Language
- 2. Rúben Fonseca root@cpan.org
- 3. Well done is quickly done Ceaser Augustus
- 4. SeARCH Cluster ~ 100 64-bits cores ~ 100Gb RAM ~ 4TB storage Myrinet 10Gb Linux (CentOS)
- 5. How to run those processes? 3 options!
- 6. Solution 1 while(! end) { run process $p while(! finished $p) { sleep n } mark $p as done }
- 7. Solution 2 #!/bin/foo run p1 run p2 result1 run p3 result2 run p4 result1 result2
- 8. Solution 3 Makefile::Parallel :-)