Siyapath: P2P Gossip Based Volunteer Computing Framework
1 like625 views
This document introduces Siyapath, a peer-to-peer gossip-based volunteer computing framework. It addresses the growing demand for computational power by utilizing resources from the general public in a volunteer computing network. Siyapath uses a peer-to-peer and serverless architecture with gossip protocols to distribute jobs across volunteer nodes. It implements features like job submission, scheduling, distribution, processing, validation and fault tolerance in a scalable and robust manner without single points of failure. The framework is implemented in Java using Apache Thrift for services and communication between peer nodes.
Siyapath: P2P Gossip Based Volunteer Computing Framework
- 1. Siyapath Peer to peer Gossip Based Volunteer Computing Framework
- 2. Problem Analysis Growth of demand for high computational power High Performance Computing High Throughput Computing Supercomputing vs. Distributed Computing Cluster Computing Grid/Desktop Grid Computing Volunteer Computing Tradeoff between cost and throughput
- 3. Volunteer Computing Computational power volunteered by general public Large resource pool self-financing / self-maintaining Volunteer Computing Frameworks Existing frameworks BOINC Bayanihan JADIF
- 4. Introducing Siyapath Volunteer computing framework Peer-To-Peer Architecture Absence of server bottleneck Gossip Protocols High scalability Robustness Absence of single point of failure Reliability
- 5. Features Gossip as the communication protocol Job submission Job scheduling Task distribution Task processing Result validation Fault Tolerance Security
- 8. Implementation Programming Language - Java Services Framework - Apache Thrift Communication via a service interface Addresses implementation details of the network (not our focus) P2P nature using thrift client/server Implementation of gossip protocols
- 10. Best Practices Version control system Subversion. Hosted on Google http://code.google.com/p/siyapath/ Build Automation Apache Maven Unit / Integrated testing JUnit Logging Apache Log4j Continuous Integration Cloudbees - https://siyapath.ci.cloudbees.com/job/siyapath-ci/ Website http://siyapath.org
- 11. Project Supervisors Mrs. Vishaka Nanayakkara Dr. Srinath Perera Group members 080475F - W.G.H.A.M. Silva 080083C- W.D.M. Dhanushka 080313J - H.D. Nadeeshani 080324T - M.N.M. Nufail