首页 - 学术讲座 - 正文

Distributed Computing of all-to-all Comparisons with big data

创建时间:  2016/06/28  谢姚   浏览次数:   返回

报告人:澳大利亚昆士兰科技大学田玉楚教授

报告时间:201674号(周一)上午10:30

报告地点:延长校区电机楼2楼会议室

 

报告摘要:Solving large-scale all-to-all comparison problems using distributed computing is increasingly significant for various applications. Previous efforts to implement distributed all-to-all comparison frameworks have treated the two phases of data distribution and comparison task scheduling separately. This leads to high storage demands as well as poor data locality for the comparison tasks, thus creating a need to redistribute the data at runtime. Furthermore, most previous methods have been developed for homogeneous computing environments, so their overall performance is degraded even further when they are used in heterogeneous distributed systems. To tackle these challenges, we have developed a dataaware task scheduling approach for solving all-to-all comparison problems in distributed systems. The approach formulates the requirements for data distribution and comparison task scheduling simultaneously as a constrained optimization problem. Then, metaheuristic data pre-scheduling and dynamic task scheduling strategies are developed along with an algorithmic implementation to solve the problem. The approach provides perfect data locality for all comparison tasks, avoiding rearrangement of data at runtime. It achieves load balancing among heterogeneous computing nodes, thus enhancing the overall computation time. It also reduces data storage requirements across the network. The effectiveness of the approach is demonstrated through experimental studies.

 

报告人简介:Professor Yu-Chu Tian, computer scientist and Australia Research Council (ARC) recognized expert of international standing. He is a professor of computer science at the School of Electrical Engineering and Computer Science at Queensland University of Technology in Australia. Prof Tian received the PhD degree from Zhejiang University in 1993 and the PhD degree from the University of Sydney in 2009. He worked in a number of universities in the mainland of China, Hong Kong, USA and Australia. Since 2002, he has been with Queensland University of Technology in Brisbane, Australia, initially as a Lecturer and Senior Lecturer, later as an Associate Professor and Head of Discipline of Networks and Communications, and currently as a Professor. He has published a monograph and over 190 refereed papers. His current research interests include systems engineering, real-time computing, computer networks, big data processing, distributed and cloud computing, and control theory and engineering. He led establishment QUT’s Netcom Discipline and Big Data Lab for Experimental HPC and Networks. He has also led several large-scale research projects from ARC and CRCs (Cooperative Research Centres). He is the editor-in-chief for Springer’s Handbook of Real-Time Computing, an Associate Editor for Information Sciences (Elsevier) and Asia-Pacific Journal of Chemical Engineering (Wiley).

上一条:微流控芯片的应用

下一条:Achieving Privacy-Preserving Location-Based Query over Outsourced Encrypted Data