DataMPI

Extending MPI for Big Data with Key-Value based Communication

Research

  1. Xiaoyi Lu, Fan Liang, Bing Wang, Li Zha, Zhiwei Xu. DataMPI: Extending MPI to Hadoop-like Big Data Computing. In Proceedings of the 28th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2014), Phoenix, Arizona, USA, 2014.

  2. Zhiwei Xu. High-Performance Techniques for Big Data Computing in Internet Services. In Proceedings of the 2012 SC Companion: High Performance Computing (SC 2012), Salt Lake City, Utah, USA, 2012. [Download]

  3. Xiaoyi Lu, Bing Wang, Li Zha, Zhiwei Xu. Can MPI Benefit Hadoop and MapReduce Applications? In Workshop (SRMPDS 2011) Proceedings of the 40th International Conference on Parallel Processing (ICPP 2011), Taipei, China, 2011. [Download]

  1. Xiaoyi Lu. DataMPI: Extending MPI to Hadoop-like Big Data Computing. Presented in the 28th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2014), Phoenix, Arizona, USA, 2014.

  2. Xiaoyi Lu. Performance Benefits of DataMPI: A Case Study with BigDataBench. Presented in the Fourth Workshop on Big Data Benchmarks, Performance Optimization, and Emerging Hardware (BPOE-4), Co-located with 2014 International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2014), Salt Lake City, Utah, USA, 2014.

  3. Xiaoyi Lu. Extending MPI to Big Data Computing: Challenges and Benefits of DataMPI. Presented in 2013 Big Data Technology Conference (BDTC 2013), Beijing, China, 2013. [Invited talk]

  4. Zhiwei Xu. Cloud-Sea Computing on Zettabytes of Data. Presented in 2013 International SuperComputing Big Data Conference (ISC-BigData 2013), Heidelberg, Germany, 2013. [Invited talk]

  5. Zhiwei Xu. Acquisition & Analysis of Immense Datasets for e-People. Presented in 2013 International SuperComputing Conference (ISC 2013), Leipzig, Germany, 2013. [Invited talk]

  6. Zhiwei Xu. High-Performance Techniques for Big Data Computing in Internet Services. Presented in 2012 International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2012), Salt Lake City, Utah, USA, 2012. [Invited talk]

Copyright (C) 2011-2014, DataMPI team

fork me on github
Locations of visitors to this page