MR3 is a new execution engine for Hadoop. Similar in spirit to Tez, it can be thought of as an enhancement of Tez with simpler design, better performance, and more features. MR3 is ready for production use as it supports all major features from Tez such as Kerberos-based security, authentication and authorization, fault-tolerance, and recovery. MR3 is implemented in Scala.
Hive-MR3 is an extension of Hive that runs on top of MR3. In order to exploit new features in MR3, Hive-MR3 is built on a modified backend of Hive. In comparison with Hive-on-Tez, Hive-MR3 generally runs faster for sequential queries by virtue of the simple architectual design of ApplicationMaster in MR3. In particular, it makes a better utilization of computing resources and thus yields a higher throughput for concurrent queries.
We are hiring developers who will contribute to the MR3 project. Prior experience with Scala programming or Hadoop is not required, but applicants should have working experience with Linux-based distributed Java programming. Applicants are invited to contact Professor Sungwoo Park (gla at postech.ac.kr). We communicate in English for technical discussions, so applicants should have a working command of English.
MR3 연구에 참여할 학생을 모집합니다. 빅데이터, Hadoop, 소프트웨어 개발에 관심있는 학생이면 됩니다. MR3는 Scala로 개발하고 있습니다.
Programming Language Laboratory Department of Computer Science and Engineering Pohang University of Science and Technology San 31 Hyoja-dong, Nam-gu, Pohang, Gyeongbuk, 790-784 Republic of Korea
Office: PIRL, 354
Web page maintained by Sungwoo Park