Programming Language Laboratory - Welcome!

Computer Science and Engineering Department
Pohang University of Science and Technology

MR3

https://mr3.postech.ac.kr

MR3 is a new execution engine for Hadoop and Kubernetes. It is a new execution engine with simple design, excellent performance, and native support for both Yarn and Kubernetes. MR3 is ready for production use as it supports all major features such as Kerberos-based security, authentication and authorization, fault-tolerance, and recovery. MR3 is implemented in Scala.

Hive on MR3. Hive, the de facto standard for SQL queries in Hadoop, currently supports three execution engines for its backend -- MapReduce, Tez, and Spark. Now Hive can run on top of MR3 as well. Hive on MR3 runs much faster than Hive on Tez by virtue of the simple architectural design of MR3. In particular, it yields a much higher throughput for concurrent queries by making a better utilization of computing resources. Hive 2 and 3 also support an execution mode called LLAP (Low Latency Analytical Processing) designed for interactive queries. In comparison with Hive with LLAP, Hive on MR3 allows elastic allocation of cluster resources, provides better support for concurrency, and fully implements impersonation.

Hive on Kubernetes With its native support for Kubernetes, MR3 can power Hive on Kubernetes clusters. As it creates and destroys containers as necessary, MR3 enables Hive to take full advantage of the dynamic resource allocation of Kubernetes. By reading data from remote sources while running containers on Kubernetes, Hive on MR3 can achieve the separation of compute and storage.

We are hiring developers who will contribute to the MR3 project. Prior experience with Scala programming or Hadoop is not required, but applicants should have working experience with Linux-based distributed Java programming. Applicants are invited to contact Professor Sungwoo Park (gla at postech.ac.kr). We communicate in English for technical discussions, so applicants should have a working command of English.

MR3 연구에 참여할 학생을 모집합니다. 빅데이터, Hadoop, 소프트웨어 개발에 관심있는 학생이면 됩니다. MR3는 Scala로 개발하고 있습니다.

POSTECH 컴퓨팅사고력센터

https://ct.postech.ac.kr

• 누구나 컴퓨팅 사고를 익힐 수 있도록 전문성 갖춘 강좌를 무료로 제공하는 서비스입니다.
• 컴퓨팅으로 문제를 풀 때 핵심이라 할 수 있는 컴퓨팅 사고를 Python 언어와 함께 설명합니다.
• 별도의 소프트웨어 설치 없이 바로 사용할 수 있는 Python 프로그래밍 환경을 제공합니다.
• 프로그래밍 숙제는 자동으로 채점해서 결과를 설명해주고 프로그램 분석 기술을 이용하여 틀린 곳까지 찾아줍니다.
• 학원이나 코딩 교육 사이트보다 월등히 높은 수준의 교육 서비스를 무료로 제공합니다.

• 프로그램 분석 연구에 관심있는 학생을 모집합니다. 학부 프로그래밍언어 과목을 수강한 학생이면 됩니다. 프로그램 분석기는 Scala로 개발하고 있습니다.

소프트웨어

• A Theorem Prover for Intuitionistic Modal Logic S5
• BBeye: A Theorem Prover for Boolean BI (Bunched Implications)
• Mechanizing Metatheory without Typing Contexts
• Judgmental Subtyping Systems with Intersection Types and Modal Types
• PGG (Parser Generator Generator for Functional Languages)
• QuickParanoid - A Tool for Ortholog Clustering

Office: PIRL, 354
Phone: +82-54-279-5878

Web page maintained by Sungwoo Park