SFBay ACM: DryadLINQ: A System for General-Purpose Distributed Data-Parallel Computing March 18, 2009

Presented by Yuan Yu, Senior Researcher at Microsoft Research, Silicon Valley Lab

DryadLINQ provides a simple, powerful, and elegant programming environment for large-scale data parallel computing. It combines the .NET Language Integrated Query (LINQ) and the Dryad distributed execution engine. A DryadLINQ program is a sequential program (written in C#, VB, or F#) composed of LINQ expressions performing arbitrary side effect-free transformations on datasets, and can be written and debugged using standard .NET development tools. The DryadLINQ system automatically and transparently translates the data-parallel portions of the program into a distributed execution plan and executes it using the Dryad execution engine, which ensures reliable, scalable execution of the plan. In this talk, I will describe the programming model, the design, and the implementation of the DryadLINQ system.

Official Website: http://www.sfbayacm.org/events/2009-03-18.php