You are in:

Week 11: Spark

Lecture notes:

Spark - Lecture notes

Other parallel computing frameworks - Lecture slides (6 per page)

Supplemental notes:

Spark Documentation: Links to an extensive list of documentation, tutorial videos, exercises, and trainng materials.
Intro to Apache Spark: ITAS Workshop: introduction, examples, software development lifecycle, case studies
Hands-on Tour of Apache Spark in 5 Minutes: Hortonworks tutorial

Buzzwords:

Reslilient Distributed Data (RDD), transformations, actions, job, task, executor, worker, cluster manager

For questions or comments about this site, contact Paul Krzyzanowski, gro.kp@ofnibew

The entire contents of this site are protected by copyright under national and international law. No part of this site may be copied, reproduced, stored in a retrieval system, or transmitted, in any form, or by any means whether electronic, mechanical or otherwise without the prior written consent of the copyright holder. If there is something on this page that you want to use, please let me know.

Any opinions expressed on this page do not necessarily reflect the opinions of my employers and may not even reflect my own.

Last updated: December 1, 2018

Week 11: Spark

Contents

CS 417

CS 417 background