School of Engineering and Computer Science Te Kura Mātai Pūkaha, Pūrorohiko

Lecture Notes 2021

Week 1:
  • Course Introduction
  • What is Big Data ? Where Big Data Comes from [PDF ]
  • What we can do and what should we do with Big Data ? [PDF]

Week 2:
  • Introduction to Feature Manipulation [PDF]
  • Feature Selection: Wrapper approaches and Sequential Search [PDF]
    • Reading: Data Preprocessing [PDF]

Week 3:
  • Feature Selection: Filter and Embedded approaches [PDF]
    • Extra Notes --- COMP 307 Decision Tree Learning with An Example [PDF]

Week 4:
  • Feature Manipulation for High-Dimensional Data: Feature Construction [PDF]

Week 5:

Week 6: Moving Beyond Linearity: Linear Regression and Shrinkage Methods [PDF]

Week 7:

Week 8-9: Hadoop MapReduce [PDF]

Week 10-11: Apache Spark [PDF]

Week 11-12: Spark Machine Learning Libraries [PDF]
Topic attachments
I Attachment Action Size Date Who Comment
AIML427_2021_Test_Final.pdfpdf AIML427_2021_Test_Final.pdf manage 131 K 10 May 2021 - 12:43 Main.chenqi1  
COMP307Related.zipzip COMP307Related.zip manage 4 MB 16 Feb 2021 - 09:15 Main.chenqi1  
Credit.csvcsv Credit.csv manage 25 K 21 Mar 2021 - 14:00 Main.chenqi1  
Week10-11_Apache Spark.pdfpdf Week10-11_Apache Spark.pdf manage 14 MB 12 May 2021 - 19:59 Main.chenqi1  
Week11-12_Spark ML.pdfpdf Week11-12_Spark ML.pdf manage 2 MB 26 May 2021 - 22:52 Main.chenqi1  
Week5_6_Regression2Nolinearity.pdfpdf Week5_6_Regression2Nolinearity.pdf manage 3 MB 28 Mar 2021 - 21:45 Main.chenqi1  
Week5_Regression1.pdfpdf Week5_Regression1.pdf manage 4 MB 24 Mar 2021 - 17:05 Main.chenqi1  
Week8-9_MapReduce.pdfpdf Week8-9_MapReduce.pdf manage 30 MB 03 May 2021 - 11:11 Main.chenqi1  
Week9-10_Apache Spark.pdfpdf Week9-10_Apache Spark.pdf manage 14 MB 12 May 2021 - 19:58 Main.chenqi1  
Print version | Backlinks |