Advanced Techniques in Machine Learning (89654)


Class notes

  1. From Binary to Multiclass
    Class notes can be downloaded from here. They were also summarized in Hebrew by Vered Shwartz.
    Error Correcting Output Codes (ECOC) is summarized in a beasutiful paper by Allwein, Schapire, and Singer (2000).

  2. Multiclass
    Class notes can be downloaded from here. Again you can look at the notes in Hebrew made by Vered Shwartz.

  3. Multilabel and ranking
    Definition of the multilabel problem and its surrogate loss is presented in Section 2 of (Crammer and Singer, 2003) and in Section 7 (the first half) of (Crammer, Dekel, Keshet, Shalev-Shwartz, and Singer, 2006)
    The presentation on search engines can be downloaded from here.

  4. Search engines
    The presentation on search engines can be downloaded from here.

  5. Structured prediction
    First presentation on structured prediction can be downloaded from here.
    Look at the presentation of Klein and Taskar and the presentation of Gärtner and Vembu.

  6. Conditional Random Fields (CRFs)
    CRFs are extension of logistic regression to structured output problems. A description of CRF is given here.

  7. Recommender systems
    Presentation can be found (new version!)here.
    If you are interested, see also papers by Yehuda Koren.

  8. Latent Dirichlet Allocation
    Presentation can be found here.

  9. Generative models and deep neural models
    Presentation is based on the presentation given at Standford CS231n and can be found here.

  10. Adversarial examples
    Presentaion can be downloaded here.




Previous exams

2014a, 2014b, 2015a, 2015b 2016a, and 2016b


Exercises

Exercises can be downloaded from the Piazza.