CS886 Fall07 - Schedule

This is a partial and tentative schedule only.  As the course progresses, the schedule will be adjusted.

JM = Jurafsky & Martin (2008), Speech and Language Processing, 2nd edition
MS = Manning & Schutze (1999), Foundations of Statistical Natural Language Processing
MRS = Manning, Rhagavan & Schutze (2008), Introduction to Information Retrieval

Lecture
Topics
Complementary Readings
Assigned Readings
Sept 11
Course overview
MS1, JM1

Sept 13
Linguistic essentials
MS3

Sept 18
Elementary probability theory
MS2,5

Sept 20
Inference and n-gram models
MS6, JM4

Sept 25
Basics of machine learning
lecture slides

Sept 27
Vector Space Model
MS15.2, MRS6

Oct 2
Latent semantic analysis, Bayes nets, Expectation Maximization
MS15.4, MRS18, lecture slides

Oct 4
Information theory, entropy, Kullback-Leibler divergence
MS2.2
Probabilistic Latent Semantic Indexing
Presenters: John Whissel and Reid Kerr
Oct 9
Hierarchical Bayesian models, variational expectation maximization


Oct 11
Linear classifiers, perceptrons

Latent Dirichlet Allocation
Presenters: Tyler Lu and Andy Chiu
Oct 16
Support vector machines, probably approximately correct learning


Oct 18
kernels

Text Categorization with Support Vector Machines: Learning with Many Relevant Features
Presenters: Richard Fung and Terry Park
Oct 23
convolution kernels


Oct 25
Maximum entropy principle

Convolution Kernels for Natural Language
Presenters: Abtin Azari and Norris Arab
Oct 30
Maximum entropy models


Nov 1
Markov Models

A Maximum Entropy Approach to Natural Language Processing
Presenters: Lin Xu and Hwayoung Kim
Nov 6
Conditional Random Fields


Nov 8
Statistical Relational Learning

Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Presenters: Adam Hartfiel and Wilson Hsu
Nov 13
Relational Markov Networks


Nov 15
Markov Logic

Collective Information Extraction with Relational Markov Networks
Presenters: Annie Lee and Farheen Omar
Nov 20
Markov Logic Networks


Nov 22
Course wrap up

Joint Inference in Information Extraction
Presenters: Luiz Gomes and Ruonan Li
Group and Topic Discovery from Relations and Text
Presenter: Adam Fourney
Nov 27
Project presentations

Tyler Lu
John Whissel
Wilson Hsu
Annie Lee
Nov 29
Project presentations

Andy Chiu
Richard Fung
HwaYoung Kim
Ruonan Li
Dec 4
Project presentations

Reid Kerr
Adam Hartfiel
Terry Park
Adam Fourney
Dec 6
Project presentations *11:00am - 12:50pm*
Project report deadline

Lin Xu
Farheen Omar
Abtin Azari
Norris Arab
Luiz Gomes