CMP476 Introduction to Natural Language Processing
Semester :
2026 Fall
Instructor : Ilyas Cicekli
Email :
ilyas@cs.hacettepe.edu.tr
Class Hours : Thursday 13:40-16:30
Classroom: D8
Text Book
1. Daniel Jurafsky, and James H. Martin, "Speech and Language Processing", Third Edition, Prentice Hall, 2024.
Reference Books
3. Bird, Steven, Edward Loper and Ewan Klein, “Natural Language Processing with Python”, O’Reilly Media Inc., 2009.
Grading:
Quizzes : 30%
Midterm : 30%
Final : 40%
Quiz Policy:
· There will be at least 5 pop-up quizzes.
· Pop-up quizzes will NOT be announced; regular attendance is required in order to take the quizzes. Pop-up quizzes may be given at any time during the scheduled class hours. These quizzes are intended to help students review and reinforce the material covered in class. Since they may be given without prior notice, students are encouraged to attend class regularly and keep up with the course material.
· There are NO make-ups for pop-up quizzes.
· 5% of your quiz grade will be based on your lowest quiz score out of the N quizzes, and 95% will be based on your highest N−1 quiz scores.
Programming
Assignments:
·
There will be
several programming assignments provided as optional exercises throughout the
course. These assignments are intended to give you an opportunity to practice
the concepts and techniques covered in class and to further develop your
programming skills. They will not be
graded and will not contribute to your course or assignment grades.
Therefore, completing these exercises is entirely optional and up to you.
·
Please note that no direct support or assistance will
be provided for these programming assignments. You are encouraged to work
through the exercises independently and use the available course materials and
resources to help you when needed.
Tentative Course Outline:
|
Week |
Subject |
Related chapters in 3rd edition of
textbook |
|
1 |
Introduction/Overview of NLP |
Ch. 1 |
|
2 |
Regular Expressions, Text Normalization, Edit Distance |
Ch. 2 |
|
3 |
N-gram Language Models, |
Ch. 3 |
|
4 |
Spelling Correction, Part-of-Speech Tagging |
Ch. 8 & Appendix B |
|
5 |
Text Classification: Naive Bayes |
Ch. 4 |
|
6 |
Text Classification: Logistic Regression |
Ch. 5 |
|
7 |
Vector Semantics |
Ch. 6 |
|
|
MIDTERM |
|
|
8 |
Neural Networks and Neural
Language Models |
Ch. 7 |
|
9 |
RNNs and LSTMs |
Ch. 9 |
|
10 |
Transformers and Large
Language Models |
Ch. 10 |
|
11 |
Fine-Tuning and Masked
Language Models |
Ch. 11 |
|
12 |
Morphological Processing |
Ch. 3 from 2nd edition of the book |
|
13 |
Context-Free Grammars and Syntactic Parsing |
Ch. 17 and else |
|
14 |
Statistical Parsing |
Ch. 18 and else |
|
|
FINAL EXAM |
|
Lecture Notes:
Announcements:
· We will use the HADI system
( https://hadi.hacettepe.edu.tr/login/
) for all course announcements. All course materials, including your grades,
will be available in the HADI system. You should regularly check the HADI
system for the course announcements.
·
Midterm Date:
November 19, Time: 13:40, Location: D8, ??
o Midterm will be a closed
book exam.