VBM682   Natural Language Processing


 

Semester

Fall 2024

Instructor

Prof. Dr. İlyas Çiçekli

Email:  ilyas@cs.hacettepe.edu.tr

Class Hours 

Thursday 18:30-21:00

Classroom: D10

  


Text Book

1.   Daniel Jurafsky, and James H. Martin, "Speech and Language Processing", Third Edition, Prentice Hall, 2024.

 

Other References

 

1.    Christopher D. Manning, and Hinrich Schutze, "Foundations of Statistical Natural Language Processing", The MIT Press, 1999.

2.    Bird, Steven, Edward Loper and Ewan Klein, “Natural Language Processing with Python”, O’Reilly Media Inc., 2009.

 


Grading

Final Exam :

50%

Homework :

50%

 


Course Outline:

Week

Subject

Related chapters in 3rd edition of textbook

1

Introduction/Overview of NLP

Ch. 1

2

Regular Expressions, Text Normalization, Edit Distance

Ch. 2

3

N-gram Language Models,

Ch. 3

4

Spelling Correction, Part-of-Speech Tagging

Ch. 8 & Appendix B

5

Text Classification: Naive Bayes

Ch. 4

6

Text Classification: Logistic Regression

Ch. 5

7

Vector Semantics

Ch. 6

8

Neural Networks and Neural Language Models

Ch. 7

9

RNNs and LSTMs

Ch. 9

10

Transformers and Large Language Models

Ch. 10

11

Fine-Tuning and Masked Language Models

Ch. 11

12

Morphological Processing

Ch. 3 from 2nd edition of the book

13

Context-Free Grammars and Syntactic Parsing

Ch. 17 and else

14

Statistical Parsing

Ch. 18 and else

 

 


 

Lecture Notes:

           

·       lec01-introduction.pdf

·       lec02-1-BasicTextProcessing.pdf

·       lec02-2-MinimumEditDistance.pdf

·       lec03-LanguageModels.pdf

·       lec04-1-SpellingCorrection.pdf

·       lec04-2-PartOfSpeechTagging.pdf

·       lec05-TextClassificationNaiveBayes.pdf

·       lec06-LogisticRegression.pdf

·       lec07-VectorSemantics_Word2vec.pdf

·       lec08-NN_NeuralLanguageModels.pdf

·       lec09-RNNs_LSTMs.pdf

·       lec10-Transformers_LLMs.pdf

·       lec11-BidirectionalTransformerEncoders.pdf

·       lec12-MorphologicalProcessing.pdf

·       lec13-1-SyntacticParsing.pdf

·       lec13-2-StatisticalParsing.pdf

 

 


 

Announcements:

 

·       Tüm ders duyuruları için HADI sistemini (https://hadi.hacettepe.edu.tr/login/) kullanacağım. Notlarınız, ödev duyuruları ve ödev gönderilmeleri için HADI sistemi kullanılacaktır.