BYM452 Natural Language ProcessingInstitutional InformationDegree Programs Computer EngineeringInformation For StudentsDiploma SupplementErasmus Policy StatementNational Qualifications
Computer Engineering

Preview

Bachelor TR-NQF-HE: Level 6 QF-EHEA: First Cycle EQF-LLL: Level 6

Course General Introduction Information

Course Code: BYM452
Course Name: Natural Language Processing
Course Semester: Spring
Course Credits:
ECTS
6
Language of instruction:
Course Requirement:
Does the Course Require Work Experience?: No
Type of course: Departmental Elective
Course Level:
Bachelor TR-NQF-HE:6. Master`s Degree QF-EHEA:First Cycle EQF-LLL:6. Master`s Degree
Mode of Delivery: Face to face
Course Coordinator : Dr.Öğr.Üyesi KEMAL ÇAĞRI SERDAROĞLU
Course Lecturer(s): Prof. Dr. Halis Altun
Course Assistants:

Course Purpose and Content

Course Objectives: Natural language processing (NLP) is a very important technology in the information age. Exciting advances in the field of natural language processing (NLP) have emerged recently, enabling systems that can perform tasks such as text translation, question answering, and spoken conversations. This course aims to provide students with a basic understanding of NLP, including standard frameworks, algorithms and techniques used to solve a variety of NLP problems. The curriculum will cover topics such as language modelling, representation learning, text classification, string tagging, syntactic parsing, machine translation and question answering, with a particular focus on recent deep learning approaches. Through this course, students will receive a comprehensive introduction to NLP concepts, methods, algorithms, applications, and cutting-edge method research in the field of deep learning for NLP.
Course Content: This lesson; Introduction to Natural Language Processing (NLP), Linguistic Fundamentals, Regular Exp., Text Normalization, Edit Distance, N-gram Models, Machine Learning Fundamentals, Text Classification, Naive Bayes and Logistic Regression, Vector Semantics and Dense Word Embeddings, Artificial Neural Networks and Neural Language Models, Sequence Tagging for Parts of Speech and Named Entities, Exam Week, RNNs and LSTMs, Transformers and Pre-Trained Language Models, Fine-Tuned and Masked Language Models, Machine Translation, Question Answering and Information Retrieval, Chatbots and Conversational Systems, Automated Speech Recognition and Text-to-Speech Conversion, Context-Free Grammars, Formation Parsing, Dependency Parsing, Logical Representations of Sentence Meaning, Topic Review and Project Presentations; Includes topics.

Learning Outcomes

The students who have succeeded in this course;
1) In NLP, breaking a real-world problem into subproblems, using existing natural language processing tools to conduct basic NLP, and identifying potential solutions.
2) Learn about the main uses of machine learning techniques and deep learning models in NLP.
3) Describe state-of-the-art methods for tackling NLP sub-problems such as text representation, representation learning techniques, text mining, language modeling and similarity detection, and gain an understanding of methods and metrics for various natural language processing tasks and applications.

Course Flow Plan

Week Subject Related Preparation
1) Introduction to Natural Language Processing Textbook
2) Linguistic Fundamentals, Regular Exp., Text Normalization, Edit Distance Textbook
3) N-gram Models Textbook
4) Machine Learning Fundamentals, Text Classification, Naive Bayes and Logistic Regression Textbook
5) Vector Semantics and Dense Word Embeddings Textbook
6) Artificial Neural Networks and Neural Language Models Textbook
7) Sequence Tagging for Parts of Speech and Named Entities Textbook
8) Midterm Textbook
9) RNNs and LSTMs Textbook
10) Transformers and Pretrained Language Models, Fine-Tuned and Masked Language Models Textbook
11) Machine Translation, Question Answering and Information Gathering Textbook
12) Chatbots and Conversational Systems, Automatic Speech Recognition and Text-to-Speech Conversion Textbook
13) Context-Free Grammars, Formation Parsing, Dependency Parsing, Logical Representations of Sentence Meaning Textbook
14) Revision

Sources

Course Notes / Textbooks: Speech and Language Processing, Jurafsky and Martin, 3rd edition
References: Ders Kitabı Ders Notları

Course - Learning Outcome Relationship

No Effect 1 Lowest 2 Medium 3 Highest
       
Program Outcomes Level of Contribution
1) Adequate knowledge in mathematics, science and engineering subjects pertaining to the relevant discipline; ability to use theoretical and applied knowledge in these areas in complex engineering problems.
2) Ability to identify, formulate, and solve complex engineering problems; ability to select and apply proper analysis and modeling methods for this purpose.
3) Ability to design a complex system, process, device or product under realistic constraints and conditions, in such a way as to meet the desired result; ability to apply modern design methods for this purpose
4) Ability to devise, select, and use modern techniques and tools needed for analyzing and solving complex problems encountered in engineering practice; ability to employ information technologies effectively.
5) Ability to design and conduct experiments, gather data, analyze and interpret results for investigating complex engineering problems or discipline specific research questions.
6) Ability to work efficiently in intra-disciplinary and multi-disciplinary teams; ability to work individually.
7) Ability to communicate effectively in Turkish, both orally and in writing; knowledge of a minimum of one foreign language; ability to write effective reports and comprehend written reports, prepare design and production reports, make effective presentations, and give and receive clear and intelligible instructions.
8) Knowledge of the global and societal impacts of engineering practices on priority issues such as health, environment and safety and contemporary issues; knowledge of the legal aspects of engineering solutions. awareness of the consequences
9) Consciousness to behave according to ethical principles and professional and ethical responsibility; knowledge on standards used in engineering practice.
10) Information about business life practices such as project management, risk management, and change management; awareness of entrepreneurship, innovation, and knowledge about sustainable development.
11) Ability to design systems to meet desired needs
12) Ability to apply basic sciences in the field of computer engineering
13) Ability to implement designs by experiments
14) Recognition of the need for lifelong learning; ability to access information, to follow developments in science and technology, and to continue to educate him/herself.

Learning Activity and Teaching Methods

Course
Homework
Proje Hazırlama
Rapor Yazma

Measurement and Evaluation Methods and Criteria

Yazılı Sınav (Açık uçlu sorular, çoktan seçmeli, doğru yanlış, eşleştirme, boşluk doldurma, sıralama)
Homework
Bireysel Proje
Raporlama

Assessment & Grading

Semester Requirements Number of Activities Level of Contribution
Homework Assignments 3 % 10
Project 1 % 20
Midterms 1 % 25
Final 1 % 45
total % 100
PERCENTAGE OF SEMESTER WORK % 55
PERCENTAGE OF FINAL WORK % 45
total % 100

İş Yükü ve AKTS Kredisi Hesaplaması

Activities Number of Activities Aktiviteye Hazırlık Aktivitede Harçanan Süre Aktivite Gereksinimi İçin Süre Workload
Course Hours 13 2 26
Study Hours Out of Class 14 5 70
Project 1 20 20
Homework Assignments 3 20 60
Midterms 1 2 2
Jury 1 2 2
Total Workload 180