BYM452 Natural Language ProcessingInstitutional InformationDegree Programs Software EngineeringInformation For StudentsDiploma SupplementErasmus Policy StatementNational Qualifications
Software Engineering

Preview

Bachelor TR-NQF-HE: Level 6 QF-EHEA: First Cycle EQF-LLL: Level 6

Course General Introduction Information

Course Code: BYM452
Course Name: Natural Language Processing
Course Semester: Fall
Course Credits:
ECTS
6
Language of instruction:
Course Requirement:
Does the Course Require Work Experience?: No
Type of course: Area Ellective
Course Level:
Bachelor TR-NQF-HE:6. Master`s Degree QF-EHEA:First Cycle EQF-LLL:6. Master`s Degree
Mode of Delivery: Face to face
Course Coordinator : Dr.Öğr.Üyesi KEMAL ÇAĞRI SERDAROĞLU
Course Lecturer(s): Prof. Dr. Halis Altun
Course Assistants:

Course Purpose and Content

Course Objectives: Natural language processing (NLP) is a very important technology in the information age. Exciting advances in the field of natural language processing (NLP) have emerged recently, enabling systems that can perform tasks such as text translation, question answering, and spoken conversations. This course aims to provide students with a basic understanding of NLP, including standard frameworks, algorithms and techniques used to solve a variety of NLP problems. The curriculum will cover topics such as language modelling, representation learning, text classification, string tagging, syntactic parsing, machine translation and question answering, with a particular focus on recent deep learning approaches. Through this course, students will receive a comprehensive introduction to NLP concepts, methods, algorithms, applications, and cutting-edge method research in the field of deep learning for NLP.
Course Content: This lesson; Introduction to Natural Language Processing (NLP), Linguistic Fundamentals, Regular Exp., Text Normalization, Edit Distance, N-gram Models, Machine Learning Fundamentals, Text Classification, Naive Bayes and Logistic Regression, Vector Semantics and Dense Word Embeddings, Artificial Neural Networks and Neural Language Models, Sequence Tagging for Parts of Speech and Named Entities, Exam Week, RNNs and LSTMs, Transformers and Pre-Trained Language Models, Fine-Tuned and Masked Language Models, Machine Translation, Question Answering and Information Retrieval, Chatbots and Conversational Systems, Automated Speech Recognition and Text-to-Speech Conversion, Context-Free Grammars, Formation Parsing, Dependency Parsing, Logical Representations of Sentence Meaning, Topic Review and Project Presentations; Includes topics.

Learning Outcomes

The students who have succeeded in this course;
1) In NLP, breaking a real-world problem into subproblems, using existing natural language processing tools to conduct basic NLP, and identifying potential solutions.
2) Learn about the main uses of machine learning techniques and deep learning models in NLP.
3) Describe state-of-the-art methods for tackling NLP sub-problems such as text representation, representation learning techniques, text mining, language modeling and similarity detection, and gain an understanding of methods and metrics for various natural language processing tasks and applications.

Course Flow Plan

Week Subject Related Preparation
1) Introduction to Natural Language Processing Textbook
2) Linguistic Fundamentals, Regular Exp., Text Normalization, Edit Distance Textbook
3) N-gram Models Textbook
4) Machine Learning Fundamentals, Text Classification, Naive Bayes and Logistic Regression Textbook
5) Vector Semantics and Dense Word Embeddings Textbook
6) Artificial Neural Networks and Neural Language Models Textbook
7) Sequence Tagging for Parts of Speech and Named Entities Textbook
8) Midterm Textbook
9) RNNs and LSTMs Textbook
10) Transformers and Pretrained Language Models, Fine-Tuned and Masked Language Models Textbook
11) Machine Translation, Question Answering and Information Gathering Textbook
12) Chatbots and Conversational Systems, Automatic Speech Recognition and Text-to-Speech Conversion Textbook
13) Context-Free Grammars, Formation Parsing, Dependency Parsing, Logical Representations of Sentence Meaning Textbook
14) Revision

Sources

Course Notes / Textbooks: Speech and Language Processing, Jurafsky and Martin, 3rd edition
References: Ders Kitabı Ders Notları

Course - Learning Outcome Relationship

No Effect 1 Lowest 2 Medium 3 Highest
       
Program Outcomes Level of Contribution
1) Sufficient knowledge in mathematics, science and software engineering discipline-specific topics; the theoretical and practical knowledge in these areas, the ability to use in complex engineering problems. 3
2) The ability to identify, formulate, and solve complex engineering problems; selecting and applying appropriate analysis and modelling methods for this purpose. 3
3) The ability to design a complex system, process, device or product under realistic constraints and conditions to meet specific requirements; the ability to apply modern design methods for this purpose. 3
4) Ability to develop, select and use modern techniques and tools necessary for analysis and solution of complex problems in engineering applications; ability to use information technologies effectively. 3
5) Ability to design experiments, conduct experiments, collect data, analyse and interpret the results of complex engineering problems or discipline-specific research topics. 3
6) Disiplin içi ve çok disiplinli takımlarda etkin biçimde çalışabilme becerisi; bireysel çalışma becerisi. 3
7) Awareness of the need for lifelong learning; access to knowledge, ability to follow developments in science and technology, and constant self-renewal. 3
8) Effective communication skills in Turkish oral and written communication; at least one foreign language knowledge; ability to write effective reports and understand written reports, to prepare design and production reports, to make effective presentations, to give clear and understandable instructions and to receive. 2
9) Conformity to ethical principles, professional and ethical responsibility; Information on standards used in engineering applications. 2
10) Information on practices in business, such as project management, risk management and change management; awareness about entrepreneurship, innovation; information on sustainable development. 2
11) Information on the effects of engineering applications on health, environment, and safety in universal and social dimensions, and on the problems of the modern age in engineering; awareness of the legal consequences of engineering solutions. 2
12) Adequate skills in the analysis, design, verification, evaluation, implementation, implementation, and maintenance of software systems 2

Learning Activity and Teaching Methods

Course
Homework
Proje Hazırlama
Rapor Yazma

Measurement and Evaluation Methods and Criteria

Yazılı Sınav (Açık uçlu sorular, çoktan seçmeli, doğru yanlış, eşleştirme, boşluk doldurma, sıralama)
Homework
Bireysel Proje
Raporlama

Assessment & Grading

Semester Requirements Number of Activities Level of Contribution
Homework Assignments 3 % 10
Project 1 % 20
Midterms 1 % 25
Final 1 % 45
total % 100
PERCENTAGE OF SEMESTER WORK % 55
PERCENTAGE OF FINAL WORK % 45
total % 100

İş Yükü ve AKTS Kredisi Hesaplaması

Activities Number of Activities Aktiviteye Hazırlık Aktivitede Harçanan Süre Aktivite Gereksinimi İçin Süre Workload
Course Hours 13 2 26
Study Hours Out of Class 14 5 70
Project 1 20 20
Homework Assignments 3 20 60
Midterms 1 2 2
Jury 1 2 2
Total Workload 180