大型語言模型
Large Language Models
| 節 | 週五 |
|---|---|
5 13:20–14:10 | 大型語言模型 ED103（光復） 3 節連堂 |
6 14:20–15:10 | |
7 15:30–16:20 |
* 根據陽明交大上課時間表所列
Large language models (LLMs) offers a unique opportunity to peek behind the curtains of the groundbreaking advancements in generative artificial intelligence (GAI). By delving into these developments, you will understand how language models are evolved and exploited to deploy over various domains. This course will address how LLMs work under the hood, tearing the lid off the GAI black box. LLMs provide a platform to explore how machines can comprehend, generate, and manipulate language in ways that mimic human cognition. This course focuses on the fundamentals in computation theories, architectures and practices for LLMs, and highlights the academic and industrial advances in the extended models and applications.
Calculus, Linear Algebra, Probability and Statistics
無備註
Teaching materials, codes and datasets will be provided. Teacher assistants will be available at PM19:00-20:00 in week days. Appointments are required. You are encouraged to use online discussion function in E3. TAs will promptly reply your questions.
Temporary Policy: Homework (or Task Competition) (60%), Final Project (40%), Class Attendance (+10%)
-
Neural Network Models
-
Optimization for Deep Models
-
Recurrent Network & Attention
-
Generative Models, Transformer, BERT, GPT & Breeze
-
LLM Model Trends and AI Computing Architecture for LLM
-
DaVinci GAI Platform & Applications
-
Machine Learning Basics
| 週次 | 主題 |
|---|---|
| 第 1 週 | Feedforward & Convolutional Neural Networks 2024-09-06(五) 時數：[2024-09-06]簡仁宗(3.00) |
| 第 2 週 | Regularization for Optimization in Deep Learning 2024-09-13(五) 時數：[2024-09-13]簡仁宗(3.00) |
| 第 3 週 | Recurrent Neural Network & Sequential Learning 2024-09-20(五) 時數：[2024-09-20]簡仁宗(3.00) |
| 第 4 週 | N-Gram Language Models & Topic-Based Language Models 2024-09-27(五) 時數：[2024-09-27]簡仁宗(3.00) |
| 第 5 週 | RNN Language Models & Language Understanding 2024-10-04(五) 時數：[2024-10-04]簡仁宗(3.00) |
| 第 6 週 | Attention Networks & Transformers 2024-10-11(五) 時數：[2024-10-11]簡仁宗(3.00) |
| 第 7 週 | BERT Encoder & GPT Decoder 2024-10-18(五) 時數：[2024-10-18]簡仁宗(3.00) |
| 第 8 週 | Retrieval, Augmentation & Generation 2024-10-25(五) 時數：[2024-10-25]簡仁宗(3.00) |
| 第 9 週 | Generation with Prompting Strategies 2024-11-01(五) 時數：[2024-11-01]簡仁宗(3.00) |
| 第 10 週 | LLMs with GPT, LLaMA & Breeze 2024-11-08(五) 時數：[2024-11-08]簡仁宗(3.00) |
| 第 11 週 | AI Computing Architecture for LLM 2024-11-15(五) 時數：[2024-11-15]梁伯嵩(3.00) |
| 第 12 週 | DaVinci GAI Platform & Applications 2024-11-22(五) 時數：[2024-11-22]梁伯嵩(3.00) |
| 第 13 週 | LLM Model Trends and Generative AI 2024-11-29(五) 時數：[2024-11-29]簡仁宗(3.00) |
| 第 14 週 | Final Presentation 2024-12-06(五) 時數：[2024-12-06]簡仁宗(2.00) 梁伯嵩(1.00) |
| 第 15 週 | Final Presentation 2024-12-13(五) 時數：[2024-12-13]簡仁宗(2.00) 梁伯嵩(1.00) |
| 第 16 週 | Final Presentation 2024-12-20(五) 時數：[2024-12-20]簡仁宗(2.00) 梁伯嵩(1.00) |
1. Lecture Notes and Slides 2. I. Goodfellow and Y. Bengio and A. Courville, Deep Learning, The MIT Press, 2016. 3. S. Watanabe and J.-T. Chien, Bayesian Speech and Language Processing, Cambridge University Press, 2015.
- 地點
- ED708
- 時間
- PM18:00-18:30 on Monday. Appointments are required.
- 聯絡方式
- jtchien@nycu.edu.tw