Update 2023-12-12-LLM.md

rkuo2000 · Feb 8, 2024 · 1adecf1 · 1adecf1
1 parent 4d5b9d1
commit 1adecf1
Showing 1 changed file with 11 additions and 17 deletions.
diff --git a/_posts/2023-12-12-LLM.md b/_posts/2023-12-12-LLM.md
@@ -6,7 +6,7 @@ category: [Lecture]
 tags: [jekyll, ai]
 ---
 
-Introduction to Large Language Models (LLMs), LLM in Vision, etc.
+Introduction to Large Language Models (LLMs), MM-LLMs, etc.
 
 ---
 ## History of LLM
@@ -15,33 +15,19 @@ Introduction to Large Language Models (LLMs), LLM in Vision, etc.
 *ChatGPT saw 1.6B visits in May 2023.*<br>
 *Meta also released three versions of LLaMA-2 (7B, 13B, 70B) free for commercial use in July.*<br>
 
----
-### 從解題能力來看四代語言模型的演進
-An evolution process of the four generations of language models (LM) from the perspective of task solving capacity.<br>
-![](https://d3i71xaburhd42.cloudfront.net/c61d54644e9aedcfc756e5d6fe4cc8b78c87755d/2-Figure2-1.png)
-
----
-### 大型語言模型統計表
-![](https://d3i71xaburhd42.cloudfront.net/c61d54644e9aedcfc756e5d6fe4cc8b78c87755d/8-Table1-1.png)
+### 大型語言模型(>10B)的時間軸
+![](https://api.wandb.ai/files/vincenttu/images/projects/37228380/5a69d608.png)
 
----
-### 近年大型語言模型(>10B)的時間軸
-![](https://d3i71xaburhd42.cloudfront.net/c61d54644e9aedcfc756e5d6fe4cc8b78c87755d/9-Figure3-1.png)
-
----
 ### 大型語言模型之產業分類
 ![](https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F2e8bfd65-5272-4cf1-8b86-954bab975bab_2400x1350.png)
 
----
 ### 大型語言模型之技術分類
 ![](https://miro.medium.com/v2/resize:fit:1100/format:webp/1*vZK250i8PIWid6BiaZ1QCA.png)
 
----
 ### 計算記憶體的成長與Transformer大小的關係
 [AI and Memory Wall](https://medium.com/riselab/ai-and-memory-wall-2cb4265cb0b8)<br>
 ![](https://miro.medium.com/v2/resize:fit:4800/format:webp/0*U-7GJqBZ2tY1W5Iu)
 
----
 ### LLMops 針對生成式 AI 用例調整了 MLops 技術堆疊
 ![](https://www.insightpartners.com/wp-content/uploads/2023/10/llmops-market-map-1.png)
 
@@ -277,6 +263,14 @@ A GPT-4V annotated preference dataset for large vision language models.
 ![](https://tnoinkwms.github.io/ALTER-LLM/architecture_2.png)
 ![](https://tnoinkwms.github.io/ALTER-LLM/feedback.png)
 
+---
+## MM-LLMs
+**Paper:** [MM-LLMs: Recent Advances in MultiModal Large Language Models](https://arxiv.org/html/2401.13601v1)<br>
+![](https://arxiv.org/html/2401.13601v1/x1.png)
+
+### The general model architecture of MM-LLMs
+![](https://arxiv.org/html/2401.13601v1/x2.png)
+
 ---
 ## Advanced Topics