{"topic":{"id":9142,"title":"深度学习个人笔记分享","slug":"topic","userId":31,"categoryId":54,"createdAt":"2024-01-18 06:58:23.717815","bumpedAt":"2024-08-22 10:25:23.580504","views":2049,"postsCount":40,"highestPostNumber":43,"likeCount":29,"closed":false,"pinned":false,"pinnedGlobally":false,"pinnedAt":null,"pinnedUntil":null,"isBanner":false,"excerpt":"分享一些个人在学习过程中的笔记。参考资料： https://speech.ee.ntu.edu.tw/~hylee/ml/2022-spring.php https://speech.ee.ntu.edu.tw/~hylee/ml/2023-spring.php https://github.com/mli/paper-reading 《动手学深度学习》","deletedAt":null,"isAnonymous":false,"isPrivate":false,"isMembersOnly":false,"category":{"id":54,"name":"学术专区","slug":"academic","color":"9EB83B"},"author":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif"},"realAuthor":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif"},"tags":[]},"posts":[{"id":22087,"postNumber":1,"raw":"分享一些个人在学习过程中的笔记。\n\n参考资料：\n\n- https://speech.ee.ntu.edu.tw/~hylee/ml/2022-spring.php\n- https://speech.ee.ntu.edu.tw/~hylee/ml/2023-spring.php\n- https://github.com/mli/paper-reading\n- [《动手学深度学习》](https://zh.d2l.ai/)","cooked":"

分享一些个人在学习过程中的笔记。

参考资料：

\n","createdAt":"2024-01-18 06:58:23.793579","updatedAt":"2024-03-04 03:37:11.796839","replyToPostNumber":null,"replyCount":0,"likeCount":14,"wordCount":37,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":14,"users":[{"id":49,"username":"dokuro","name":null},{"id":172,"username":"HCCH","name":"HCCH"},{"id":307,"username":"Fast","name":null},{"id":346,"username":"hoist","name":null},{"id":876,"username":"秦川楚客","name":null},{"id":1888,"username":"carrortsky","name":"Luo"},{"id":1941,"username":"john","name":"John"},{"id":2276,"username":"2832128540","name":"Schrdinger‘s dog"},{"id":3332,"username":"rijin","name":"\");drop table;--"},{"id":3988,"username":"Edmund123","name":"Edmund123"},{"id":4263,"username":"Murphy","name":null},{"id":5077,"username":"Ayato","name":"桃泽"},{"id":5309,"username":"zhui","name":null},{"id":7444,"username":"周末","name":"😀"}],"hasReacted":false}],"wiki":false,"version":3,"publicVersion":3,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22090,"postNumber":4,"raw":"# 机器学习基础理论 & 为什么选择深度学习\n\n[basic-thoery-of-ml-why-deep.pdf|attachment](/uploads/pdf/d3/b5/d3b5be76311a31a22467895a2f8a9584aa7db23f8aa48216d4510d2238796d5a.pdf) (483.5 KB)","cooked":"

机器学习基础理论 & 为什么选择深度学习

basic-thoery-of-ml-why-deep.pdf|attachment (483.5 KB)

\n","createdAt":"2024-01-18 07:11:14.119236","updatedAt":"2024-01-18 07:15:46.405109","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":22,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22091,"postNumber":5,"raw":"# 机器学习框架及一些问题的解决\n\n[frame-fix.pdf|attachment](/uploads/pdf/63/ec/63eced41ca6ffc4f2e85b9b578549ee24d88a1fa996bb272f0121b524efe00ba.pdf) (1007.5 KB)","cooked":"

机器学习框架及一些问题的解决

frame-fix.pdf|attachment (1007.5 KB)

\n","createdAt":"2024-01-18 07:11:36.558378","updatedAt":"2024-01-18 07:16:17.115362","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":18,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22092,"postNumber":6,"raw":"# 卷积神经网络\n\n[CNN.pdf|attachment](/uploads/pdf/b2/e1/b2e1363442e6edc83b773ac8f5dfcc52b447d43b53d26ee7a6622aa8077ee050.pdf) (1.8 MB)","cooked":"

卷积神经网络

CNN.pdf|attachment (1.8 MB)

\n","createdAt":"2024-01-18 07:11:58.315944","updatedAt":"2024-01-18 07:15:24.203435","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":10,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22093,"postNumber":7,"raw":"# 自注意力机制与 Transformer\n\n[self-attention-transformer.pdf|attachment](/uploads/pdf/29/e0/29e02f5a4502e6e28dd1e436e5e10cd7ffeec187f027b30f19407fa7d0053d0c.pdf) (2.4 MB)","cooked":"

自注意力机制与 Transformer

self-attention-transformer.pdf|attachment (2.4 MB)

\n","createdAt":"2024-01-18 07:12:32.736761","updatedAt":"2024-01-18 07:14:44.831525","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":12,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22094,"postNumber":8,"raw":"# 对比学习综述\n\n[constrastive-learning.pdf|attachment](/uploads/pdf/f8/83/f883aa1f0ccfb8af3ac69bd9f136ced9ec5d3ebf768e95f6986cd8701791ddfd.pdf) (1.4 MB)","cooked":"

对比学习综述

constrastive-learning.pdf|attachment (1.4 MB)

\n","createdAt":"2024-01-18 07:14:09.277115","updatedAt":"2024-01-18 07:14:09.277115","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":10,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22095,"postNumber":9,"raw":"good","cooked":"

good

\n","createdAt":"2024-01-18 07:19:55.681912","updatedAt":"2024-01-18 07:19:55.681912","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":1,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1941,"username":"john","name":"John","avatarUrl":"/uploads/image/5a/04/5a0499fe826e0ab0e29d97bc3d98bbc1dfebf81309f4b4426ae0c7b62bd908e8.avif","admin":false,"moderator":false,"signatureRaw":"自黄药师黄仁勋来，世人皆爱猫。余独爱老鼠之，可爱之态，活泼之动，实为人所难以抗拒。喵~\n\n:mouse_hole: :mouse: :mouse: :computer_mouse: :mouse_trap: :sob_mouse: :sweat_smile_mouse: :sleeping_mouse: :rolling_on_the_floor_laughing_mouse: :revolving_hearts_mouse: :pleading_face_mouse: :nerd_face_mouse: :mouse_hole: :melting_face_mouse: :mask_mouse: :innocent_mouse: :hugging_face_mouse: :frog_mouse: :face_with_cowboy_hat_mouse: :clown_face_mouse: :cherry_blossom_mouse: :cat_mouse:","signatureCooked":"

自黄药师黄仁勋来，世人皆爱猫。余独爱老鼠之，可爱之态，活泼之动，实为人所难以抗拒。喵~

$\":mouse_hole:\"$ 🐁 🐁 🖱️ 🪤 $\":sob_mouse:\"$ $\":sweat_smile_mouse:\"$ $\":sleeping_mouse:\"$ $\":rolling_on_the_floor_laughing_mouse:\"$ $\":revolving_hearts_mouse:\"$ $\":pleading_face_mouse:\"$ $\":nerd_face_mouse:\"$ $\":mouse_hole:\"$ $\":melting_face_mouse:\"$ $\":mask_mouse:\"$ $\":innocent_mouse:\"$ $\":hugging_face_mouse:\"$ $\":frog_mouse:\"$ $\":face_with_cowboy_hat_mouse:\"$ $\":clown_face_mouse:\"$ $\":cherry_blossom_mouse:\"$ $\":cat_mouse:\"$

\n"}},{"id":22102,"postNumber":10,"raw":"好好好，狠狠支持了 :hooray: 不知道我大二暑假能不能用到 😰","cooked":"

好好好，狠狠支持了 🥳 不知道我大二暑假能不能用到 😰

\n","createdAt":"2024-01-18 08:29:37.099283","updatedAt":"2024-01-18 10:40:20.245164","replyToPostNumber":null,"replyCount":0,"likeCount":2,"wordCount":24,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":2,"users":[{"id":3594,"username":"zecrious","name":"勿1小win而不麻"},{"id":4260,"username":"Rick","name":"Rick"}],"hasReacted":false}],"wiki":false,"version":3,"publicVersion":3,"deletedAt":null,"isAnonymous":false,"user":{"id":30,"username":"一只玉米人","name":"玉米🌽","avatarUrl":"/uploads/blob/14/96/14961aeaa46ccbb75a61eec0c27b26e74fb5d1c00ccdcbbe898ca9ea37087dd6.svg","admin":false,"moderator":true,"signatureRaw":"*年月擦身过，暂且问，会更好吗？*","signatureCooked":"

年月擦身过，暂且问，会更好吗？

\n"}},{"id":22109,"postNumber":11,"raw":"好强 :flushed:","cooked":"

好强 😳

\n","createdAt":"2024-01-18 09:31:48.991945","updatedAt":"2024-01-18 09:31:48.991945","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":3,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":32,"username":"ScorpioLuc","name":"池鹭","avatarUrl":"/uploads/image/c9/80/c9802bb2950fa972f099d0a7731d8b241263989889c3c325000ad5df64c5d8ff.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":22434,"postNumber":12,"raw":"# 杂项\n\n会持续更新\n\n### 正则化\n\nhttps://zh.wikipedia.org/zh-hans/%E6%AD%A3%E5%88%99%E5%8C%96_(%E6%95%B0%E5%AD%A6)\n\n**`Weight Decay` - L2 正则项**\n\nwe multiply the sum of squares with another smaller number. This number is called weight decay or wd.\n\nOur loss function now looks as follows:\n\n`Loss = MSE(y_hat, y) + wd * sum(w^2)`\n\n减小模型复杂度（弹性），降低过拟合的概率\n\n### 残差（residual）和残差网络\n\nhttps://www.cnblogs.com/wuliytTaotao/p/9560205.html\n\n### CNN 输出大小公式\n\n$W$ 为输入大小，$F$ 为卷积核大小，$P$ 为填充大小（Padding），$S$ 为步长（Stride），$N$ 为输出大小，则有：\n\n$$\nN = \\frac {W - F + 2P} {S} + 1\n$$\n\n### 熵（Entropy）；KL 散度（KL Divergence）\n\n#### 熵\n\n若一个离散随机变量 $\\mathbf{X}$ 的可能取值为 $X=\\{x_1,x_2,\\cdots,x_n\\}$，而对应的概率为 $p_i = p(X = x_i)$，则随机变量 $\\mathbf{X}$ 的熵定义为：\n\n$$\n\nH(X) = - \\sum_{i=1}^{n} p(x_i) \\log p(x_{i})\n\n$$\n\n#### 交叉熵\n\n针对上述离散变量的概率分布 $p(x)、q(x)$ 而言，其交叉熵定义为：\n\n$$\nH(p,q) = - \\sum_{x} p(x) \\log q(x)\n$$\n\n> 在信息论中，交叉熵可认为是对预测分布 $q(x)$ 用真实分布 $p(x)$ 来进行编码时所需要的信息量大小。\n\n#### KL 散度（KL Divergence）\n\nKL 散度可以用来衡量两个分布之间的差异：\n\n$$\n\\begin{aligned}\n\nD_{KL}(p||q) = & H(p,q)-H(p) \\\\\n\n=& - \\sum_{x} p(x) \\log q(x) - \\sum_{x}-p(x)\\log p(x)\\\\\n\n=& -\\sum_{x}p(x) \\log \\frac{q(x)}{p(x)}\n\n\\end{aligned}\n$$\n\n> 交叉熵损失函数实际上就是 KL 散度，只不过因为分类问题的特殊性，其式与交叉熵相同：\n\n在分类问题中，我们通过 `softmax` 函数得到一个分布，我们要通过 **KL 散度** 衡量这个分布和目标分布（一个 one-hot 向量）的差异性：\n\n$$\n\nD_{KL}(p||q) = H(p,q)-H(p)\n\n$$\n\n我们易知 $H(p) = 0$；且对于真实分布（一个 one-hot 向量）只有概率为 1 的一项是非 0 的，所以有以下化简：\n\n$$\n\\begin{aligned}\n\nD_{KL}(p||q) = & H(p,q)\\\\\n\n=& - \\sum_{x} p(x) \\log q(x)\\\\\n\n=& -\\log \\text{softmax} \\ q(x_i)\\\\\n\n=& -\\log \\frac{\\exp (x_i)}{\\sum_j \\exp (x_j)}\n\n\\end{aligned}\n$$\n\n**KL 散度的数学性质**\n\n- 正定性\n\n$$\nD_{KL}(p||q) \\ge 0\n$$\n\n- 不对称性\n\nKL 散度并不是一个真正的度量或者距离，因为它不具有对称性：\n\n$$\nD(p || q) \\ne D(q || p)\n$$\n\n#### JS 散度（JS Divergence）\n\nJS 散度度量了两个概率分布的相似度，基于 KL 散度的变体，解决了 KL 散度非对称的问题。一般地，JS 散度是对称的，其取值是 0 到 1 之间。\n\n$$\nJSD(P||Q)=\\frac{1}{2}D_{KL}(P||\\frac{P+Q}{2})+\\frac{1}{2}D_{KL}(Q||\\frac{P+Q}{2})\n$$\n\n> 对于 JS 散度，当两个分布完全不重合时，JS 散度始终为 1（$\\log 2$）","cooked":"

杂项

会持续更新

正则化

正则化 (数学) - 维基百科，自由的百科全书

Weight Decay - L2 正则项

we multiply the sum of squares with another smaller number. This number is called weight decay or wd.

Our loss function now looks as follows:

Loss = MSE(y_hat, y) + wd * sum(w^2)

减小模型复杂度（弹性），降低过拟合的概率

残差（residual）和残差网络

\n\n

CNN 输出大小公式

$W$ 为输入大小， $F$ 为卷积核大小， $P$ 为填充大小（Padding）， $S$ 为步长（Stride）， $N$ 为输出大小，则有：

\nN = \\frac {W - F + 2P} {S} + 1\n

熵（Entropy）；KL 散度（KL Divergence）

熵

若一个离散随机变量 $\\mathbf{X}$ 的可能取值为 $X=\\{x_1,x_2,\\cdots,x_n\\}$ ，而对应的概率为 $p_i = p(X = x_i)$ ，则随机变量 $\\mathbf{X}$ 的熵定义为：

\nH(X) = - \\sum_{i=1}^{n} p(x_i) \\log p(x_{i})\n

交叉熵

针对上述离散变量的概率分布 $p(x)、q(x)$ 而言，其交叉熵定义为：

\nH(p,q) = - \\sum_{x} p(x) \\log q(x)\n

\n
在信息论中，交叉熵可认为是对预测分布 $q(x)$ 用真实分布 $p(x)$ 来进行编码时所需要的信息量大小。
\n

KL 散度（KL Divergence）

KL 散度可以用来衡量两个分布之间的差异：

\n\\begin{aligned}\nD_{KL}(p||q) = & H(p,q)-H(p) \\\\\n=& - \\sum_{x} p(x) \\log q(x) - \\sum_{x}-p(x)\\log p(x)\\\\\n=& -\\sum_{x}p(x) \\log \\frac{q(x)}{p(x)}\n\\end{aligned}\n

\n
交叉熵损失函数实际上就是 KL 散度，只不过因为分类问题的特殊性，其式与交叉熵相同：
\n

在分类问题中，我们通过 softmax 函数得到一个分布，我们要通过 KL 散度 衡量这个分布和目标分布（一个 one-hot 向量）的差异性：

\nD_{KL}(p||q) = H(p,q)-H(p)\n

我们易知 $H(p) = 0$ ；且对于真实分布（一个 one-hot 向量）只有概率为 1 的一项是非 0 的，所以有以下化简：

\n\\begin{aligned}\nD_{KL}(p||q) = & H(p,q)\\\\\n=& - \\sum_{x} p(x) \\log q(x)\\\\\n=& -\\log \\text{softmax} \\ q(x_i)\\\\\n=& -\\log \\frac{\\exp (x_i)}{\\sum_j \\exp (x_j)}\n\\end{aligned}\n

KL 散度的数学性质

正定性

\nD_{KL}(p||q) \\ge 0\n

不对称性

KL 散度并不是一个真正的度量或者距离，因为它不具有对称性：

\nD(p || q) \\ne D(q || p)\n

JS 散度（JS Divergence）

JS 散度度量了两个概率分布的相似度，基于 KL 散度的变体，解决了 KL 散度非对称的问题。一般地，JS 散度是对称的，其取值是 0 到 1 之间。

\nJSD(P||Q)=\\frac{1}{2}D_{KL}(P||\\frac{P+Q}{2})+\\frac{1}{2}D_{KL}(Q||\\frac{P+Q}{2})\n

\n
对于 JS 散度，当两个分布完全不重合时，JS 散度始终为 1（ $\\log 2$ ）
\n

\n","createdAt":"2024-01-22 06:09:52.136693","updatedAt":"2024-01-22 06:09:52.136693","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":644,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22453,"postNumber":13,"raw":"这课看着很不错诶。我也来学一学吧。\n我似乎没寻找到他作业如何发布的，莫非是 private 吗？","cooked":"

这课看着很不错诶。我也来学一学吧。
\n我似乎没寻找到他作业如何发布的，莫非是 private 吗？

\n","createdAt":"2024-01-22 13:06:08.988707","updatedAt":"2024-01-22 13:06:31.376452","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":39,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":346,"username":"hoist","name":null,"avatarUrl":"/uploads/image/0d/cd/0dcdf69d213b6798002779ad4b729567cd4d889ee4a56c07a8c4454e8b563219.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":22461,"postNumber":14,"raw":"李宏毅的课吗，作业就在课程主页下面。个人认为他的课程坡度还是挺大的，光听不练/不记笔记感觉还是差点。每一年作业基本都是一样的，2022 的做的不好可以试试 2021，2023 的。","cooked":"

李宏毅的课吗，作业就在课程主页下面。个人认为他的课程坡度还是挺大的，光听不练/不记笔记感觉还是差点。每一年作业基本都是一样的，2022 的做的不好可以试试 2021，2023 的。

\n","createdAt":"2024-01-22 15:41:18.130584","updatedAt":"2024-01-22 15:41:18.130584","replyToPostNumber":13,"replyCount":1,"likeCount":1,"wordCount":75,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":3594,"username":"zecrious","name":"勿1小win而不麻"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22462,"postNumber":15,"raw":"我基本是他的课和他的作业和李沐的带读论文一起进行，中途还有无数次专门去找资料学习某个小知识。","cooked":"

我基本是他的课和他的作业和李沐的带读论文一起进行，中途还有无数次专门去找资料学习某个小知识。

\n","createdAt":"2024-01-22 15:43:02.914965","updatedAt":"2024-01-22 15:43:02.914965","replyToPostNumber":14,"replyCount":0,"likeCount":0,"wordCount":46,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":22531,"postNumber":16,"raw":"真强","cooked":"

真强

\n","createdAt":"2024-01-23 13:48:59.743638","updatedAt":"2024-01-23 13:48:59.743638","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":2,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":53,"username":"Rachel","name":null,"avatarUrl":"/uploads/image/48/ae/48ae0d54cf2d42d31c7886b6d070d7ad42c6c0519f22149410202cb3d41cd731.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":25038,"postNumber":17,"raw":"# GAN\n\n[GAN.pdf|attachment](/uploads/pdf/a0/09/a009a2ca080834e283f0006d34484282b0a32027e43fa4e1a3873bc23cc553cb.pdf) (3.7 MB)","cooked":"

GAN

GAN.pdf|attachment (3.7 MB)

\n","createdAt":"2024-02-29 09:29:23.788235","updatedAt":"2024-02-29 09:30:07.493152","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":5,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":25039,"postNumber":18,"raw":"Pytorch 要学多少学到哪里才能入门这个课呀","cooked":"

Pytorch 要学多少学到哪里才能入门这个课呀

\n","createdAt":"2024-02-29 09:37:02.474087","updatedAt":"2024-02-29 09:37:02.474087","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":17,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":3074,"username":"Trifolium","name":"白车草","avatarUrl":"/uploads/image/e9/21/e92121eac2b612e7ee2ed14db996c0fe51665ec0669ec0acc41dd23c17ae11cc.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":25046,"postNumber":19,"raw":"会基础的 Python 语法，遇到啥不会的直接搜索就能入门。\n\n另外不写作业的话一点代码都不写也没学","cooked":"

会基础的 Python 语法，遇到啥不会的直接搜索就能入门。

另外不写作业的话一点代码都不写也没学

\n","createdAt":"2024-02-29 10:01:58.771061","updatedAt":"2024-02-29 10:02:29.228892","replyToPostNumber":18,"replyCount":0,"likeCount":1,"wordCount":41,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":3074,"username":"Trifolium","name":"白车草"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":25086,"postNumber":20,"raw":"我看这课 ML 2023 全部改成了生成式 AI、是觉得会全面迭代技术吗？你对此什么看法。\n另外我对这课程无比佩服，竟然能大幅度调整大纲","cooked":"

我看这课 ML 2023 全部改成了生成式 AI、是觉得会全面迭代技术吗？你对此什么看法。
\n另外我对这课程无比佩服，竟然能大幅度调整大纲

\n","createdAt":"2024-02-29 13:03:10.123187","updatedAt":"2024-02-29 13:03:10.123187","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":57,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":346,"username":"hoist","name":null,"avatarUrl":"/uploads/image/0d/cd/0dcdf69d213b6798002779ad4b729567cd4d889ee4a56c07a8c4454e8b563219.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":25103,"postNumber":21,"raw":"李宏毅老师的课跟热点跟的很勤。一直都是每年开课根据过去一年的 AI 发展较大幅度的更改大纲，提供比较新的技术。比如 RNN 自从 Transformer 大范围使用后就变成了选学内容，学生想学去看之前的录像就好了。\n\n2023 的版本虽然作业还是沿着 Regression -> CNN -> Attention 来的，但是上课内容基本全是生成式 AI，老师基本默认了不会走“回头路”一般。你们学生不会做作业那就看我以前上课的录像好了。\n\n再看今年 2024 老师开得课，直接没有 ML 课了，改成叫 GENERATIVE AI 了。他可能觉得讲过的不必再讲一遍吧。","cooked":"

李宏毅老师的课跟热点跟的很勤。一直都是每年开课根据过去一年的 AI 发展较大幅度的更改大纲，提供比较新的技术。比如 RNN 自从 Transformer 大范围使用后就变成了选学内容，学生想学去看之前的录像就好了。

2023 的版本虽然作业还是沿着 Regression -> CNN -> Attention 来的，但是上课内容基本全是生成式 AI，老师基本默认了不会走“回头路”一般。你们学生不会做作业那就看我以前上课的录像好了。

再看今年 2024 老师开得课，直接没有 ML 课了，改成叫 GENERATIVE AI 了。他可能觉得讲过的不必再讲一遍吧。

\n","createdAt":"2024-02-29 13:45:09.242772","updatedAt":"2024-02-29 13:45:09.242772","replyToPostNumber":20,"replyCount":0,"likeCount":1,"wordCount":205,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":346,"username":"hoist","name":null}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":25310,"postNumber":23,"raw":"# Bert & GPT\n\n[BERT-GPT.pdf|attachment](/uploads/pdf/cd/3c/cd3ce269eadc25332a8fd4104672d2872949f9e8b8e6320cbeb051561817faca.pdf) (1.4 MB)","cooked":"

Bert & GPT

BERT-GPT.pdf|attachment (1.4 MB)

\n","createdAt":"2024-03-02 06:20:07.900956","updatedAt":"2024-03-02 06:20:07.900956","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":7,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":25679,"postNumber":24,"raw":"# MAE\n\n[MAE.pdf|attachment](/uploads/pdf/ab/2c/ab2c353f7f488a19e2944692cfd20ee33ab7ea51e747ede0b36d920884ece2c1.pdf) (398.1 KB)","cooked":"

MAE

MAE.pdf|attachment (398.1 KB)

\n","createdAt":"2024-03-04 03:32:33.391849","updatedAt":"2024-03-04 03:32:33.391849","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":5,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":25867,"postNumber":25,"raw":"# Image Generation\n\n先去复习下别的后面会改这个，\n\n[ImgGeneration_compressed.pdf|attachment](/uploads/pdf/26/ca/26ca6953e20d7a880854d5d0425ea4960f0f6ccae099a8a31b873d327b415144.pdf) (475.8 KB)","cooked":"

Image Generation

先去复习下别的后面会改这个，

ImgGeneration_compressed.pdf|attachment (475.8 KB)

\n","createdAt":"2024-03-05 06:50:48.249135","updatedAt":"2024-03-05 06:50:48.249135","replyToPostNumber":null,"replyCount":0,"likeCount":1,"wordCount":20,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":6205,"username":"uika_winwing","name":null}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":26098,"postNumber":26,"raw":"# Clip\n\n[CLIP.pdf|attachment](/uploads/pdf/5d/47/5d47b218e2b9af82e5c72299ab2ee3be78671bada490b2db4cbb5b544f69186a.pdf) (640.3 KB)\n\n文献应该怎么读？读多少算读完一篇文章了。像这篇 clip 我把正文逐字逐句读过去了，然而没有看他的代码。之前的 MAE，我看他基本就是把 Bert 套用过来，就很简略的读了下（只读了方法没有读实验）。","cooked":"

Clip

CLIP.pdf|attachment (640.3 KB)

文献应该怎么读？读多少算读完一篇文章了。像这篇 clip 我把正文逐字逐句读过去了，然而没有看他的代码。之前的 MAE，我看他基本就是把 Bert 套用过来，就很简略的读了下（只读了方法没有读实验）。

\n","createdAt":"2024-03-07 02:33:49.630534","updatedAt":"2024-03-07 02:33:49.630534","replyToPostNumber":null,"replyCount":0,"likeCount":1,"wordCount":90,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":1047,"username":"anonymous_coward_old","name":"Anonymous Coward Old"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":26335,"postNumber":27,"raw":"# SAM (Segment Anything)\n\n[segment-anything.pdf|attachment](/uploads/pdf/50/f1/50f11607536415408bd64cefc9312e3382f7b67435940aa3f280a29add834b38.pdf) (1.9 MB)","cooked":"

SAM (Segment Anything)

segment-anything.pdf|attachment (1.9 MB)

\n","createdAt":"2024-03-09 01:12:12.066557","updatedAt":"2024-04-12 07:31:30.421367","replyToPostNumber":null,"replyCount":0,"likeCount":1,"wordCount":7,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":6205,"username":"uika_winwing","name":null}],"hasReacted":false}],"wiki":false,"version":2,"publicVersion":2,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":29574,"postNumber":28,"raw":"# Swin Transformer\n\n[Swin-Transformer.pdf|attachment](/uploads/pdf/ac/ad/acad0d86229877d670ca2a167a57cdd1037ddb04711a41476cdaf8d0298e4f37.pdf) (1.6 MB)","cooked":"

Swin Transformer

Swin-Transformer.pdf|attachment (1.6 MB)

\n","createdAt":"2024-04-12 07:32:20.093412","updatedAt":"2024-04-12 07:32:20.093412","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":6,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":29575,"postNumber":29,"raw":"这个怎么样啊","cooked":"

这个怎么样啊

\n","createdAt":"2024-04-12 07:51:54.947052","updatedAt":"2024-04-12 07:51:54.947052","replyToPostNumber":28,"replyCount":0,"likeCount":0,"wordCount":6,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":178,"username":"Hypocrisy","name":"rotartsinimdA","avatarUrl":"/uploads/image/ce/f3/cef3773e378e161524cc7523c8a63dff0698d22802b0c1ab669894d395ee36a3.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":29714,"postNumber":30,"raw":"![image|690x252](/uploads/image/74/08/74089f5ea193c3bbe0b1ce973cb34d5ef6d3bea0deae8d577d87f84ca87c6db2.avif)\n好不容易自己对着源码画了个图 hhh 在网上好像不太找得到这样详细的 sam image encoder 图就分享下（","cooked":"

$\"image\"$
\n好不容易自己对着源码画了个图 hhh 在网上好像不太找得到这样详细的 sam image encoder 图就分享下（

\n","createdAt":"2024-04-13 17:51:39.487364","updatedAt":"2024-04-13 17:51:39.487364","replyToPostNumber":null,"replyCount":1,"likeCount":1,"wordCount":40,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"magic_wand_grin","count":1,"users":[{"id":30,"username":"一只玉米人","name":"玉米🌽"}],"hasReacted":false},{"reaction":"❤️","count":1,"users":[{"id":30,"username":"一只玉米人","name":"玉米🌽"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":29881,"postNumber":31,"raw":"没有注释的代码去死啊啊啊啊啊啊啊啊啊啊啊啊\n\n# Mobile SAM\n\n[MobileSAM.pdf|attachment](/uploads/pdf/ca/c1/cac10d49214dd27d49f01ecb1f5a8487b1f2a155285a146cdf619faa2d1f81eb.pdf) (1.4 MB)","cooked":"

没有注释的代码去死啊啊啊啊啊啊啊啊啊啊啊啊

Mobile SAM

MobileSAM.pdf|attachment (1.4 MB)

\n","createdAt":"2024-04-15 18:03:02.455698","updatedAt":"2024-04-15 18:03:02.455698","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":27,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":30478,"postNumber":32,"raw":"学学 prompt engineering。\n\n# Large Language Models Are Human-Level Prompt Engineers\n\n[APE(automatic-prompt-engineer).pdf|attachment](/uploads/pdf/ca/41/ca41381897885b8b365f0458475c0659738ac44a5af1332fbaae6ebee6a57d0a.pdf) (3.2 MB)","cooked":"

学学 prompt engineering。

Large Language Models Are Human-Level Prompt Engineers

APE(automatic-prompt-engineer).pdf|attachment (3.2 MB)

\n","createdAt":"2024-04-22 12:08:05.235846","updatedAt":"2024-04-22 12:08:05.235846","replyToPostNumber":31,"replyCount":1,"likeCount":0,"wordCount":15,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":30611,"postNumber":33,"raw":"说到 LLM，微软这两天发布了新一代的轻量级模型 Phi-3 3.8B/7B/14B，并且特别强调通过筛选高质量数据提升小模型的逻辑推理能力。他们在筛选数据时，会筛去相当多能提供知识但对推理帮助不大的数据，相当于是主动舍弃部分知识储备来换取更强的逻辑，并且解释说小模型配合搜索引擎也可以工作得很好。\n\n（以上信息大体来自近期看过的公众号，不保证完全准确）\n\n門友喜欢大模型多一点还是小模型多一点？当然这个观点也不是绝对的，比如 Phi-3 的训练数据中有不少是更大的模型生成的（并且微软好像认为它们比部分来自真人的数据更好）。","cooked":"

说到 LLM，微软这两天发布了新一代的轻量级模型 Phi-3 3.8B/7B/14B，并且特别强调通过筛选高质量数据提升小模型的逻辑推理能力。他们在筛选数据时，会筛去相当多能提供知识但对推理帮助不大的数据，相当于是主动舍弃部分知识储备来换取更强的逻辑，并且解释说小模型配合搜索引擎也可以工作得很好。

（以上信息大体来自近期看过的公众号，不保证完全准确）

門友喜欢大模型多一点还是小模型多一点？当然这个观点也不是绝对的，比如 Phi-3 的训练数据中有不少是更大的模型生成的（并且微软好像认为它们比部分来自真人的数据更好）。

\n","createdAt":"2024-04-23 12:57:29.207385","updatedAt":"2024-04-23 12:57:29.207385","replyToPostNumber":32,"replyCount":2,"likeCount":1,"wordCount":231,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":1941,"username":"john","name":"John"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1381,"username":"greyishsong","name":"greyishsong","avatarUrl":"/uploads/image/da/bc/dabc731b0311f59850625bbeb55ed969fcfac0430c5ef0f68441e5466b7aa496.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":30615,"postNumber":34,"raw":"我只能说，我最近的工作本来在 phi-2 上做魔改，现在瞌睡来了送枕头，明天和 mentor 开会，狠狠改 phi-3","cooked":"

我只能说，我最近的工作本来在 phi-2 上做魔改，现在瞌睡来了送枕头，明天和 mentor 开会，狠狠改 phi-3

\n","createdAt":"2024-04-23 13:16:42.049951","updatedAt":"2024-04-23 13:16:42.049951","replyToPostNumber":33,"replyCount":0,"likeCount":1,"wordCount":41,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"❤️","count":1,"users":[{"id":1381,"username":"greyishsong","name":"greyishsong"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":178,"username":"Hypocrisy","name":"rotartsinimdA","avatarUrl":"/uploads/image/ce/f3/cef3773e378e161524cc7523c8a63dff0698d22802b0c1ab669894d395ee36a3.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":36951,"postNumber":35,"raw":"[Ch0102 笔记.pdf|attachment](/uploads/pdf/52/37/52375b7400828dd3982f686c7af978315d5cf66ba77642f22d317609e064f236.pdf) (3.1 MB)\n借楼，小学期办了个深度学习讨论班，指导老师推荐用书是 \n[Deep Learning - Foundations and Concepts (bishopbook.com)](https://www.bishopbook.com/)\n每攒两章就在里发笔记，算是自我监督了\n（要是有同学发现哪里有错，可以留言提醒我修改）","cooked":"

Ch0102 笔记.pdf|attachment (3.1 MB)
\n借楼，小学期办了个深度学习讨论班，指导老师推荐用书是
\nDeep Learning - Foundations and Concepts (bishopbook.com)
\n每攒两章就在里发笔记，算是自我监督了
\n（要是有同学发现哪里有错，可以留言提醒我修改）

\n","createdAt":"2024-07-09 03:51:07.264044","updatedAt":"2024-07-09 03:51:48.54576","replyToPostNumber":null,"replyCount":1,"likeCount":2,"wordCount":80,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"💯️","count":1,"users":[{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海"}],"hasReacted":false},{"reaction":"👍️","count":1,"users":[{"id":3880,"username":"Betrem","name":"Bbox"}],"hasReacted":false},{"reaction":"❤️","count":2,"users":[{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海"},{"id":3880,"username":"Betrem","name":"Bbox"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":30,"username":"一只玉米人","name":"玉米🌽","avatarUrl":"/uploads/blob/14/96/14961aeaa46ccbb75a61eec0c27b26e74fb5d1c00ccdcbbe898ca9ea37087dd6.svg","admin":false,"moderator":true,"signatureRaw":"*年月擦身过，暂且问，会更好吗？*","signatureCooked":"

年月擦身过，暂且问，会更好吗？

\n"}},{"id":36963,"postNumber":36,"raw":"这种图是用什么软件画的？Draw.io 吗？","cooked":"

这种图是用什么软件画的？Draw.io 吗？

\n","createdAt":"2024-07-09 06:07:06.620738","updatedAt":"2024-07-09 06:07:06.620738","replyToPostNumber":30,"replyCount":2,"likeCount":0,"wordCount":14,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海","avatarUrl":"/uploads/image/63/d2/63d25f4f2f6693f9ab450f32bd8d04e2d29f96a980b51555a585423f113c4a58.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":36964,"postNumber":37,"raw":"2023 年的新书。","cooked":"

2023 年的新书。

\n","createdAt":"2024-07-09 06:12:32.66356","updatedAt":"2024-07-09 06:12:32.66356","replyToPostNumber":35,"replyCount":0,"likeCount":1,"wordCount":6,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"🐈️","count":1,"users":[{"id":30,"username":"一只玉米人","name":"玉米🌽"}],"hasReacted":false},{"reaction":"❤️","count":1,"users":[{"id":30,"username":"一只玉米人","name":"玉米🌽"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海","avatarUrl":"/uploads/image/63/d2/63d25f4f2f6693f9ab450f32bd8d04e2d29f96a980b51555a585423f113c4a58.avif","admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":36965,"postNumber":38,"raw":"感觉很像啊，我也经常用 draw.io 画图，这个看起来和它的默认配色方案一模一样","cooked":"

感觉很像啊，我也经常用 draw.io 画图，这个看起来和它的默认配色方案一模一样

\n","createdAt":"2024-07-09 06:19:59.181245","updatedAt":"2024-07-09 06:19:59.181245","replyToPostNumber":36,"replyCount":0,"likeCount":0,"wordCount":33,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":1381,"username":"greyishsong","name":"greyishsong","avatarUrl":"/uploads/image/da/bc/dabc731b0311f59850625bbeb55ed969fcfac0430c5ef0f68441e5466b7aa496.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":36966,"postNumber":39,"raw":"是的","cooked":"

是的

\n","createdAt":"2024-07-09 06:23:17.685364","updatedAt":"2024-07-09 06:23:17.685364","replyToPostNumber":36,"replyCount":0,"likeCount":0,"wordCount":2,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":37664,"postNumber":40,"raw":"请问笔记时用什么整理的呢","cooked":"

请问笔记时用什么整理的呢

\n","createdAt":"2024-07-22 07:47:26.568979","updatedAt":"2024-07-22 07:47:26.568979","replyToPostNumber":null,"replyCount":1,"likeCount":0,"wordCount":12,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":3949,"username":"kyl","name":"kyl","avatarUrl":null,"admin":false,"moderator":false,"signatureRaw":null,"signatureCooked":null}},{"id":37665,"postNumber":41,"raw":"markdown\n或者 notion","cooked":"

markdown
\n或者 notion

\n","createdAt":"2024-07-22 08:54:21.807852","updatedAt":"2024-07-22 08:54:21.807852","replyToPostNumber":40,"replyCount":0,"likeCount":1,"wordCount":4,"liked":false,"bookmarked":false,"polls":[],"reactions":[{"reaction":"😋️","count":1,"users":[{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海"}],"hasReacted":false},{"reaction":"❤️","count":1,"users":[{"id":1288,"username":"LittleWangInShanghai","name":"小王在上海"}],"hasReacted":false}],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":38913,"postNumber":42,"raw":"# MyVLM\n\n[MyVLM.pdf|attachment](/uploads/pdf/7f/5d/7f5dc6b3929c466643406a4ceb41972c49acdfd1ef8ee812ba3e24461980aac4.pdf) (1.8 MB)","cooked":"

MyVLM

MyVLM.pdf|attachment (1.8 MB)

\n","createdAt":"2024-08-22 10:19:44.789301","updatedAt":"2024-08-22 10:19:44.789301","replyToPostNumber":null,"replyCount":0,"likeCount":0,"wordCount":5,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":31,"username":"TsuinoSora","name":null,"avatarUrl":"/uploads/image/77/06/7706643ba6d3ee1ec9d0070db0ad8a22bed8651fa8eb829cf44df4d20fa24b3b.avif","admin":false,"moderator":true,"signatureRaw":null,"signatureCooked":null}},{"id":38914,"postNumber":43,"raw":"[quote=\"greyishsong, post:33, topic:9142, username:greyishsong\"]\n比如 Phi-3 的训练数据中有不少是更大的模型生成的（并且微软好像认为它们比部分来自真人的数据更好）\n[/quote]\n有点大模型蒸馏的味道","cooked":"

\n\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\tgreyishsong:\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t

\n
比如 Phi-3 的训练数据中有不少是更大的模型生成的（并且微软好像认为它们比部分来自真人的数据更好）
\n

\n\t\t\t\t\t\t

有点大模型蒸馏的味道

\n","createdAt":"2024-08-22 10:25:23.580504","updatedAt":"2024-08-22 10:25:23.580504","replyToPostNumber":33,"replyCount":0,"likeCount":0,"wordCount":60,"liked":false,"bookmarked":false,"polls":[],"reactions":[],"wiki":false,"version":1,"publicVersion":1,"deletedAt":null,"isAnonymous":false,"user":{"id":4668,"username":"IO","name":null,"avatarUrl":null,"admin":true,"moderator":false,"signatureRaw":"","signatureCooked":null}}],"hasMore":false,"lastReadPostNumber":42,"hasUrlPostNumber":true}