<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8"> <meta http-equiv="X-UA-Compatible" content="IE=Edge"> <link rel="stylesheet" href="/llm-learning-note/assets/css/just-the-docs-default.css"> <link rel="stylesheet" href="/llm-learning-note/assets/css/just-the-docs-head-nav.css" id="jtd-head-nav-stylesheet"> <style id="jtd-nav-activation"> .site-nav ul li a { background-image: none; } </style> <script src="/llm-learning-note/assets/js/vendor/lunr.min.js"></script> <script src="/llm-learning-note/assets/js/just-the-docs.js"></script> <meta name="viewport" content="width=device-width, initial-scale=1"> <!-- Begin Jekyll SEO tag v2.8.0 --> <title>LLM 学习笔记 | Personal reference book</title> <meta name="generator" content="Jekyll v3.10.0" /> <meta property="og:title" content="LLM 学习笔记" /> <meta property="og:locale" content="en_US" /> <meta name="description" content="Personal reference book" /> <meta property="og:description" content="Personal reference book" /> <link rel="canonical" href="https://sam890306.github.io/llm-learning-note/assets/css/just-the-docs-head-nav.css" /> <meta property="og:url" content="https://sam890306.github.io/llm-learning-note/assets/css/just-the-docs-head-nav.css" /> <meta property="og:site_name" content="LLM 学习笔记" /> <meta property="og:type" content="website" /> <meta name="twitter:card" content="summary" /> <meta property="twitter:title" content="LLM 学习笔记" /> <script type="application/ld+json"> {"@context":"https://schema.org","@type":"WebPage","description":"Personal reference book","headline":"LLM 学习笔记","url":"https://sam890306.github.io/llm-learning-note/assets/css/just-the-docs-head-nav.css"}</script> <!-- End Jekyll SEO tag --> <script> MathJax = { tex: { inlineMath: [['$', '$'], ['\\(', '\\)']], displayMath: [['$$','$$'], ['\\[','\\]']] }, options: { skipHtmlTags: ['script','noscript','style','textarea','pre','code'] } }; </script> <script id="MathJax-script" async src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js"></script> </head> <body> <a class="skip-to-main" href="#main-content">Skip to main content</a> <svg xmlns="http://www.w3.org/2000/svg" class="d-none"> <symbol id="svg-link" viewBox="0 0 24 24"> <title>Link</title> <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-link"> <path d="M10 13a5 5 0 0 0 7.54.54l3-3a5 5 0 0 0-7.07-7.07l-1.72 1.71"></path><path d="M14 11a5 5 0 0 0-7.54-.54l-3 3a5 5 0 0 0 7.07 7.07l1.71-1.71"></path> </svg> </symbol> <symbol id="svg-menu" viewBox="0 0 24 24"> <title>Menu</title> <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-menu"> <line x1="3" y1="12" x2="21" y2="12"></line><line x1="3" y1="6" x2="21" y2="6"></line><line x1="3" y1="18" x2="21" y2="18"></line> </svg> </symbol> <symbol id="svg-arrow-right" viewBox="0 0 24 24"> <title>Expand</title> <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-chevron-right"> <polyline points="9 18 15 12 9 6"></polyline> </svg> </symbol> <!-- Feather. MIT License: https://github.com/feathericons/feather/blob/master/LICENSE --> <symbol id="svg-external-link" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-external-link"> <title id="svg-external-link-title">(external link)</title> <path d="M18 13v6a2 2 0 0 1-2 2H5a2 2 0 0 1-2-2V8a2 2 0 0 1 2-2h6"></path><polyline points="15 3 21 3 21 9"></polyline><line x1="10" y1="14" x2="21" y2="3"></line> </symbol> <symbol id="svg-doc" viewBox="0 0 24 24"> <title>Document</title> <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-file"> <path d="M13 2H6a2 2 0 0 0-2 2v16a2 2 0 0 0 2 2h12a2 2 0 0 0 2-2V9z"></path><polyline points="13 2 13 9 20 9"></polyline> </svg> </symbol> <symbol id="svg-search" viewBox="0 0 24 24"> <title>Search</title> <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="feather feather-search"> <circle cx="11" cy="11" r="8"></circle><line x1="21" y1="21" x2="16.65" y2="16.65"></line> </svg> </symbol> <!-- Bootstrap Icons. MIT License: https://github.com/twbs/icons/blob/main/LICENSE.md --> <symbol id="svg-copy" viewBox="0 0 16 16"> <title>Copy</title> <svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" fill="currentColor" class="bi bi-clipboard" viewBox="0 0 16 16"> <path d="M4 1.5H3a2 2 0 0 0-2 2V14a2 2 0 0 0 2 2h10a2 2 0 0 0 2-2V3.5a2 2 0 0 0-2-2h-1v1h1a1 1 0 0 1 1 1V14a1 1 0 0 1-1 1H3a1 1 0 0 1-1-1V3.5a1 1 0 0 1 1-1h1v-1z"/> <path d="M9.5 1a.5.5 0 0 1 .5.5v1a.5.5 0 0 1-.5.5h-3a.5.5 0 0 1-.5-.5v-1a.5.5 0 0 1 .5-.5h3zm-3-1A1.5 1.5 0 0 0 5 1.5v1A1.5 1.5 0 0 0 6.5 4h3A1.5 1.5 0 0 0 11 2.5v-1A1.5 1.5 0 0 0 9.5 0h-3z"/> </svg> </symbol> <symbol id="svg-copied" viewBox="0 0 16 16"> <title>Copied</title> <svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" fill="currentColor" class="bi bi-clipboard-check-fill" viewBox="0 0 16 16"> <path d="M6.5 0A1.5 1.5 0 0 0 5 1.5v1A1.5 1.5 0 0 0 6.5 4h3A1.5 1.5 0 0 0 11 2.5v-1A1.5 1.5 0 0 0 9.5 0h-3Zm3 1a.5.5 0 0 1 .5.5v1a.5.5 0 0 1-.5.5h-3a.5.5 0 0 1-.5-.5v-1a.5.5 0 0 1 .5-.5h3Z"/> <path d="M4 1.5H3a2 2 0 0 0-2 2V14a2 2 0 0 0 2 2h10a2 2 0 0 0 2-2V3.5a2 2 0 0 0-2-2h-1v1A2.5 2.5 0 0 1 9.5 5h-3A2.5 2.5 0 0 1 4 2.5v-1Zm6.854 7.354-3 3a.5.5 0 0 1-.708 0l-1.5-1.5a.5.5 0 0 1 .708-.708L7.5 10.793l2.646-2.647a.5.5 0 0 1 .708.708Z"/> </svg> </symbol> </svg> <div class="side-bar"> <div class="site-header" role="banner"> <a href="/llm-learning-note/" class="site-title lh-tight"> LLM 学习笔记 </a> <button id="menu-button" class="site-button btn-reset" aria-label="Toggle menu" aria-pressed="false"> <svg viewBox="0 0 24 24" class="icon" aria-hidden="true"><use xlink:href="#svg-menu"></use></svg> </button> </div> <nav aria-label="Main" id="site-nav" class="site-nav"> <ul class="nav-list"><li class="nav-list-item"><a href="/llm-learning-note/guide/math-basics.html" class="nav-list-link">公式用法</a></li><li class="nav-list-item"><a href="/llm-learning-note/" class="nav-list-link">Welcome</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch001-Write-Ahead-Log.html" class="nav-list-link">Write-Ahead Log（WAL）学习笔记</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch002-Elastic-Search.html" class="nav-list-link">Elasticsearch 的 Write-Ahead Log（Translog）学习笔记</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch003-Lucene.html" class="nav-list-link">Lucene 学习笔记</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch004-Inverted-Index.html" class="nav-list-link">倒查表——AI分词的基础</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch005-Cost-of-Compute.html" class="nav-list-link">「计算成本」与「语义结构」</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch006-Generalization.html" class="nav-list-link">泛化能力漫谈</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch007-Semantic-Continuity.html" class="nav-list-link">语义连续性(Semantic Continuity) &amp; 高维流形（manifold）</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch008-Manifold.html" class="nav-list-link">高维流形（Manifold）</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch009-Misalignment.html" class="nav-list-link">跨主题、跨领域时容易失真（流形弯曲）</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch010-Dimension.html" class="nav-list-link">高维语义空间</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch011-Embedding-and-Transformer.html" class="nav-list-link">Embedding和Transformer</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch012-LLM-Arch.html" class="nav-list-link">GPT-4 这样的大模型是怎么搭起来的</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch013-LLM-Distributon.html" class="nav-list-link">LLM 是如何部署的</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch014-LLM-Arch-Iteration.html" class="nav-list-link">这种工程架构是怎么想出来的？</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch015-Other-LLM.html" class="nav-list-link">AI 大模型时代的基础设施共识</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch016-Computation-Graph.html" class="nav-list-link">一切神经网络，本质上都是一张计算图（Computation Graph）在运行</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch017-How-to-Learn.html" class="nav-list-link">这些知识从哪获得</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch018-Build-a-System.html" class="nav-list-link">一个工程师式学习路径：</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch019-Week1-2.html" class="nav-list-link">Week 1–2（第一阶段：能跑起来）</a></li><li class="nav-list-item"><a href="/llm-learning-note/notes/Ch020-Week3-4.html" class="nav-list-link">Week 3–4：LoRA/QLoRA 微调实操</a></li></ul> </nav> <footer class="site-footer"> This site uses <a href="https://github.com/just-the-docs/just-the-docs">Just the Docs</a>, a documentation theme for Jekyll. </footer> </div> <div class="main" id="top"> <div id="main-header" class="main-header"> <div class="search" role="search"> <div class="search-input-wrap"> <input type="text" id="search-input" class="search-input" tabindex="0" placeholder="Search LLM 学习笔记" aria-label="Search LLM 学习笔记" autocomplete="off"> <label for="search-input" class="search-label"><svg viewBox="0 0 24 24" class="search-icon"><use xlink:href="#svg-search"></use></svg></label> </div> <div id="search-results" class="search-results"></div> </div> </div> <div class="main-content-wrap"> <div id="main-content" class="main-content"> <main> </main> </div> </div> <div class="search-overlay"></div> </div> </body> </html>
