| @@ -11,24 +11,29 @@ https://www.coursera.org/learn/machine-learning | |||
| 本项目包含课程中的所有课后作业以及笔记,目前正在将手写笔记进行电子化。 | |||
| 1. 笔记(notes)都为中文,为了便于复习和扩充等,尽量会按照视频目录,以及视频内容进行提炼整理。 | |||
| 2. 所有课后作业(assignments)都已提交并通过 Coursera 编程测验。仅供参考,请勿抄袭。 | |||
| 笔记基于支持 LaTeX 的 markdown 编辑器 [Typora][2],其他类似的编辑器也可以阅读,不过可能会产生一些排版问题。 | |||
| For Andrew Ng's machine learning course on Coursera. | |||
| 如要直接在 GitHub Page 上阅读,需安装 Chrome 插件 —— [GitHub with MathJax][1],测试后发现该插件无法正常渲染某些公式(已向插件作者提出 issues),故还是建议用 Typora 阅读。 | |||
| Including assignments and notes, notes are WIP. | |||
| You can read it by Typora or any other similar markdown editor. | |||
| For Andrew Ng's machine learning course on Coursera. | |||
| ## 阅读及编辑 | |||
| 1. **在线阅读地址**:http://scruel.gitee.io/ml-andrewng-notes/ | |||
| 2. 直接在 GitHub Page 上阅读,需安装 Chrome 插件 —— [GitHub with MathJax][1](部分公式仍无法正常解析)。 | |||
| 3. 下载 .html 网页文件及 笔记图片 image 文件夹,浏览器打开阅读。 | |||
| 4. 笔记源码(.md)基于支持 LaTeX 的 markdown 编辑器 [Typora][2],其他类似的编辑器也可以阅读及编辑,注意其他编辑器可能会产生排版问题。 | |||
| Including assignments and notes, notes are WIP. | |||
| You can read it by Typora or any other similar markdown editor. | |||
| ## 致谢 | |||
| - Coursera 官网文档 | |||
| - Coursera 官网 | |||
| - @小小人_V 笔记 | |||
| - 52nlp | |||
| @@ -36,7 +41,5 @@ You can read it by Typora or any other similar markdown editor. | |||
| 注:由于手写笔记成稿时间较早,有所参考无法一一致谢,在此统一表示谢意! | |||
| [1]: https://chrome.google.com/webstore/detail/ioemnmodlmafdkllaclgeombjnmnbima | |||
| [2]: https://typora.io/ | |||
| @@ -0,0 +1,227 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>吴恩达(Andrew Ng)机器学习公开课中文笔记</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><h1><a name='header-n282' class='md-header-anchor '></a>吴恩达(Andrew Ng)机器学习公开课中文笔记</h1><p><a href='./week1.html'>week1</a></p><ol start='' ><li>引言(Introduction)</li><li>单变量线性回归(Linear Regression with One Variable)</li></ol><p><a href='./week2.html'>week2</a></p><ol start='3' ><li>线性代数回顾(Linear Algebra Review)</li><li>多变量线性回归(Linear Regression with Multiple Variables)</li><li>Octave/Matlab 指南(Octave/Matlab Tutorial)</li></ol><p><a href='./week3.html'>week3</a></p><ol start='6' ><li>逻辑回归(Logistic Regression)</li><li>正则化(Regularization)</li></ol><p><a href='./week4.html'>week4</a></p><ol start='8' ><li>神经网络:表达(Neural Networks: Representation)</li></ol><p><a href='./week5.html'>week5</a></p><ol start='9' ><li>神经网络:学习(Neural Networks: Learning)</li></ol><p><a href='./week6.html'>week6</a></p><ol start='10' ><li>机器学习应用的建议(Advice for Applying Machine Learning)</li><li>机器学习系统设计(Machine Learning System Design)</li></ol><p><a href='./week7.html'>week7</a></p><ol start='12' ><li>支持向量机(Support Vector Machines)</li></ol><p><a href='./week8.html'>week8</a></p><ol start='13' ><li>无监督学习(Unsupervised Learning)</li><li>降维(Dimensionality Reduction)</li></ol><p><a href='./week9.html'>week9</a></p><ol start='15' ><li>异常检测(Anomaly Detection)</li><li>推荐系统(Recommender Systems)</li></ol><p><a href='./week10.html'>week10</a></p><ol start='17' ><li>大规模机器学习(Large Scale Machine Learning)</li></ol><p><a href='./week11.html'>week11</a></p><ol start='18' ><li>实战:图像光学识别(Application Example: Photo OCR)</li></ol><p><div style="display:none"> | |||
| <script src="https://s19.cnzz.com/z_stat.php?id=1272117433&web_id=1272117433" language="JavaScript"></script> | |||
| </div></p></div> | |||
| </body> | |||
| </html> | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week10.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">17 Large Scale Machine Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">17.1 Learning With Large Datasets</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">17.2 Stochastic Gradient Descent</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">17.3 Mini-Batch Gradient Descent</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">17.4 Stochastic Gradient Descent Convergence</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">17.5 Online Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">17.6 Map Reduce and Data Parallelism</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>17 Large Scale Machine Learning</h1><h2><a name='header-n3' class='md-header-anchor '></a>17.1 Learning With Large Datasets</h2><h2><a name='header-n4' class='md-header-anchor '></a>17.2 Stochastic Gradient Descent</h2><h2><a name='header-n5' class='md-header-anchor '></a>17.3 Mini-Batch Gradient Descent</h2><h2><a name='header-n6' class='md-header-anchor '></a>17.4 Stochastic Gradient Descent Convergence</h2><h2><a name='header-n7' class='md-header-anchor '></a>17.5 Online Learning</h2><h2><a name='header-n8' class='md-header-anchor '></a>17.6 Map Reduce and Data Parallelism</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week11.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">18 Application Example: Photo OCR</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">18.1 Problem Description and Pipeline</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">18.2 Sliding Windows</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">18.3 Getting Lots of Data and Artificial Data</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">18.4 Ceiling Analysis_ What Part of the Pipeline to Work on Next</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">Summary and Thank You</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>18 Application Example: Photo OCR</h1><h2><a name='header-n3' class='md-header-anchor '></a>18.1 Problem Description and Pipeline</h2><h2><a name='header-n4' class='md-header-anchor '></a>18.2 Sliding Windows</h2><h2><a name='header-n5' class='md-header-anchor '></a>18.3 Getting Lots of Data and Artificial Data</h2><h2><a name='header-n6' class='md-header-anchor '></a>18.4 Ceiling Analysis_ What Part of the Pipeline to Work on Next</h2><h2><a name='header-n7' class='md-header-anchor '></a>Summary and Thank You</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -1,6 +1,6 @@ | |||
| [TOC] | |||
| # 18 Application Example:Photo OCR | |||
| # 18 Application Example: Photo OCR | |||
| ## 18.1 Problem Description and Pipeline | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week4.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">8 Neural Networks: Representation</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">8.1 Non-linear Hypotheses</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">8.2 Neurons and the Brain</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">8.3 Model Representation I</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">8.4 Model Representation II</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">8.5 Examples and Intuitions I</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">8.6 Examples and Intuitions II</a></span><span class="md-toc-item md-toc-h2" data-ref="n9"><a class="md-toc-inner" href="#header-n9">8.7 Multiclass Classification</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>8 Neural Networks: Representation</h1><h2><a name='header-n3' class='md-header-anchor '></a>8.1 Non-linear Hypotheses</h2><h2><a name='header-n4' class='md-header-anchor '></a>8.2 Neurons and the Brain</h2><h2><a name='header-n5' class='md-header-anchor '></a>8.3 Model Representation I</h2><h2><a name='header-n6' class='md-header-anchor '></a>8.4 Model Representation II</h2><h2><a name='header-n7' class='md-header-anchor '></a>8.5 Examples and Intuitions I</h2><h2><a name='header-n8' class='md-header-anchor '></a>8.6 Examples and Intuitions II</h2><h2><a name='header-n9' class='md-header-anchor '></a>8.7 Multiclass Classification</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -1,6 +1,6 @@ | |||
| [TOC] | |||
| # 8 Neural Networks:Representation | |||
| # 8 Neural Networks: Representation | |||
| ## 8.1 Non-linear Hypotheses | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week5.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">9 Neural Networks: Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">9.1 Cost Function</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">9.2 Backpropagation Algorithm</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">9.3 Backpropagation Intuition</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">9.4 Implementation Note_ Unrolling Parameters</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">9.5 Gradient Checking</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">9.6 Random Initialization</a></span><span class="md-toc-item md-toc-h2" data-ref="n9"><a class="md-toc-inner" href="#header-n9">9.7 Putting It Together</a></span><span class="md-toc-item md-toc-h2" data-ref="n10"><a class="md-toc-inner" href="#header-n10">9.8 Autonomous Driving</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>9 Neural Networks: Learning</h1><h2><a name='header-n3' class='md-header-anchor '></a>9.1 Cost Function</h2><h2><a name='header-n4' class='md-header-anchor '></a>9.2 Backpropagation Algorithm</h2><h2><a name='header-n5' class='md-header-anchor '></a>9.3 Backpropagation Intuition</h2><h2><a name='header-n6' class='md-header-anchor '></a>9.4 Implementation Note_ Unrolling Parameters</h2><h2><a name='header-n7' class='md-header-anchor '></a>9.5 Gradient Checking</h2><h2><a name='header-n8' class='md-header-anchor '></a>9.6 Random Initialization</h2><h2><a name='header-n9' class='md-header-anchor '></a>9.7 Putting It Together</h2><h2><a name='header-n10' class='md-header-anchor '></a>9.8 Autonomous Driving</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -1,6 +1,6 @@ | |||
| [TOC] | |||
| # 9 Neural Networks:Learning | |||
| # 9 Neural Networks: Learning | |||
| ## 9.1 Cost Function | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week6.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">10 Advice for Applying Machine Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">10.1 Deciding What to Try Next</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">10.2 Evaluating a Hypothesis</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">10.3 Model Selection and Train/Validation/Test Sets</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">10.4 Diagnosing Bias vs. Variance</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">10.5 Regularization and Bias/Variance</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">10.6 Learning Curves</a></span><span class="md-toc-item md-toc-h2" data-ref="n9"><a class="md-toc-inner" href="#header-n9">10.7 Deciding What to Do Next Revisited</a></span><span class="md-toc-item md-toc-h1" data-ref="n12"><a class="md-toc-inner" href="#header-n12">11 Machine Learning System Design</a></span><span class="md-toc-item md-toc-h2" data-ref="n13"><a class="md-toc-inner" href="#header-n13">11.1 Prioritizing What to Work On</a></span><span class="md-toc-item md-toc-h2" data-ref="n14"><a class="md-toc-inner" href="#header-n14">11.2 Error Analysis</a></span><span class="md-toc-item md-toc-h2" data-ref="n15"><a class="md-toc-inner" href="#header-n15">11.3 Error Metrics for Skewed Classes</a></span><span class="md-toc-item md-toc-h2" data-ref="n16"><a class="md-toc-inner" href="#header-n16">11.4 Trading Off Precision and Recall</a></span><span class="md-toc-item md-toc-h2" data-ref="n17"><a class="md-toc-inner" href="#header-n17">11.5 Data For Machine Learning</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>10 Advice for Applying Machine Learning</h1><h2><a name='header-n3' class='md-header-anchor '></a>10.1 Deciding What to Try Next</h2><h2><a name='header-n4' class='md-header-anchor '></a>10.2 Evaluating a Hypothesis</h2><h2><a name='header-n5' class='md-header-anchor '></a>10.3 Model Selection and Train/Validation/Test Sets</h2><h2><a name='header-n6' class='md-header-anchor '></a>10.4 Diagnosing Bias vs. Variance</h2><h2><a name='header-n7' class='md-header-anchor '></a>10.5 Regularization and Bias/Variance</h2><h2><a name='header-n8' class='md-header-anchor '></a>10.6 Learning Curves</h2><h2><a name='header-n9' class='md-header-anchor '></a>10.7 Deciding What to Do Next Revisited</h2><p> </p><h1><a name='header-n12' class='md-header-anchor '></a>11 Machine Learning System Design</h1><h2><a name='header-n13' class='md-header-anchor '></a>11.1 Prioritizing What to Work On</h2><h2><a name='header-n14' class='md-header-anchor '></a>11.2 Error Analysis</h2><h2><a name='header-n15' class='md-header-anchor '></a>11.3 Error Metrics for Skewed Classes</h2><h2><a name='header-n16' class='md-header-anchor '></a>11.4 Trading Off Precision and Recall</h2><h2><a name='header-n17' class='md-header-anchor '></a>11.5 Data For Machine Learning</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -1,5 +1,23 @@ | |||
| [TOC] | |||
| # 10 Advice for Applying Machine Learning | |||
| ## 10.1 Deciding What to Try Next | |||
| ## 10.2 Evaluating a Hypothesis | |||
| ## 10.3 Model Selection and Train/Validation/Test Sets | |||
| ##10.4 Diagnosing Bias vs. Variance | |||
| ## 10.5 Regularization and Bias/Variance | |||
| ## 10.6 Learning Curves | |||
| ## 10.7 Deciding What to Do Next Revisited | |||
| # 11 Machine Learning System Design | |||
| ## 11.1 Prioritizing What to Work On | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week7.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">12 Support Vector Machines</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">12.1 Optimization Objective</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">12.2 Large Margin Intuition</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">12.3 Mathematics Behind Large Margin Classification</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">12.4 Kernels I</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">12.5 Kernels II</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">12.6 Using An SVM</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>12 Support Vector Machines</h1><h2><a name='header-n3' class='md-header-anchor '></a>12.1 Optimization Objective</h2><h2><a name='header-n4' class='md-header-anchor '></a>12.2 Large Margin Intuition</h2><h2><a name='header-n5' class='md-header-anchor '></a>12.3 Mathematics Behind Large Margin Classification</h2><h2><a name='header-n6' class='md-header-anchor '></a>12.4 Kernels I</h2><h2><a name='header-n7' class='md-header-anchor '></a>12.5 Kernels II</h2><h2><a name='header-n8' class='md-header-anchor '></a>12.6 Using An SVM</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week8.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">13 Unsupervised Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">13.1 Unsupervised Learning_ Introduction</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">13.2 K-Means Algorithm</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">13.3 Optimization Objective</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">13.4 Random Initialization</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">13.5 Choosing the Number of Clusters</a></span><span class="md-toc-item md-toc-h1" data-ref="n8"><a class="md-toc-inner" href="#header-n8">14 Dimensionality Reduction</a></span><span class="md-toc-item md-toc-h2" data-ref="n9"><a class="md-toc-inner" href="#header-n9">14.1 Motivation I_ Data Compression</a></span><span class="md-toc-item md-toc-h2" data-ref="n10"><a class="md-toc-inner" href="#header-n10">14.2 Motivation II_ Visualization</a></span><span class="md-toc-item md-toc-h2" data-ref="n11"><a class="md-toc-inner" href="#header-n11">14.3 Principal Component Analysis Problem Formulation</a></span><span class="md-toc-item md-toc-h2" data-ref="n12"><a class="md-toc-inner" href="#header-n12">14.4 Principal Component Analysis Algorithm</a></span><span class="md-toc-item md-toc-h2" data-ref="n13"><a class="md-toc-inner" href="#header-n13">14.5 Reconstruction from Compressed Representation</a></span><span class="md-toc-item md-toc-h2" data-ref="n14"><a class="md-toc-inner" href="#header-n14">14.6 Choosing the Number of Principal Components</a></span><span class="md-toc-item md-toc-h2" data-ref="n15"><a class="md-toc-inner" href="#header-n15">14.7 Advice for Applying PCA</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>13 Unsupervised Learning</h1><h2><a name='header-n3' class='md-header-anchor '></a>13.1 Unsupervised Learning_ Introduction</h2><h2><a name='header-n4' class='md-header-anchor '></a>13.2 K-Means Algorithm</h2><h2><a name='header-n5' class='md-header-anchor '></a>13.3 Optimization Objective</h2><h2><a name='header-n6' class='md-header-anchor '></a>13.4 Random Initialization</h2><h2><a name='header-n7' class='md-header-anchor '></a>13.5 Choosing the Number of Clusters</h2><h1><a name='header-n8' class='md-header-anchor '></a>14 Dimensionality Reduction</h1><h2><a name='header-n9' class='md-header-anchor '></a>14.1 Motivation I_ Data Compression</h2><h2><a name='header-n10' class='md-header-anchor '></a>14.2 Motivation II_ Visualization</h2><h2><a name='header-n11' class='md-header-anchor '></a>14.3 Principal Component Analysis Problem Formulation</h2><h2><a name='header-n12' class='md-header-anchor '></a>14.4 Principal Component Analysis Algorithm</h2><h2><a name='header-n13' class='md-header-anchor '></a>14.5 Reconstruction from Compressed Representation</h2><h2><a name='header-n14' class='md-header-anchor '></a>14.6 Choosing the Number of Principal Components</h2><h2><a name='header-n15' class='md-header-anchor '></a>14.7 Advice for Applying PCA</h2></div> | |||
| </body> | |||
| </html> | |||
| @@ -0,0 +1,225 @@ | |||
| <!doctype html> | |||
| <html> | |||
| <head> | |||
| <meta charset='UTF-8'><meta name='viewport' content='width=device-width initial-scale=1'> | |||
| <title>week9.md</title><link href='http://fonts.googleapis.com/css?family=Open+Sans:400italic,700italic,700,400&subset=latin,latin-ext' rel='stylesheet' type='text/css' /><style type='text/css'>html {overflow-x: initial !important;}:root { --bg-color: #ffffff; --text-color: #333333; --code-block-bg-color: inherit; } | |||
| html { font-size: 14px; background-color: var(--bg-color); color: var(--text-color); font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; -webkit-font-smoothing: antialiased; } | |||
| body { margin: 0px; padding: 0px; height: auto; bottom: 0px; top: 0px; left: 0px; right: 0px; font-size: 1rem; line-height: 1.42857; overflow-x: hidden; background: inherit; } | |||
| a:active, a:hover { outline: 0px; } | |||
| .in-text-selection, ::selection { background: rgb(181, 214, 252); text-shadow: none; } | |||
| #write { margin: 0px auto; height: auto; width: inherit; word-break: normal; word-wrap: break-word; position: relative; padding-bottom: 70px; white-space: pre-wrap; overflow-x: visible; } | |||
| .for-image #write { padding-left: 8px; padding-right: 8px; } | |||
| body.typora-export { padding-left: 30px; padding-right: 30px; } | |||
| @media screen and (max-width: 500px) { | |||
| body.typora-export { padding-left: 0px; padding-right: 0px; } | |||
| .CodeMirror-sizer { margin-left: 0px !important; } | |||
| .CodeMirror-gutters { display: none !important; } | |||
| } | |||
| .typora-export #write { margin: 0px auto; } | |||
| #write > p:first-child, #write > ul:first-child, #write > ol:first-child, #write > pre:first-child, #write > blockquote:first-child, #write > div:first-child, #write > table:first-child { margin-top: 30px; } | |||
| #write li > table:first-child { margin-top: -20px; } | |||
| img { max-width: 100%; vertical-align: middle; } | |||
| input, button, select, textarea { color: inherit; font-style: inherit; font-variant: inherit; font-weight: inherit; font-stretch: inherit; font-size: inherit; line-height: inherit; font-family: inherit; } | |||
| input[type="checkbox"], input[type="radio"] { line-height: normal; padding: 0px; } | |||
| ::before, ::after, * { box-sizing: border-box; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6, #write div, #write pre { width: inherit; } | |||
| #write p, #write h1, #write h2, #write h3, #write h4, #write h5, #write h6 { position: relative; } | |||
| h1 { font-size: 2rem; } | |||
| h2 { font-size: 1.8rem; } | |||
| h3 { font-size: 1.6rem; } | |||
| h4 { font-size: 1.4rem; } | |||
| h5 { font-size: 1.2rem; } | |||
| h6 { font-size: 1rem; } | |||
| p { -webkit-margin-before: 1rem; -webkit-margin-after: 1rem; -webkit-margin-start: 0px; -webkit-margin-end: 0px; } | |||
| .typora-export p { white-space: normal; } | |||
| .mathjax-block { margin-top: 0px; margin-bottom: 0px; -webkit-margin-before: 0rem; -webkit-margin-after: 0rem; } | |||
| .hidden { display: none; } | |||
| .md-blockmeta { color: rgb(204, 204, 204); font-weight: bold; font-style: italic; } | |||
| a { cursor: pointer; } | |||
| sup.md-footnote { padding: 2px 4px; background-color: rgba(238, 238, 238, 0.7); color: rgb(85, 85, 85); border-radius: 4px; } | |||
| #write input[type="checkbox"] { cursor: pointer; width: inherit; height: inherit; margin: 4px 0px 0px; } | |||
| figure { max-width: 100%; overflow-x: auto; margin: 0px; } | |||
| tr { break-inside: avoid; break-after: auto; } | |||
| thead { display: table-header-group; } | |||
| table { border-collapse: collapse; border-spacing: 0px; width: 100%; overflow: auto; break-inside: auto; text-align: left; } | |||
| table.md-table td { min-width: 80px; } | |||
| .CodeMirror-gutters { border-right: 0px; background-color: inherit; } | |||
| .CodeMirror { text-align: left; } | |||
| .CodeMirror-placeholder { opacity: 0.3; } | |||
| .CodeMirror pre { padding: 0px 4px; } | |||
| .CodeMirror-lines { padding: 0px; } | |||
| div.hr:focus { cursor: none; } | |||
| pre { white-space: pre-wrap; } | |||
| .CodeMirror-gutters { margin-right: 4px; } | |||
| .md-fences { font-size: 0.9rem; display: block; break-inside: avoid; text-align: left; overflow: visible; white-space: pre; background: var(--code-block-bg-color); position: relative !important; } | |||
| .md-diagram-panel { width: 100%; margin-top: 10px; text-align: center; padding-top: 0px; padding-bottom: 8px; overflow-x: auto; } | |||
| .md-fences .CodeMirror.CodeMirror-wrap { top: -1.6em; margin-bottom: -1.6em; } | |||
| .md-fences.mock-cm { white-space: pre-wrap; } | |||
| .show-fences-line-number .md-fences { padding-left: 0px; } | |||
| .show-fences-line-number .md-fences.mock-cm { padding-left: 40px; } | |||
| .CodeMirror-line { break-inside: avoid; } | |||
| .footnotes { opacity: 0.8; font-size: 0.9rem; padding-top: 1em; padding-bottom: 1em; } | |||
| .footnotes + .footnotes { margin-top: -1em; } | |||
| .md-reset { margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: top; background: transparent; text-decoration: none; text-shadow: none; float: none; position: static; width: auto; height: auto; white-space: nowrap; cursor: inherit; -webkit-tap-highlight-color: transparent; line-height: normal; font-weight: normal; text-align: left; box-sizing: content-box; direction: ltr; } | |||
| li div { padding-top: 0px; } | |||
| blockquote { margin: 1rem 0px; } | |||
| li p, li .mathjax-block { margin: 0.5rem 0px; } | |||
| li { margin: 0px; position: relative; } | |||
| blockquote > :last-child { margin-bottom: 0px; } | |||
| blockquote > :first-child { margin-top: 0px; } | |||
| .footnotes-area { color: rgb(136, 136, 136); margin-top: 0.714rem; padding-bottom: 0.143rem; } | |||
| @media print { | |||
| html, body { border: 1px solid transparent; height: 99%; break-after: avoid; break-before: avoid; } | |||
| .typora-export * { -webkit-print-color-adjust: exact; } | |||
| h1, h2, h3, h4, h5, h6 { break-after: avoid-page; orphans: 2; } | |||
| p { orphans: 4; } | |||
| html.blink-to-pdf { font-size: 13px; } | |||
| .typora-export #write { padding-left: 1cm; padding-right: 1cm; padding-bottom: 0px; break-after: avoid; } | |||
| .typora-export #write::after { height: 0px; } | |||
| @page { margin: 20mm 0mm; } | |||
| } | |||
| .footnote-line { margin-top: 0.714em; font-size: 0.7em; } | |||
| a img, img a { cursor: pointer; } | |||
| pre.md-meta-block { font-size: 0.8rem; min-height: 2.86rem; white-space: pre-wrap; background: rgb(204, 204, 204); display: block; overflow-x: hidden; } | |||
| p > img:only-child { display: block; margin: auto; } | |||
| p .md-image:only-child { display: inline-block; width: 100%; text-align: center; } | |||
| #write .MathJax_Display { margin: 0.8em 0px 0px; } | |||
| .mathjax-block { white-space: pre; overflow: hidden; width: 100%; } | |||
| p + .mathjax-block { margin-top: -1.143rem; } | |||
| .mathjax-block:not(:empty)::after { display: none; } | |||
| [contenteditable="true"]:active, [contenteditable="true"]:focus { outline: none; box-shadow: none; } | |||
| .task-list { list-style-type: none; } | |||
| .task-list-item { position: relative; padding-left: 1em; } | |||
| .task-list-item input { position: absolute; top: 0px; left: 0px; } | |||
| .math { font-size: 1rem; } | |||
| .md-toc { min-height: 3.58rem; position: relative; font-size: 0.9rem; border-radius: 10px; } | |||
| .md-toc-content { position: relative; margin-left: 0px; } | |||
| .md-toc::after, .md-toc-content::after { display: none; } | |||
| .md-toc-item { display: block; color: rgb(65, 131, 196); } | |||
| .md-toc-item a { text-decoration: none; } | |||
| .md-toc-inner:hover { } | |||
| .md-toc-inner { display: inline-block; cursor: pointer; } | |||
| .md-toc-h1 .md-toc-inner { margin-left: 0px; font-weight: bold; } | |||
| .md-toc-h2 .md-toc-inner { margin-left: 2em; } | |||
| .md-toc-h3 .md-toc-inner { margin-left: 4em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 6em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 8em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 10em; } | |||
| @media screen and (max-width: 48em) { | |||
| .md-toc-h3 .md-toc-inner { margin-left: 3.5em; } | |||
| .md-toc-h4 .md-toc-inner { margin-left: 5em; } | |||
| .md-toc-h5 .md-toc-inner { margin-left: 6.5em; } | |||
| .md-toc-h6 .md-toc-inner { margin-left: 8em; } | |||
| } | |||
| a.md-toc-inner { font-size: inherit; font-style: inherit; font-weight: inherit; line-height: inherit; } | |||
| .footnote-line a:not(.reversefootnote) { color: inherit; } | |||
| .md-attr { display: none; } | |||
| .md-fn-count::after { content: "."; } | |||
| .md-tag { opacity: 0.5; } | |||
| .md-comment { color: rgb(162, 127, 3); opacity: 0.8; font-family: monospace; } | |||
| code { text-align: left; } | |||
| h1 .md-tag, h2 .md-tag, h3 .md-tag, h4 .md-tag, h5 .md-tag, h6 .md-tag { font-weight: initial; opacity: 0.35; } | |||
| a.md-print-anchor { border-width: initial !important; border-style: none !important; border-color: initial !important; display: inline-block !important; position: absolute !important; width: 1px !important; right: 0px !important; outline: none !important; background: transparent !important; text-decoration: initial !important; text-shadow: initial !important; } | |||
| .md-inline-math .MathJax_SVG .noError { display: none !important; } | |||
| .mathjax-block .MathJax_SVG_Display { text-align: center; margin: 1em 0em; position: relative; text-indent: 0px; max-width: none; max-height: none; min-height: 0px; min-width: 100%; width: auto; display: block !important; } | |||
| .MathJax_SVG_Display, .md-inline-math .MathJax_SVG_Display { width: auto; margin: inherit; display: inline-block !important; } | |||
| .MathJax_SVG .MJX-monospace { font-family: monospace; } | |||
| .MathJax_SVG .MJX-sans-serif { font-family: sans-serif; } | |||
| .MathJax_SVG { display: inline; font-style: normal; font-weight: normal; line-height: normal; zoom: 90%; text-indent: 0px; text-align: left; text-transform: none; letter-spacing: normal; word-spacing: normal; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px; margin: 0px; } | |||
| .MathJax_SVG * { transition: none; } | |||
| .md-diagram-panel > svg { max-width: 100%; } | |||
| [lang="flow"] svg, [lang="mermaid"] svg { max-width: 100%; } | |||
| :root { --side-bar-bg-color: #fafafa; --control-text-color: #777; } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: normal; src: local("Open Sans Regular"), url("./github/400.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: normal; src: local("Open Sans Italic"), url("./github/400i.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: normal; font-weight: bold; src: local("Open Sans Bold"), url("./github/700.woff") format("woff"); } | |||
| @font-face { font-family: "Open Sans"; font-style: italic; font-weight: bold; src: local("Open Sans Bold Italic"), url("./github/700i.woff") format("woff"); } | |||
| html { font-size: 16px; } | |||
| body { font-family: "Open Sans", "Clear Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; color: rgb(51, 51, 51); line-height: 1.6; } | |||
| #write { max-width: 860px; margin: 0px auto; padding: 20px 30px 100px; } | |||
| #write > ul:first-child, #write > ol:first-child { margin-top: 30px; } | |||
| body > :first-child { margin-top: 0px !important; } | |||
| body > :last-child { margin-bottom: 0px !important; } | |||
| a { color: rgb(65, 131, 196); } | |||
| h1, h2, h3, h4, h5, h6 { position: relative; margin-top: 1rem; margin-bottom: 1rem; font-weight: bold; line-height: 1.4; cursor: text; } | |||
| h1:hover a.anchor, h2:hover a.anchor, h3:hover a.anchor, h4:hover a.anchor, h5:hover a.anchor, h6:hover a.anchor { text-decoration: none; } | |||
| h1 tt, h1 code { font-size: inherit; } | |||
| h2 tt, h2 code { font-size: inherit; } | |||
| h3 tt, h3 code { font-size: inherit; } | |||
| h4 tt, h4 code { font-size: inherit; } | |||
| h5 tt, h5 code { font-size: inherit; } | |||
| h6 tt, h6 code { font-size: inherit; } | |||
| h1 { padding-bottom: 0.3em; font-size: 2.25em; line-height: 1.2; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h2 { padding-bottom: 0.3em; font-size: 1.75em; line-height: 1.225; border-bottom: 1px solid rgb(238, 238, 238); } | |||
| h3 { font-size: 1.5em; line-height: 1.43; } | |||
| h4 { font-size: 1.25em; } | |||
| h5 { font-size: 1em; } | |||
| h6 { font-size: 1em; color: rgb(119, 119, 119); } | |||
| p, blockquote, ul, ol, dl, table { margin: 0.8em 0px; } | |||
| li > ol, li > ul { margin: 0px; } | |||
| hr { height: 4px; padding: 0px; margin: 16px 0px; background-color: rgb(231, 231, 231); border-width: 0px 0px 1px; border-style: none none solid; border-top-color: initial; border-right-color: initial; border-left-color: initial; border-image: initial; overflow: hidden; box-sizing: content-box; border-bottom-color: rgb(221, 221, 221); } | |||
| body > h2:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child { margin-top: 0px; padding-top: 0px; } | |||
| body > h1:first-child + h2 { margin-top: 0px; padding-top: 0px; } | |||
| body > h3:first-child, body > h4:first-child, body > h5:first-child, body > h6:first-child { margin-top: 0px; padding-top: 0px; } | |||
| a:first-child h1, a:first-child h2, a:first-child h3, a:first-child h4, a:first-child h5, a:first-child h6 { margin-top: 0px; padding-top: 0px; } | |||
| h1 p, h2 p, h3 p, h4 p, h5 p, h6 p { margin-top: 0px; } | |||
| li p.first { display: inline-block; } | |||
| ul, ol { padding-left: 30px; } | |||
| ul:first-child, ol:first-child { margin-top: 0px; } | |||
| ul:last-child, ol:last-child { margin-bottom: 0px; } | |||
| blockquote { border-left: 4px solid rgb(221, 221, 221); padding: 0px 15px; color: rgb(119, 119, 119); } | |||
| blockquote blockquote { padding-right: 0px; } | |||
| table { padding: 0px; word-break: initial; } | |||
| table tr { border-top: 1px solid rgb(204, 204, 204); margin: 0px; padding: 0px; } | |||
| table tr:nth-child(2n) { background-color: rgb(248, 248, 248); } | |||
| table tr th { font-weight: bold; border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr td { border: 1px solid rgb(204, 204, 204); text-align: left; margin: 0px; padding: 6px 13px; } | |||
| table tr th:first-child, table tr td:first-child { margin-top: 0px; } | |||
| table tr th:last-child, table tr td:last-child { margin-bottom: 0px; } | |||
| .CodeMirror-gutters { border-right: 1px solid rgb(221, 221, 221); } | |||
| .md-fences, code, tt { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; } | |||
| .md-fences { margin-bottom: 15px; margin-top: 15px; padding: 8px 1em 6px; } | |||
| .task-list { padding-left: 0px; } | |||
| .task-list-item { padding-left: 32px; } | |||
| .task-list-item input { top: 3px; left: 8px; } | |||
| @media screen and (min-width: 914px) { | |||
| } | |||
| @media print { | |||
| html { font-size: 13px; } | |||
| table, pre { break-inside: avoid; } | |||
| pre { word-wrap: break-word; } | |||
| } | |||
| .md-fences { background-color: rgb(248, 248, 248); } | |||
| #write pre.md-meta-block { padding: 1rem; font-size: 85%; line-height: 1.45; background-color: rgb(247, 247, 247); border: 0px; border-radius: 3px; color: rgb(119, 119, 119); margin-top: 0px !important; } | |||
| .mathjax-block > .code-tooltip { bottom: 0.375rem; } | |||
| #write > h3.md-focus::before { left: -1.5625rem; top: 0.375rem; } | |||
| #write > h4.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h5.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| #write > h6.md-focus::before { left: -1.5625rem; top: 0.285714rem; } | |||
| .md-image > .md-meta { border: 1px solid rgb(221, 221, 221); border-radius: 3px; font-family: Consolas, "Liberation Mono", Courier, monospace; padding: 2px 4px 0px; font-size: 0.9em; color: inherit; } | |||
| .md-tag { color: inherit; } | |||
| .md-toc { margin-top: 20px; padding-bottom: 20px; } | |||
| .sidebar-tabs { border-bottom: none; } | |||
| #typora-quick-open { border: 1px solid rgb(221, 221, 221); background-color: rgb(248, 248, 248); } | |||
| #typora-quick-open-item { background-color: rgb(250, 250, 250); border-color: rgb(254, 254, 254) rgb(229, 229, 229) rgb(229, 229, 229) rgb(238, 238, 238); border-style: solid; border-width: 1px; } | |||
| #md-notification::before { top: 10px; } | |||
| .on-focus-mode blockquote { border-left-color: rgba(85, 85, 85, 0.12); } | |||
| header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Arial, sans-serif; } | |||
| .file-node-content:hover .file-node-icon, .file-node-content:hover .file-node-open-state { visibility: visible; } | |||
| .mac-seamless-mode #typora-sidebar { background-color: var(--side-bar-bg-color); } | |||
| .md-lang { color: rgb(180, 101, 77); } | |||
| </style> | |||
| </head> | |||
| <body class='typora-export' > | |||
| <div id='write' class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" href="#header-n2">15 Anomaly Detection</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" href="#header-n3">15.1 Problem Motivation</a></span><span class="md-toc-item md-toc-h2" data-ref="n4"><a class="md-toc-inner" href="#header-n4">15.2 Gaussian Distribution</a></span><span class="md-toc-item md-toc-h2" data-ref="n5"><a class="md-toc-inner" href="#header-n5">15.3 Algorithm</a></span><span class="md-toc-item md-toc-h2" data-ref="n6"><a class="md-toc-inner" href="#header-n6">15.4 Developing and Evaluating an Anomaly Detection System</a></span><span class="md-toc-item md-toc-h2" data-ref="n7"><a class="md-toc-inner" href="#header-n7">15.5 Anomaly Detection vs. Supervised Learning</a></span><span class="md-toc-item md-toc-h2" data-ref="n8"><a class="md-toc-inner" href="#header-n8">15.6 Choosing What Features to Use</a></span><span class="md-toc-item md-toc-h2" data-ref="n9"><a class="md-toc-inner" href="#header-n9">15.7 Multivariate Gaussian Distribution</a></span><span class="md-toc-item md-toc-h2" data-ref="n10"><a class="md-toc-inner" href="#header-n10">15.8 Anomaly Detection using the Multivariate Gaussian Distribution</a></span><span class="md-toc-item md-toc-h1" data-ref="n11"><a class="md-toc-inner" href="#header-n11">16 Recommender Systems</a></span><span class="md-toc-item md-toc-h2" data-ref="n12"><a class="md-toc-inner" href="#header-n12">16.1 Problem Formulation</a></span><span class="md-toc-item md-toc-h2" data-ref="n13"><a class="md-toc-inner" href="#header-n13">16.2 Content Based Recommendations</a></span><span class="md-toc-item md-toc-h2" data-ref="n14"><a class="md-toc-inner" href="#header-n14">16.3 Collaborative Filtering</a></span><span class="md-toc-item md-toc-h2" data-ref="n15"><a class="md-toc-inner" href="#header-n15">16.4 Collaborative Filtering Algorithm</a></span><span class="md-toc-item md-toc-h2" data-ref="n16"><a class="md-toc-inner" href="#header-n16">16.5 Vectorization_ Low Rank Matrix Factorization</a></span><span class="md-toc-item md-toc-h2" data-ref="n17"><a class="md-toc-inner" href="#header-n17">16.6 Implementational Detail_ Mean Normalization</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>15 Anomaly Detection</h1><h2><a name='header-n3' class='md-header-anchor '></a>15.1 Problem Motivation</h2><h2><a name='header-n4' class='md-header-anchor '></a>15.2 Gaussian Distribution</h2><h2><a name='header-n5' class='md-header-anchor '></a>15.3 Algorithm</h2><h2><a name='header-n6' class='md-header-anchor '></a>15.4 Developing and Evaluating an Anomaly Detection System</h2><h2><a name='header-n7' class='md-header-anchor '></a>15.5 Anomaly Detection vs. Supervised Learning</h2><h2><a name='header-n8' class='md-header-anchor '></a>15.6 Choosing What Features to Use</h2><h2><a name='header-n9' class='md-header-anchor '></a>15.7 Multivariate Gaussian Distribution</h2><h2><a name='header-n10' class='md-header-anchor '></a>15.8 Anomaly Detection using the Multivariate Gaussian Distribution</h2><h1><a name='header-n11' class='md-header-anchor '></a>16 Recommender Systems</h1><h2><a name='header-n12' class='md-header-anchor '></a>16.1 Problem Formulation</h2><h2><a name='header-n13' class='md-header-anchor '></a>16.2 Content Based Recommendations</h2><h2><a name='header-n14' class='md-header-anchor '></a>16.3 Collaborative Filtering</h2><h2><a name='header-n15' class='md-header-anchor '></a>16.4 Collaborative Filtering Algorithm</h2><h2><a name='header-n16' class='md-header-anchor '></a>16.5 Vectorization_ Low Rank Matrix Factorization</h2><h2><a name='header-n17' class='md-header-anchor '></a>16.6 Implementational Detail_ Mean Normalization</h2></div> | |||
| </body> | |||
| </html> | |||