This book is meant to provide an introduction to vectors, matrices, and least squares methods, basic topics in applied linear algebra. Our goal is to give the beginning student, with little or no prior exposure to linear algebra, a good grounding in the basic ideas, as well as an appreciation for how they are used in many applications, including data fitting, machine learning and artificial intelligence, to-mography, navigation, image processing, finance, and automatic control systems.
The background required of the reader is familiarity with basic mathematical notation. We use calculus in just a few places, but it does not play a critical role and is not a strict prerequisite. Even though the book covers many topics that are traditionally taught as part of probability and statistics, such as fitting mathematical models to data, no knowledge of or background in probability and statistics is needed.
The book covers less mathematics than a typical text on applied linear algebra. We use only one theoretical concept from linear algebra, linear independence, and only one computational tool, the QR factorization; our approach to most applications relies on only one method, least squares (or some extension). In this sense we aim for intellectual economy: With just a few basic mathematical ideas, con-cepts, and methods, we cover many applications. The mathematics we do present, however, is complete, in that we carefully justify every mathematical statement. In contrast to most introductory linear algebra texts, however, we describe many applications, including some that are typically considered advanced topics, like document classification, control, state estimation, and portfolio optimization.
The book does not require any knowledge of computer programming, and can be used as a conventional textbook, by reading the chapters and working the exercises that do not involve numerical computation. This approach however misses out on one of the most compelling reasons to learn the material: You can use the ideas and methods described in this book to do practical things like build a prediction model from data, enhance images, or optimize an investment portfolio. The growing power of computers, together with the development of high level computer languages and packages that support vector and matrix computation, have made it easy to use the methods described in this book for real applications. For this reason we hope that every student of this book will complement their study with computer programming exercises and projects, including some that involve real data. This book includes some generic exercises that require computation; additional ones, and the associated data files and language-specific resources, are available online.
If you read the whole book, work some of the exercises, and carry out computer exercises to implement or use the ideas and methods, you will learn a lot. While there will still be much for you to learn, you will have seen many of the basic ideas behind modern data science and other application areas. We hope you will be empowered to use the methods for your own applications.
The book is divided into three parts. Part I introduces the reader to vectors, and various vector operations and functions like addition, inner product, distance, and angle. We also describe how vectors are used in applications to represent word counts in a document, time series, attributes of a patient, sales of a product, an audio track, an image, or a portfolio of investments. Part II does the same for matrices, culminating with matrix inverses and methods for solving linear equa-tions. Part III, on least squares, is the payoff, at least in terms of the applications. We show how the simple and natural idea of approximately solving a set of over-determined equations, and a few extensions of this basic idea, can be used to solve many practical problems.
The whole book can be covered in a 15 week (semester) course; a 10 week (quarter) course can cover most of the material, by skipping a few applications and perhaps the last two chapters on nonlinear least squares. The book can also be used for self-study, complemented with material available online. By design, the pace of the book accelerates a bit, with many details and simple examples in parts I and II, and more advanced examples and applications in part III. A course for students with little or no background in linear algebra can focus on parts I and II, and cover just a few of the more advanced applications in part III. A more advanced course on applied linear algebra can quickly cover parts I and II as review, and then focus on the applications in part III, as well as additional topics.
We are grateful to many of our colleagues, teaching assistants, and students for helpful suggestions and discussions during the development of this book and the associated courses. We especially thank our colleagues Trevor Hastie, Rob Tibshirani, and Sanjay Lall, as well as Nick Boyd, for discussions about data fitting and classification, and Jenny Hong, Ahmed Bou-Rabee, Keegan Go, David Zeng, and Jaehyun Park, Stanford undergraduates who helped create and teach the course EE103. We thank David Tse, Alex Lemon, Neal Parikh, and Julie Lancashire for carefully reading drafts of this book and making many good suggestions.
Stephen P. Boyd is the Samsung Professor of Engineering, and Professor of Electrical Engineering at Stanford University with courtesy appointments in the Department of Computer Science, and the Department of Management Science and Engineering. He is the co-author ofConvex Optimization, written with Lieven Vandenberghe and published by Cambridge University Press in 2004.
Lieven ...
(展开全部)
「如果你不看新聞,你會與世界脫節;但如果你看新聞,你會與事實脫節。」--丹佐.華盛頓(Denzel Washington)2013年4月12日,杜伯里應英國《衛...
♩ 与厨房里的音乐家为伴,让耳朵唤醒味蕾。♬♪ 10位音乐大师的美食故事、30道在家就能做的米其林星级菜肴。♫拥有一颗纯洁的心,才能做出一碗好汤。——贝多芬人类...
毛立平(1974— ),女,历史学博士,中国人民大学清史研究所副教授,研究领域为清代宫廷史、性别史。主要研究成果有:专著《清代嫁妆研究》;论文《金枝玉叶与收支困...
坐在高档写字楼中的白领,很容易惹病上身,工作压力大、失眠、焦虑、经常加班、时不时的应酬、不规律的饮食,最终导致体质越来越差。如果您也被这些问题所困扰,除了要多做...
Inagreatercommunityofmankind,religiousandsocialprogressmustbecomemorecoherent.Fe...
冰浆技术及应用 本书特色 第0章绪论0.1人与自然0.2节能减排刻不容缓O.3蓄冷技术0.3.1蓄冷技术发展0.3.2蓄冷技术0.4食品保鲜0.5冰浆的概念参考...
海洋自由论 本书特色 这系列是一群"出海"年轻人"睁眼年世界"写下的文字,是他们"看世界"的点点滴滴。该系列书旨在重新认识西洋,重视海洋。本书是其中的一部,全面...
精彩摘录Thisgalleryisafree-standingvolumesituatedwithinapark-likegardenofbirchesandc...
中成药部分-实用临床中药学 本书特色 实用是李学林和崔瑛等主编的《实用临床中药学》的*大特色,也是本书与传统临床中药学教材的*大不同之处。实用性体现在:①不仅介...
《中国都市圈极限通勤研究》内容简介:本书基于联通手机信令数据,选取中国最具代表性的十大都市圈,通过分析居民日常通勤情况,试
Have you taken children to a gallery recently? Did you struggle to explain the w...
伊曼努尔•康德(Immanuel Kant,1724-1804),启蒙运动时期最重要的思想家之一,德国古典哲学创始人,同时也是一位杰出的天文学家。其前期的自然科...
建筑绘画与一般绘画 内容简介 建筑画,特别是建筑表现图,*主要的目的和作用在于向建筑的业主、使用者乃至包括建筑师在内的设计者和其他有关的人说明所描绘的建筑,着重...
eedtogetuptospeedquicklyonthelatestadvancesinhighperformancedataconverters?Wanth...
墨香銅臭(ㄒㄧㄡˋ)低齡迷信少女,知名表情包博主。美食界泥石流,拍照手抖帕金森。打字慢如狗,填坑看心情……都是騙人的。其實喜歡在午後喝一杯清茶眺望遠方,打開心愛...
史铁生,1951年生于北京。1967年初中毕业。1969年去陕北农村插队,三年后双腿瘫痪转回北京。回京后在一家街道工厂做临时工,七年后因病情加重回家疗养。197...
餐饮老板内参餐饮老板内参是专注餐饮垂直领域的经管新媒体,致力于为餐饮老板、餐饮创业者、供应链用户提供新锐、独特、有价值的内容和思想服务。目前已成为国内极具影响力...
作品目录目录中译本说明研究大纲:霍布斯的政治学(自然权利导论)一部计划写的关于霍布斯的书的前言评《政治的概念》附录一 关于
本书是美国著名职场规划专家、奥巴马政府顾问亚历山德拉·列维特的代表作,出版上市以来,在美国产生巨大轰动,引起“上至70余岁
针灸与气功 内容简介 本书对针灸与气功的起源和发展及操练方法进行了详细介绍。内容包括针灸的特点;针灸的起源和发展;针灸的基本理论;针灸的方法及针灸的治疗和气功的...