This book is meant to provide an introduction to vectors, matrices, and least squares methods, basic topics in applied linear algebra. Our goal is to give the beginning student, with little or no prior exposure to linear algebra, a good grounding in the basic ideas, as well as an appreciation for how they are used in many applications, including data fitting, machine learning and artificial intelligence, to-mography, navigation, image processing, finance, and automatic control systems.
The background required of the reader is familiarity with basic mathematical notation. We use calculus in just a few places, but it does not play a critical role and is not a strict prerequisite. Even though the book covers many topics that are traditionally taught as part of probability and statistics, such as fitting mathematical models to data, no knowledge of or background in probability and statistics is needed.
The book covers less mathematics than a typical text on applied linear algebra. We use only one theoretical concept from linear algebra, linear independence, and only one computational tool, the QR factorization; our approach to most applications relies on only one method, least squares (or some extension). In this sense we aim for intellectual economy: With just a few basic mathematical ideas, con-cepts, and methods, we cover many applications. The mathematics we do present, however, is complete, in that we carefully justify every mathematical statement. In contrast to most introductory linear algebra texts, however, we describe many applications, including some that are typically considered advanced topics, like document classification, control, state estimation, and portfolio optimization.
The book does not require any knowledge of computer programming, and can be used as a conventional textbook, by reading the chapters and working the exercises that do not involve numerical computation. This approach however misses out on one of the most compelling reasons to learn the material: You can use the ideas and methods described in this book to do practical things like build a prediction model from data, enhance images, or optimize an investment portfolio. The growing power of computers, together with the development of high level computer languages and packages that support vector and matrix computation, have made it easy to use the methods described in this book for real applications. For this reason we hope that every student of this book will complement their study with computer programming exercises and projects, including some that involve real data. This book includes some generic exercises that require computation; additional ones, and the associated data files and language-specific resources, are available online.
If you read the whole book, work some of the exercises, and carry out computer exercises to implement or use the ideas and methods, you will learn a lot. While there will still be much for you to learn, you will have seen many of the basic ideas behind modern data science and other application areas. We hope you will be empowered to use the methods for your own applications.
The book is divided into three parts. Part I introduces the reader to vectors, and various vector operations and functions like addition, inner product, distance, and angle. We also describe how vectors are used in applications to represent word counts in a document, time series, attributes of a patient, sales of a product, an audio track, an image, or a portfolio of investments. Part II does the same for matrices, culminating with matrix inverses and methods for solving linear equa-tions. Part III, on least squares, is the payoff, at least in terms of the applications. We show how the simple and natural idea of approximately solving a set of over-determined equations, and a few extensions of this basic idea, can be used to solve many practical problems.
The whole book can be covered in a 15 week (semester) course; a 10 week (quarter) course can cover most of the material, by skipping a few applications and perhaps the last two chapters on nonlinear least squares. The book can also be used for self-study, complemented with material available online. By design, the pace of the book accelerates a bit, with many details and simple examples in parts I and II, and more advanced examples and applications in part III. A course for students with little or no background in linear algebra can focus on parts I and II, and cover just a few of the more advanced applications in part III. A more advanced course on applied linear algebra can quickly cover parts I and II as review, and then focus on the applications in part III, as well as additional topics.
We are grateful to many of our colleagues, teaching assistants, and students for helpful suggestions and discussions during the development of this book and the associated courses. We especially thank our colleagues Trevor Hastie, Rob Tibshirani, and Sanjay Lall, as well as Nick Boyd, for discussions about data fitting and classification, and Jenny Hong, Ahmed Bou-Rabee, Keegan Go, David Zeng, and Jaehyun Park, Stanford undergraduates who helped create and teach the course EE103. We thank David Tse, Alex Lemon, Neal Parikh, and Julie Lancashire for carefully reading drafts of this book and making many good suggestions.
Stephen P. Boyd is the Samsung Professor of Engineering, and Professor of Electrical Engineering at Stanford University with courtesy appointments in the Department of Computer Science, and the Department of Management Science and Engineering. He is the co-author ofConvex Optimization, written with Lieven Vandenberghe and published by Cambridge University Press in 2004.
Lieven ...
(展开全部)
周金涛先生,中国康德拉季耶夫周期理论研究的开拓者。作为大师级的策略分析师,从2008年次贷危机到2016年大宗商品年度反弹,先生对于大级别周期运行脉络的把握可谓...
史欣悦• 君合律师事务所合伙人,环太平洋律师协会理事,国际律师组织Multilaw Academy校长。•《令人心动的offer第二季》带教律师,喜马拉雅职场导...
静水,有故事的创业女性,不认命的追梦人,自由撰稿人,高校兼职财税讲师,育儿工作者。一支笔写尽人间冷暖,陪你把孤单过成勇敢。她说:“不依赖,才能做一个又忙又美的女...
◎编辑推荐“青春是一场远行,我们再也回不去了。”每个人的青春里都有一个V先生,温柔而沉默的他曾陪伴万千少男少女一同成长。寂地以温暖唯美的笔触、天马行空的想象力,...
秦文君,著有长篇小说《男生贾至全传》《小鬼鲁智胜》《小丫林晓梅》《调皮的日子》等作品四百余万字,四十余次在国内及海外获各种儿童文学奖;《家有小丑》《开心女孩》等...
张超,以圆融之道举重若轻,帮助读者解决生活中最常见的棘手问题。出版有《攻心话术》《人脉是设计出来的》《人脉是设计出来的.实战篇》《人脉是设计出来的.关键篇》等作...
精彩摘录当代希腊人很信奉那个大家都熟悉的寓言故事:一个人在鱼群如梭的海边钓鱼,钓到两条就收竿回家,外国游客问,为什么不多
《金色梦乡》是日本知名作家伊坂幸太郎的代表作,获第5届日本书店大奖、第21届山本周五郎奖,日文版销量突破114万册,堺雅人、竹内结子主演同名电影。对于《金色梦乡...
陈坤 演员 主要作品 电影[画皮] 个人随笔集[突然就走到了西藏]等费勇 学者 主要作品 [转念的力量]等本期作者[按字母顺序排列]比尔·波特 作家 翻译家 多...
叶楚桥,热爱传统文化,喜欢唐诗宋词,乐于探寻诗词背后的故事。现为简书签约作者,一点资讯、美篇、百度汉语等多家平台特邀作者,以独特新颖的视角,轻松幽默的语言,生动...
雪球创始人兼董事长,福建省武平县人,1997 年毕业于北京大学,先后在南方报业集团和网易公司工作,2010 年创办雪球,2017年创立了雷石价值基金。雪球作为在...
《3D打印建模:Autodesk 123D Design详解与实战(第2版)》内容简介:本书从实际应用的角度出发,用通俗易懂的语言详细讲解了Autod
精彩摘录我生平最喜欢三样东西春天,阳光,还有十七于是冬季将息,雨季渐停,乌云下越过去。喜欢自己走了十六行。然后是你——引自第1页
世界上最难的事,就是“认识你自己”;世界上最痛的事,就是“分析你自己”;世界上最好的事,就是“看见你自己”。在精神分析的历史上,由分析师记录下来的案例,太多了;...
作者介绍: 吴淼,资深漫画人,毕业于南京艺术学院。《萌芽》杂志唯一签约小说漫画家。05年开始构思塔希里亚世界。06年开始在博客连载。07年开始在接力出版社出版。...
Jodie Moule ,Symplicit公司的联合创始人和负责人,是澳大利亚一位经验丰富的设计咨询师,她专注于用户研究、策略规划和服务设计。她具有心理学背景...
郑永年,现任香港中文大学(深圳)校长讲席教授、全球与当代中国高等研究院院长,华南理工大学公共政策研究院学术委员会主席,上海交通大学政治经济研究院名誉院长。北京大...
作品目录贾平凹:“三毛不是美女,一个高挑着身子,披着长发,携了书和笔漫游世界的形象,年轻的坚强而又孤独的三毛对于大陆年轻
IntheSecondEditionofhisaward-winningbook,GradyBoochdrawsupontherichandvariedresu...
因为剧场的时间安排有误,《暗恋》《桃花源》两个剧组同时在剧场中进行彩排,于是上演了一场啼笑皆非的悲喜剧。《暗恋》讲述了江柳滨和云之凡两个年轻恋人因战争失散,几十...