查看完整版本 : Numerical Linear Algebra 定 Stochastic Processes 黎緊要take 兩個其中一個sequence 黎讀。

22point 2019-9-19 04:00 AM

Numerical Linear Algebra 定 Stochastic Processes 黎緊要take 兩個其中一個sequence 黎讀。

想問讀過ga Ching 會似健議邊個?

narius 2019-9-19 05:52 AM

Both are interesting, useful topics. Whether you should take both of them depends on your goals and aptitude. Sit in both at least, if you don't to do all the work.


Do you have the syllabus and learning objectives. Those will tell you a little more about how much of the class is conceptual and how much is application. Just two titles tell me little. Not everyone teaches these topics the same way.


I am teaching a class now with a bit of stochastic modeling but everything is embedded in a big application, which is very different than just doing the math. In fact ,my students program more than doing math, in this class. 

hoyh 2019-9-19 11:40 AM

[quote]原帖由 [i]22point[/i] 於 2019-9-19 04:00 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=506960811&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
想問讀過ga Ching 會似健議邊個? [/quote]
兩科係兩樣嘢,不過Linear Algebra在數學各層面都是基礎,所以可以先讀。Stochastic涉及隨機考慮。

唔知你讀嘅應用在那方面,不過你可google看一看video略知一二。

Numerical Linear Algebra
[url=https://nptel.ac.in/courses/111107106/]https://nptel.ac.in/courses/111107106/[/url]

Stochastic Processes: Data Analysis and Computer Simulation
[url=https://www.youtube.com/watch?v=hq-otcUbJkY]https://www.youtube.com/watch?v=hq-otcUbJkY[/url]

竹劍 2019-9-19 04:24 PM

[quote]原帖由 [i]22point[/i] 於 2019-9-19 04:00 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=506960811&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
想問讀過ga Ching 會似健議邊個? [/quote]
呢個好睇你將來想向邊個方向進修/或者做邊方面既野.

icantstop 2019-9-19 07:15 PM

[quote]原帖由 [i]22point[/i] 於 19-9-2019 04:00 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=506960811&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
想問讀過ga Ching 會似健議邊個? [/quote]

你pure mathematics 得唔得?

innominate 2019-9-19 07:48 PM

Linear Algebra方便明白machine learning.過來人

竹劍 2019-9-19 09:01 PM

[quote]原帖由 [i]innominate[/i] 於 2019-9-19 07:48 PM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=506999271&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
Linear Algebra方便明白machine learning.過來人 [/quote]
Notes: Numeral Linear Algebra =/= Linear Algebra.

CMCJ 2019-9-21 12:29 AM

路過多口講兩句, 首先 Numerical Linear Algebra and Stochastic Processes 應該係屬於 Applied Math. 注意 Linear Algebra 本身係 Pure Math.
 
Numerical Linear Algebra - 所有 Math courses, 如果見到 Numerical 呢個字, 呢科大既係讀一d點樣用另類方法去解决 Math 問题, 而呢類方法主要係用向工程計算, 例如, 以前無計算機時, 如果想計 sin 53 度, log 15, 咁 Numerical Methods 就可以提供方法去解决呢類問题. 而 Numerical Linear Algebra 就係點樣用另類方法去解决關於 Linear Algebra 既問题, 例如點樣去解 system of equations, 兩三個 variables 就好昜用人手去解, 但 variables 去到十個八個或更多, 就一定要用 computer 去解, 所以近代既 Numerical Methods 發展主要係點樣用 algorithms 去解决 Math 問题. 

Stochastic Processes 本身係屬於 Probability Theory, 在 Statistical Theory 上, 係無絕對 random, 所以點樣 produce 一個 random number 就已經係一個學問, Stochastic Processes 就係有一個 stochastic system 包含一 set 既 sample space, 而每個 sample 都係一個 random value / function, 而呢 set sample space 係會隨時間而改變. Stochastic Processes 所用到既 Pure Math 工具相當多, 例如, calculus, algebra, set theory, 甚至 topology, 所以 Stochastic Processes 係一門幾深既學問, 但應用範圍相當廣闊.

再多口講多句, Machine Learning 其實係 close to Statistics and Algorithms, 多過 Linear Algebra

CMCJ 2019-9-21 12:40 AM

[quote]原帖由 [i]22point[/i] 於 2019-9-19 04:00 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=506960811&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
想問讀過ga Ching 會似健議邊個? [/quote]


如果想有機會應用學到既野, 咁 Stochastic Processes 會好d.
如果想輕鬆一d去讀, 我個入覺得 Numerical Linear Algebra is better.
如果我係你, 我會讀 Stochastic Processes, 因為呢科實在太有用, 對 further study 好有幫助

竹劍 2019-9-21 01:15 AM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 12:40 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507060538&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
如果想有機會應用學到既野, 咁 Stochastic Processes 會好d.
如果想輕鬆一d去讀, 我個入覺得 Numerical Linear Algebra is better.
如果我係你, 我會讀 Stochastic Processes, 因為呢科實在太有用, 對 further study 好有幫助 ... [/quote]
其實numerical linear algebra都好有用, 因為好多field, 舉個例好似ML咁, 都成日有一大堆matrix或者system of equation and etc要solve numberical / 搞optimization.

不過我同意應該讀左stochastic processes先, 因為好多地方會用到.
numerical linear algebra呢D可以等到左grad school, confirm左真係搞algorithm, scientific computing, CSE果類果陣先再讀都唔遲.

CMCJ 2019-9-21 02:21 AM

[quote]原帖由 [i]竹劍[/i] 於 2019-9-21 01:15 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507061419&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]

其實numerical linear algebra都好有用, 因為好多field, 舉個例好似ML咁, 都成日有一大堆matrix或者system of equation and etc要solve numberical / 搞optimization.

不過我同意應該讀左stochastic processes先, 因為好多地方會用到.
numerical linear algeb ... [/quote]



或者可以咁講, 如果你唔用 Mathlab 或者其他既計算工具, 咁 Numerical Linear Algebra 對你泥講會好有用, 但都只係應用在 Linear Algebra 上. 如果你會用 Mathlab 或者其他既計算工具, 咁 Numerical Linear Algebra 對你泥講真係無用, 因為你係唔需要知道 Mathlab 背後點樣解决 system of equations, 你只需知道點樣 formula 關於你個 optimization problem, 然後再 input 所有 equations 去 Mathlab 度計算, 得到结果後再分析你個 problem 解唔解到, 解决 optimization problem 同 Numerical Linear Algebra 無直接關係.


再講假如你唔用 Mathlab 或者其他既計算工具, 决定用自己所學到既 Numerical Linear Algebra 去解决 Linear Algebra 既問題, 咁我會問你既 solution 會唔會好得過 Mathlab? 你花咁多時間去做又係唔係值得呢?

narius 2019-9-21 03:26 AM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 12:29 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507060301&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
再多口講多句, Machine Learning 其實係 close to Statistics and Algorithms, 多過 Linear Algebra [/quote]

Shaking my head. Almost all stats methods are about dimensionality reduction. Stat is much more related to linear algebra than you realized. Heck, I don't teach that at my own undergrad classes.

But still .. you must have seen the matrix formulation of regression, and the collinearity issues in regression is very much related to spans and sub-spaces in the data space. Heck, the whole Principal Component Analysis is basically a big linear algebra exercise.

Stat and LA is not separate like you imply.

narius 2019-9-21 03:32 AM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 02:21 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507062614&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
再講假如你唔用 Mathlab 或者其他既計算工具, 决定用自己所學到既 Numerical Linear Algebra 去解决 Linear Algebra 既問題, 咁我會問你既 solution 會唔會好得過 Mathlab? 你花咁多時間去做又係唔係值得呢?[/quote]

Well, everyone in the business should learn at least one, if not more platforms. (BTW, R or Python would be much better than matlab in terms of library support).

To be fair, even with all the libraries, most platforms only give you the very standard stuff. Any "real" modeling work needs to be developed on your own. But computational considerations depend on the problem. I have small size data set that i will code with a "dumb" algorithm because it is more flexible to change and that saves me time in developing variations.

I also have models with hard coded parameters (i almost never do that) and clever algorithm taking advantage of that because of the huge computational requirement.

It is not a 0 and 1 approach. Most take a while before they can learn do navigate these issues.

CMCJ 2019-9-21 05:44 AM

[quote]原帖由 [i]narius[/i] 於 2019-9-21 03:26 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507063387&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


Shaking my head. Almost all stats methods are about dimensionality reduction. Stat is much more related to linear algebra than you realized. Heck, I don't teach that at my own undergrad classes.
... [/quote]

Linear regression including collinearity is just a part of Statistics. Nonlinear regression is already beyond the scope of Linear Algebra but both linear and nonlinear regressions are just a part of Statistics. However, Other substantial parts of Statistics also need other mathematical tools such as multivariable calculus, probability theory and differential equations etc. I would say yes, linear (multiple or single) regression is much related (I think "related" is not appropriate because Linear Algebra is just a tool for solving linear regression, no one says that a car is related to a screwdriver) to Linear Algebra but Statistics. I agree that Matrix and Determinant are the substantial part of Linear Algebra but linear transformation and solving system of equations are just an introduction to Linear Algebra. Matrix Theory, Topological vector spaces and Multilinear algebra and tensors are beyond your imagination.

I didn't say Statistics is not much related to Linear Algebra. I just said ML is closer to Statistics than Linear Algebra. If someone thinks ML is more related to Statistics and Statistics is more related to Linear Algebra, then ML is more related to Linear Algebra. By the concept of Math, that is transitive. I don't wanna argue that.

CMCJ 2019-9-21 05:53 AM

[quote]原帖由 [i]narius[/i] 於 2019-9-21 03:32 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507063446&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


Well, everyone in the business should learn at least one, if not more platforms. (BTW, R or Python would be much better than matlab in terms of library support).

To be fair, even with all the  ... [/quote]

Mathlab is different from R and Python. Mathlab has CAS (Computer Algebraic system) and it can perform symbolic computation. Can R and Python do the same thing (I don't really know)? I would not compare them directly.

narius 2019-9-21 07:13 AM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 05:53 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507064496&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


Mathlab is different from R and Python. Mathlab has CAS (Computer Algebraic system) and it can perform symbolic computation. Can R and Python do the same thing (I don't really know)? I would not c ... [/quote]

No. But in general, you use the best tool for the task. For data work, people use R & Python. For symbolic work, we use mathematica. BTW, R is faster, though Python has better libraries in certain areas. The two platform also talks to one another.

Matlab (btw, no "h" .. it is matlab .. not mathlab .. mat stands for matrix) is certainly less popular than the other two, in terms of data work, particularly in the silicon valley.

narius 2019-9-21 07:22 AM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 05:44 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507064444&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


Linear regression including collinearity is just a part of Statistics. Nonlinear regression is already beyond the scope of Linear Algebra but both linear and nonlinear regressions are just a part  ... [/quote]

shake head x 2 .. all these math topics are related. You know that the way you solve high order linear differential equations are based on linear algebra, right? Calculus (and you don't even have to go to the vector kind) is also intimately embedded (if you do not like the word relate) to linear algebra. Taylor series expansion is a good example. It decomposes a function into polynomial basis in the hilbert space. Fourier transform decomposes functions into another set of basis. That is all linear algebra.

You really should not look at all these math concepts in isolation. In addition, tensor is really not that big of a deal. Even undergrad can learn tensorflow (the popular tensor software library that is the foundation for deep learning network). Tensors are nothing more than matrices in more than 2 dimensions. Now if you go into tensor calculus, that can get a bit more challenging (not unlike vector calculus) but in general, you do not need that for the common ML/AI applications.

CMCJ 2019-9-21 08:48 AM

[quote]原帖由 [i]narius[/i] 於 2019-9-21 07:22 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507065369&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


shake head x 2 .. all these math topics are related. You know that the way you solve high order linear differential equations are based on linear algebra, right? Calculus (and you don't even have  ... [/quote]

I never heard that Taylor Series, and Fourier Series, Analysis and Transform are Linear Algebra. I never learned them from any linear algebra course. I learned them from Calculus and I saw them on some Numerical Methods books too. No, linear differential equations are not based on linear algebra, especially higher order DE. Yes, we can put a matrix or a vector as x variables in a Taylor Series but it does not mean Taylor Series is Linear Algebra. If so, ok, Linear Algebra is everything, no need to argue that. Yes, Fourier Transform involves Linear Transformation but it does not mean Fourier Transform is Linear Algebra. Fourier Transform should be more than this. As your logic, Series is also Linear Algebra too, right?

I didn't isolate Math Concepts. Mathematics has algebraic and geometry meaning. I can derive algebraic meaning from geometry meaning and versa. They cannot isolate from each other or the system will crash down. That is the characteristic of Math. I just would not enlarge one small part to draw a whole picture or we don't need to divide Mathematics into many different areas. Nice, Tensor Calculus is a bit more challenging for you. Yes, Tensor Calculus can be an undergrad course. No problem, different people have different abilities. You do it your way; I do it my way.

CMCJ 2019-9-21 09:07 AM

[quote]原帖由 [i]narius[/i] 於 2019-9-21 07:13 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507065221&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


No. But in general, you use the best tool for the task. For data work, people use R & Python. For symbolic work, we use mathematica. BTW, R is faster, though Python has better libraries in certain ... [/quote]



I don't know what you're talking about. I didn't recommend OP to use a mathematical tool. I said "如果你會用 Mathlab 或者其他既計算工具". At that moment I wrote this message, I just remembered the tool called 'Matlab'. I didn't google what tools are available, which one is better or even if the name is correct. The point is not the tool, ok? The point is whether OP "决定用自己所學到既 Numerical Linear Algebra 去解决 Linear Algebra 既問題" or not. You talked about R, Python, Mathematica and Silicon Valley, they all are irrelevant to this topic and our discussion.

narius 2019-9-21 09:09 PM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 08:48 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507067281&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]


I never heard that Taylor Series, and Fourier Series, Analysis and Transform are Linear Algebra. I never learned them from any linear algebra course. I learned them from Calculus and I saw them on ... [/quote]

Apparently you did not learn it well enough, or deep enough. Look up Hilbert space and Banach space (essentially the space made up of functions .. it has infinite number of dimensions). A linear differential equation is basically a restriction on the general space and you can solve it by finding its basis. That is why you can turn a high order linear differential equation into a root finding exercise of a polynomial equation.

Just look at the Q&A on this page:

[url]https://math.stackexchange.com/questions/424955/on-the-vector-spaces-of-taylor-series-and-fourier-series[/url]

Heck, have you heard of eigen-functions? That is the basic foundations of quantum mechanics. You know how the Schrodinger's equation (basically a partial differential equation in 3-space & time) is analyzed, right? The perfect example of how a functional space is decomposed into its basis. The eigenvalues are the energy levels. I know for sure that they teach this even in undergrad courses (since my kid just had it) and you don't need to go to grad school to get it.

竹劍 2019-9-21 10:52 PM

[quote]原帖由 [i]CMCJ[/i] 於 2019-9-21 02:21 AM 發表 [url=https://www.discuss.com.hk/redirect.php?goto=findpost&pid=507062614&ptid=28538459][img]https://www.discuss.com.hk/images/common/back.gif[/img][/url]
再講假如你唔用 Mathlab 或者其他既計算工具, 决定用自己所學到既 Numerical Linear Algebra 去解决 Linear Algebra 既問題, 咁我會問你既 solution 會唔會好得過 Mathlab? 你花咁多時間去做又係唔係值得呢 [/quote]
如果仲滿足於用MATLAB去解決問題既水平, 咁自然唔需要讀numerical linear algebra, 因為MATLAB會自己解決左呢個問題.

揀得要去讀呢類既, 多數係本身搞scientific computing, CSE, 或者係high performance computing related既人, MATLAB佢地肯定會嫌慢.
當然, 正正係呢個原因, 所以我先話呢D咁專門既野, 留番PG真係專門揀呢類先去讀, 唔駛UG就咁快去讀住

[[i] 本帖最後由 竹劍 於 2019-9-22 05:25 AM 編輯 [/i]]

CMCJ 2019-9-22 12:48 AM

其實 Taylor Series 好 simple, 我讀 AL 已經學過, f(x) 個 x 係可以係任何野, 有人 input 一d特別野而得到-d特別結果, 咁唔代表 Taylor Series 既本質可以變, Fourier Series 都係一樣. Hilbert Space 只係將 R2, R3 and Rn 推上去 infinite space, 所以 vector space 係 abstract, 唔實用. 如果講 Hilbert Space (not Hilbert Matrix) 就係屬於 Functional Analysis 既野, 已經超越左 Linear Algebra. 正如我講 Riemann Space, 我就係講 Math Analysis, 而唔係 Calculus. 我睇過網友提供既 link, 我認為佢地係講緊 Functional Analysis 既野, 雖然我地可以見到一d Linear Algebra 既 terms, 例如 inner product, vector space etc. 但唔代表佢地講緊 Linear Algebra. Mathematical Spaces 係一樣好悶既野, 我相信好多網友都有同感, 所以唔再多講, 各位請呀!

台風中心的救星 2019-9-24 05:44 PM

我識!

Linear Algebra 係討論點、線、面、空間的數學,有subspace的概念,同有vector、matric的應用。

Stochastic Process 係討論過程的輸出都係隨機變數,X1、X2...Xn 或 Xt,有鞅 Martingale: E(Xt|Xt-1) 係等於 Xt-1同semi等概念,係唸得明明Ito Calculus同build Black Scholes formula等的基本概率模型。

出名的 Brownian Motion 就係有 Bt,Wiener Process 就係 Xt - Xt-1 ~ N(0,1)

Matlab program 則可寫 monte-carlo computing

學數學好好。

:smile_30:

[[i] 本帖最後由 台風中心的救星 於 2019-9-24 05:46 PM 編輯 [/i]]

台風中心的救星 2019-9-24 06:07 PM

體重究竟係咩隨機過程輸出?線性代數的機械輸出?真係難唸,唔知讀咩好?

[[i] 本帖最後由 台風中心的救星 於 2019-9-24 06:11 PM 編輯 [/i]]

22point 2020-1-1 06:00 AM

Stochastic Processes I
Random vectors, multivariate densities, covariance matrix, multivariate normal distribution. Random walk, Poisson process. Other topics if time permits.

Stochastic Processes II
Markov chains in discrete and continuous time, random walk, recurrent events. If time permits, topics chosen from stationary normal processes, branching processes, queuing theory.

Introduction to Numerical Analysis: Linear Algebra
Analysis of numerical methods for linear algebraic systems and least squares problems. Orthogonalization methods. Ill conditioned problems. Eigenvalue and singular value computations. Knowledge of programming recommended

Introduction to Numerical Analysis: Approximation and Nonlinear Equations
Rounding and discretization errors. Calculation of roots of polynomials and nonlinear equations. Interpolation. Approximation of functions. Knowledge of programming recommended.

大概就係兩課GA內容
希望睇完內容有讀過ga ching 可以比下意見先前沒比content 係好難比到意見,唔好意思阿咁多位
頁: [1]
查看完整版本: Numerical Linear Algebra 定 Stochastic Processes 黎緊要take 兩個其中一個sequence 黎讀。