I am really stuck in this problem, I have only 2 days to learn matrix's base, and its generator. My problem is that I know definitions but I don't understand intuitively what they mean.
What I know:
base = vectors which generate the matrix.
generator = vectors which generate matrix, but there are more than enough (unlike in base)
But what is linear independence and dependence? Can you please give me trivial examples where I distinctly see the difference between them. Why dependence? What does it depend on? Why do I call (in)dependent?
Thanks in tons..
Best Answer
Do you remember the stories of treasure maps? We were told that to get to the treasure we needed to take five steps North and three steps East. We can make this mathematical. Let $\vec{n}$ be a step North and $\vec{e}$ a vector East. Then taking five steps North and then three steps East can be written $5\vec{n}+3\vec{e}$. Going South is negative North and going West is negative East: three steps South and then one step West can be written $-3\vec{n}-\vec{e}$.
The vectors $\vec{n}$ and $\vec{e}$ span the treasure map because you can get to any point on the map by going some steps North and some steps East. (Including "negative steps".) In linear algebra speak, the vectors $\vec{n}$ and $\vec{e}$ span the treasure map. Moreover, they are linearly independent: there is no combination of North/South steps that can make up for an East/West step. You need both choices of direction to be able to reach all of the points on the map.
Let me introduce a new movement: a diagonal step $\vec{d}$. (Imagine this as a movement to the North-East direction.) Sure, $\vec{n}$, $\vec{e}$ and $\vec{d}$ still span the treasure map; $\vec{n}$ and $\vec{e}$ did that without $\vec{d}$'s help. However, these are not linearly independent. Adding $\vec{d}$ does not help me to get to points on the map that I couldn't have otherwise got to. For example, a diagonal step can be done by making a partial step to the North and a partial step to the East. Mathematically:
$$\vec{d} = \frac{1}{\sqrt{2}}\vec{n} + \frac{1}{\sqrt{2}}\vec{e} \, . $$
Generally: a set of vectors span a space if a mixture of them allows you to "get to" each point of the space. They are linearly independent if you need all of them to do that, i.e. taking one away (e.g. not being able to move North) will stop you doing this. They are linearly dependent if you have more possibilities than you need, e.g. having a diagonal step when a small North and small East step will do the job.