Some confusion about the basis vectors. These questions came from the definition of a basis at the bottom. I'm wondering:
- What the relation is between basis and non-basis vectors. Or put another way, if every single element in the vector space is linearly dependent on the linearly independent basis vectors (they are independent among themselves, but dependent amongst the other vectors). This is based on my understanding of the definition of span and the idea that every vector in the space is a linear combination of the basis vectors (except the basis vectors). I'm visualizing the span as: the basis vectors are all linearly independent, but then they "connect" to every other vector outside of the basis via linear combination. In that sense they reach every other vector, and so span the vector space. Wondering if that is correct.
- If the number of basis vectors is the dimension. Just want to make sure I'm understanding.
- What the relation between a basis and a generating set is.
- A brief intuition on how to think of basis vectors.
A set of elements in a vector space is called a basis if they are:
- Linearly independent.
- And every vector in the vector space is a linear combination of the set (the basis vectors?).
In another perspective, a basis is a linearly independent spanning set.
Formally, a basis $B$ of a vector space $V$ over a field $F$ is a linearly independent subset of $V$ that spans $V$.
A span of a set of vectors in $V$ is the intersection of all subspaces containing that set.
In the definition of free module they compare a basis to a generating set.
Best Answer
Let's talk about vectors of real numbers with two elements in them. The set of these vectors is named $\mathbb{R}^2$. Consider $$\begin{bmatrix}1\\ 0\end{bmatrix} \text{and} \begin{bmatrix}0\\ 1\end{bmatrix}.$$
Can any other two element vector be written as a combination of these two vectors? Yes, it can! Consider any vector $\begin{bmatrix}a\\ b\end{bmatrix}$ for any values $a$ and $b$. $\begin{bmatrix}a\\ b\end{bmatrix}=a\begin{bmatrix}1\\ 0\end{bmatrix} + b\begin{bmatrix}0\\ 1\end{bmatrix}.$ Since any two element vector can be written as a linear combination of these two vectors, and we need both of these vectors, then these vectors form a basis.
Formally, we say that $\left\{\begin{bmatrix}1\\ 0\end{bmatrix},\begin{bmatrix}0\\ 1\end{bmatrix}\right\}$ is a basis of $\mathbb{R}^2$. We could also say that $\left\{\begin{bmatrix}1\\ 0\end{bmatrix},\begin{bmatrix}0\\ 1\end{bmatrix}\right\}$ generates $\mathbb{R}^2$.
What about the vectors $$\begin{bmatrix}1\\ 0\end{bmatrix}, \begin{bmatrix}0\\ 1\end{bmatrix} \text{and} \begin{bmatrix}1\\ 1\end{bmatrix}?$$ We could also write any vector $\begin{bmatrix}a\\ b\end{bmatrix}$ as a linear combination of these three vectors. However, we don't need all three of them. We could just as easily work with just the first two vectors. So the set of these vectors is not a basis of $\mathbb{R}^2$. However, it still generates $\mathbb{R}^2$ because $\text{span}\left(\left\{\begin{bmatrix}1\\ 0\end{bmatrix},\begin{bmatrix}0\\ 1\end{bmatrix},\begin{bmatrix}1\\ 1\end{bmatrix}\right\}\right)=\mathbb{R}^2$. Therefore, the dimension of $\mathbb{R}^2$ is two, because any basis set of $\mathbb{R}^2$ has two vectors in it.
Can we have a basis other than $\left\{\begin{bmatrix}1\\ 0\end{bmatrix},\begin{bmatrix}0\\ 1\end{bmatrix}\right\}$? Yes, we can. Consider $$\begin{bmatrix}1\\ 1\end{bmatrix} \text{and} \begin{bmatrix}0\\ 1\end{bmatrix}.$$ Any vector $\begin{bmatrix}a\\ b\end{bmatrix}$ can be written as a linear combination of these two vectors: $$ a\begin{bmatrix}1\\ 1\end{bmatrix} + (b-a)\begin{bmatrix}0\\ 1\end{bmatrix}=\begin{bmatrix}a\\ b\end{bmatrix}.$$ So $\left\{\begin{bmatrix}1\\ 1\end{bmatrix},\begin{bmatrix}0\\ 1\end{bmatrix}\right\}$ is also a basis of $\mathbb{R}^2$.
Imagine trying to send a vector space through a communication channel. If we had to send every vector then this would be an impossible thing to do because we would need an infinite number of vectors. What could we do instead? If we had a basis for our vector space, we could just send the basis and tell the person on the other end that the vectors we sent are a basis for our vector space. And that's the intuition. A basis is a small set of vectors that completely represents our vector space. In fact, there's no smaller set of vectors that completely represents our vector space.