Suppose your $k$-regular graph $G$, split in vertex parts $X$ and $Y$, is not 2-connected.
Then there is a vertex $v$ whose removal splits $G$ in at least two connected components. Let $C$ be one of these components.
We'll just count the number of edges in $C$ and run into a problem. Suppose without loss of generality that $v \in Y$. Now, $C$ induces a bipartite graph, say with parts $X' \subset X$ and $Y' \subset Y$. Let $x = |X'|$ and $y = |Y'|$. Also, let $i$ be the number of edges going from $v$ to $C$. We have that $0 < i < k$. It turns out the bounds on $i$ are important, but I'll let you figure out why exactly we must have that.
Let $e_C$ be the number of edges in $C$. We have $e_C = x \cdot k - i$, since every vertex in $X'$ is of degree $k$, but the edges going to $v$ are not in $C$. Also, $e_C = y \cdot k$, since $Y'$ has no edges going out of $C$. Therefore $x \cdot k - i = y \cdot k$ and thus $x - \frac{i}{k} = y$. Since $y$ is the number of vertices in $Y'$, it is an integer, meaning that $i$ is a multiple of $k$. But $0 < i < k$, which makes it impossible.
Note that we never assumed $G$ was a simple graph, and this holds even if we have multi-edges.
EDIT :
I seem to have missed the point of the question, as commented. The specific problem at hand is when $n = 2$. It does look there there are problems in the statement, and that you need n>2. Every definition of vertex-connectivity I came across states that a complete graph of n vertices has connectedness n−1 (even when extended to multigraphs). So the graph you speak would not be 2-connected. I think it's a mistake, and this happens sometimes in the literature with the special cases that are considered 'trivial'.
Let the two parts of the graph be $A$ and $B$ if it is not connected then it contains $k\geq2$ connected components. Each of these connected components contains at least $\frac{n}{4}+1$ vertices in $A$ and at least $\frac{n}{4}+1$ vertices in $B$. So each connected component has at least $\frac{n}{2}+2$ vertices. So if we have $k$ connected components we need $\frac{kn}{2}+2k$ vertices, even for $k=2$ we get $n+4$ vertices. So it is impossible for $G$ to be disconnected.
Best Answer
A bipartite graph only requires that the vertex set can be partitioned into two disjoint sets, say $A$ and $B$, such that every edge in $E$ connects a vertex from one of the sets, to the other. You can have isolated points. If one denotes the bipartite graph by $(A,B,E)$, then formally you will have a different bipartition depending on if you place an isolated vertex in $A$ or in $B$.