Define a set $A$ to be disconnected iff there exist nonempty relatively open sets $U$ and $W$ in $A$ with $U\cap W = \emptyset$ and $A = U\cup W.$ Define a set $A$ to be connected iff it is not disconnected.(there are many equivalent definitions, but I want to prove this lemma using this one). Prove that if $E$ is connected and $E\subseteq F \subseteq \overline{E},$ then $F$ is connected.
Let $U, W$ be a separation for $F$. Find open sets $O_U$ and $O_W$ so that $U = F \cap O_U$ and $W = F\cap O_W.$ I claim that $E\cap O_U, E\cap O_W$ separate $E$. However, I'm unable to show that $U' = E\cap O_U, W' =E\cap O_W \neq \emptyset$ (I think this should be straightforward, but for some reason, I can't figure this out). Suppose $U' = \emptyset.$ Then $E\cap O_U = \emptyset.$ Since $E \subseteq F = U\cup W = F\cap (O_U \cup O_W)\subseteq O_U\cup O_W,$ we have that $E \subseteq O_W,$ so $E\cap O_W = E\subseteq F\cap O_W = W\subseteq F\subseteq \overline{E}.$ Observe that since $E\cap O_U = \emptyset, F\cap O_U = (F\backslash E)\cap O_U\subseteq F\backslash E.$
Similarly, $W'\neq \emptyset.$ Clearly, $U', W'$ are relatively open in $E$. Suppose $U'\cap W' \neq \emptyset.$ Let $x\in U'\cap W'.$ Then $x\in E\cap O_U\cap O_W \subseteq F\cap O_U\cap O_W = U\cap W = \emptyset,$ a contradiction. So $U'\cap W' = \emptyset.$ Also, $U'\cup W' = (E\cap O_U)\cup (E\cap O_W) = E\cap (O_U \cup O_W)$ and $E\subseteq (O_U \cup O_W),$ so $U'\cup W' = E.$
Best Answer
This follows from the following result:
Theorem: If $Y$ is a connected subset of a topological space $X$, then $\overline{Y}$ is connected.
Here is a short proof
Suppose $\overline{Y}$ is the union of two disjoint clopen sets $A$ and $B$ in $\overline{Y}$. Then $A\cap Y$ and $B\cap Y$ are clopen in $Y$. Hence, either $A\cap Y=\emptyset$ or $B\cap Y=\emptyset$. Suppose $Y\cap B=\emptyset$. Then $Y\subset A$ and so, $\overline{Y}=\overline{A}=A$ since $A$ is closed in $\overline{Y}$. Thus, $B=\emptyset$.
In your case, if $E\subset F\subset \overline{E}$ and $E$ is connected, then the closure of $E$ relative to $F$, given by $\overline{E}\cap F=F$, is connected.