Suppose we are given an embedding of $S^2$ in $\mathbb{CP}^2$ with self-intersection 1. Is there a diffeomorphism of $\mathbb{CP}^2$ which takes the given sphere to a complex line?
Note: I suspect that either it is known that there is such a diffeomorphism, or the problem is open. This is because if there was an embedding for which no such diffemorphism existed, you could use it to produce an exotic 4-sphere. To see this, reverse the orientation on $\mathbb{CP}^2$ then blow down the sphere.
EDIT: for a counter-example, it is tempting to look for the connect-sum of a line and a knotted $S^2$. The problem is to prove that the result cannot be taken to a complex line. For example, the fundamental group of the complement $C$ is no help, since it must be simply connected. This is because the boundary of a small neighbourhood $N$ of the sphere is $S^3$ and so $\mathbb{CP}^2$ is the sum of $N$ and $C$ across $S^3$ and so in particuar $C$ must be simply-connected.
Best Answer
The conjecture that every $S^2 \subseteq \mathbb{C}P^2$ is standard if it is homologous to flat is implied by the smooth Poincaré conjecture in 4 dimensions. It also implies a special of smooth Poincaré that is accepted as an open problem, the case of Gluck surgery in $S^4$. I can't prove or disprove the question of course, but since the question is sandwiched between two open problems, I can "prove" that it is an open problem.
It is easier to consider $\mathbb{C}P^2$ minus a tubular neighborhood of the $S^2$, rather than to "blow it down". The condition on the homology class is equivalent to the condition that the boundary of this tube is $S^3$; the projection to the core is a Hopf fibration. The blowdown consists of attaching a 4-ball to this 3-sphere; let's skip this step. As Joel had in mind, the complement of the $S^2$ is simply connected. In fact, it is a homotopy 4-ball with boundary $S^3$. Thus, Freedman's theorem implies that it is homeomorphic to a 4-ball and smooth Poincaré would imply that it is diffeomorphic to a 4-ball. When it is, this 4-ball is still standard with its Hopf-fibered boundary (the Hopf fibration is unique up to orientation), so the $S^2$ is unknotted.
In the other direction, the $S^2$ could be the direct sum of a standard complex line in $\mathbb{C}P^2$ with a 2-knot $K$ in $S^4$. I argue that in this case, the blowdown is equivalent to the Gluck surgery along $K$. What is a Gluck surgery? It looks like Dehn surgery in 3 dimensions, except with peculiar behavior. The official definition is that you remove a neighborhood of $K$ (which here is $D^2 \times S^2$, not the twisted bundle in Joel's construction), then glue it back after applying the non-trivial diffeomorphism of $S^1 \times S^2$. That diffeomorphism comes from the non-trivial element in $\pi_1(\text{SO}(3)) = \mathbb{Z}/2$. One thing that is peculiar is that the Gluck surgery does not change the homotopy type of its 4-manifold, which is why it produces many candidate counterexamples to smooth Poincaré.
Again, it is easier to think about the closed complement to Joel's $S^2$ than the blowdown. The corresponding version of Gluck surgery is to remove all of $D^2 \times K$, but only glue back a thickened $D^2$ (a 2-handle) along an attaching circle, and not glue back in the remaining 4-ball along the rest of $K$. What is peculiar here is that the attaching circle does not change; it is still a vertical circle in $S^1 \times S^2$. What changes instead is that the framing of the attachment is twisted by 1. (Or it can be twisted by some other odd number, since $\pi_1(\text{SO}(3)) = \mathbb{Z}/2$ and not $\mathbb{Z}$. More prosaically, the "belt trick" lets you change the twisting by an even number.) Anyway, if Joel's sphere is $K$ connect summed with a complex line $L$, then you can represent this crucial 2-handle with another complex line $J$ in $\mathbb{C}P^2$. The question is whether the framing of its attachment to $L$ is odd or even. The fact that a perturbation $J'$ of $J$ intersects $J$ once tells me that the framing is odd. So the result is Gluck surgery.
The old version of this answer was less developed (and at first I made the $\pi_1$ mistake that is corrected in the comments and the edit to the question). But it is still worth noting that there are many open special cases of smooth Poincaré that consist of just one homotopy 4-sphere. Some topologists interpret this as strong evidence that smooth Poincaré is false. Others suppose that we just might not be very good at finding diffeomorphisms with $S^4$. A few examples, including some Gluck surgeries, were shown to be standard only after many years, for instance in this paper by Selman Akbulut.