Following David Speyer's suggestion, let $X=\mathbb{C}^2-\{0\}/\lbrace(x,y)\mapsto (2x,2y)\rbrace$
be the standard Hopf surface. The image, $E$, of the $x$-axis is an elliptic curve.
Remove a point of $X-E$ to get $Y$. The second Betti number $b_2(Y)=0$ because it is homeomorphic to $S^3\times S^1-pt$. If $Y$ were Kähler then $\int_E\omega\not=0$,
where $\omega$ is the Kähler form, and this would imply that $b_2(Y)\not=0$.
The main obstruction to existence of Kahler metric (in addition to Lefschetz
SL(2)-action and Riemann-Hodge relations in cohomology)
is homotopy formality: the cohomology ring of a Kahler manifold is related to its de Rham algebra by a chain of homomorphisms of differential graded algebras inducing isomorphisms on cohomology. This is proven by Deligne-Griffiths-Morgan-Sullivan in 1970-ies.
This is a very strong topological condition; for instance, no nilmanifold (except torus) is homotopy formal. There are symplectic nilmanifolds satisfying hard Lefschetz and the rest of Riemann-Hodge conditions for cohomology.
Another obstruction is existence of a positive, exact current. As shown by Peternell, all non-Kahler Moishezon manifolds admit a positive, exact (n-1,n-1)-current, hence they are not Kahler. However, Moishezon manifolds are homotopy formal ([DGMS]), and often satisfy the Riemann-Hodge. This argument
is also used to prove that twistor spaces of compact Riemannian 4-manifolds are not Kahler, except CP^3 and flag space (Hitchin).
The sufficient condition in this direction is obtained by Harvey-Lawson: they proved that a manifold is Kahler if and only if it does not admit an exact (2n-2)-current with positive, non-zero (n-1, n-1)-part.
Finally, Izu Vaisman has shown that any compact locally conformally Kahler manifold (a manifold with Kahler metric taking values in a non-trivial 1-dimensional local system) is non-Kahler.
Also, a complex surface is Kahler if and only if its $b_1$ is even. This was known from Kodaira classification of surfaces, and the direct proof was obtained in late 1990-ies by Buchdahl and Lamari using the Harvey-Lawson criterion.
Best Answer
I think that the easiest example of compact pseudo-Kähler manifold which does not admit any Kähler metric is the Kodaira-Thurston manifold. See for instance the introduction of
Yamada, Takumi, Ricci flatness of certain compact pseudo-Kähler solvmanifolds, J. Geom. Phys. 62, No. 5, 1338-1345 (2012). ZBL1239.53100.