ADDITION: I have compiled what I think is a definitive collection of listmanias at Amazon for a best selection of books an references, mostly in increasing order of difficulty, in almost any branch of geometry and topology. In particular the books I recommend below for differential topology and differential geometry; I hope to fill in commentaries for each title as I have the time in the future.
If you want to have an overall knowledge Physics-flavored the best books are Nakahara's "Geometry, Topology and Physics" and above all: Frankel's "The Geometry of Physics" (great book, but sometimes his notation can bug you a lot compared to standards).
If you want to learn Differential Topology study these in this order: Milnor's "Topology from a Differentiable Viewpoint", Jänich/Bröcker's "Introduction to Differential Topology" and Madsen's "From Calculus to Cohomology". Although it is always nice to have a working knowledge of general point set topology which you can quickly learn from Jänich's "Topology" and more rigorously with Runde's "A Taste of Topology".
To start Algebraic Topology these two are of great help: Croom's "Basic Concepts of Algebraic Topology" and Sato/Hudson "Algebraic Topology an intuitive approach". Graduate level standard references are Hatcher's "Algebraic Topology" and Bredon's "Topology and Geometry", tom Dieck's "Algebraic Topology" along with Bott/Tu "Differential Forms in Algebraic Topology."
To really understand the classic and intuitive motivations for modern differential geometry you should master curves and surfaces from books like Toponogov's "Differential Geometry of Curves and Surfaces" and make the transition with Kühnel's "Differential Geometry - Curves, Surfaces, Manifolds". Other nice classic texts are Kreyszig "Differential Geometry" and Struik's "Lectures on Classical Differential Geometry".
For modern differential geometry I cannot stress enough to study carefully the books of Jeffrey M. Lee "Manifolds and Differential Geometry" and Liviu Nicolaescu's "Geometry of Manifolds". Both are deep, readable, thorough and cover a lot of topics with a very modern style and notation. In particular, Nicolaescu's is my favorite. For Riemannian Geometry I would recommend Jost's "Riemannian Geometry and Geometric Analysis" and Petersen's "Riemannian Geometry". A nice introduction for Symplectic Geometry is Cannas da Silva "Lectures on Symplectic Geometry" or Berndt's "An Introduction to Symplectic Geometry". If you need some Lie groups and algebras the book by Kirilov "An Introduction to Lie Groops and Lie Algebras" is nice; for applications to geometry the best is Helgason's "Differential Geometry - Lie Groups and Symmetric Spaces".
FOR TONS OF SOLVED PROBLEMS ON DIFFERENTIAL GEOMETRY the best book by far is the recent volume by Gadea/Muñoz - "Analysis and Algebra on Differentiable Manifolds: a workbook for students and teachers". From manifolds to riemannian geometry and bundles, along with amazing summary appendices for theory review and tables of useful formulas.
EDIT (ADDED): However, I would argue that one of the best introductions to manifolds is the old soviet book published by MIR, Mishchenko/Fomenko - "A Course of Differential Geometry and Topology". It develops everything up from $\mathbb{R}^n$, curves and surfaces to arrive at smooth manifolds and LOTS of examples (Lie groups, classification of surfaces, etc). It is also filled with LOTS of figures and classic drawings of every construction giving a very visual and geometric motivation. It even develops Riemannian geometry, de Rham cohomology and variational calculus on manifolds very easily and their explanations are very down to Earth. If you can get a copy of this title for a cheap price (the link above sends you to Amazon marketplace and there are cheap "like new" copies) I think it is worth it. Nevertheless, since its treatment is a bit dated, the kind of algebraic formulation is not used (forget about pullbacks and functors, like Tu or Lee mention), that is why an old fashion geometrical treatment may be very helpful to complement modern titles. In the end, we must not forget that the old masters were much more visual an intuitive than the modern abstract approaches to geometry.
NEW!: the book by Mishchenko/Fomenko, along with its companion of problems and solutions, has been recently typeset and reprinted by Cambridge Scientific Publishers!
If you are interested in learning Algebraic Geometry I recommend the books of my Amazon list. They are in recommended order to learn from the beginning by yourself. In particular, from that list, a quick path to understand basic Algebraic Geometry would be to read Bertrametti et al. "Lectures on Curves, Surfaces and Projective Varieties", Shafarevich's "Basic Algebraic Geometry" vol. 1, 2 and Perrin's "Algebraic Geometry an Introduction". But then you are entering the world of abstract algebra.
If you are interested in Complex Geometry (Kähler, Hodge...) I recommend Moroianu's "Lectures on Kähler Geometry", Ballmann's "Lectures on Kähler Manifolds" and Huybrechts' "Complex Geometry". To connect this with Analysis of Several Complex Variables I recommend trying Fritzsche/Grauert "From Holomorphic Functions to Complex Manifolds" and also Wells' "Differential Analysis on Complex Manifolds". Afterwards, to connect this with algebraic geometry, try, in this order, Miranda's "Algebraic Curves and Riemann Surfaces", Mumford's "Algebraic Geometry - Complex Projective Varieties", Voisin's "Hodge Theory and Complex Algebraic Geometry" vol. 1 and 2, and Griffiths/Harris "Principles of Algebraic Geometry".
You can see their table of contents at Amazon.
Hope this helps... good luck!
First of all, the concept of a "manifold" is certainly not exclusive to differential geometry. Manifolds are one of the basic objects of study in topology, and are also used extensively in complex analysis (in the form of Riemann surfaces and complex manifolds) and algebraic geometry (in the form of varieties).
Within topology, manifolds can be studied purely as topological spaces, but it is also common to consider manifolds with either a piecewise-linear or differentiable structure. The topological study of piecewise-linear manifolds is sometimes called piecewise-linear topology, and the topological study of differentiable manifolds is sometimes called differential topology.
I'm not sure I would necessarily describe these as distinct subfields of topology -- they are more like points of view towards geometric topology, and for the most part one can study the same geometric questions from each of the three main points of view. However, there are questions that only make sense from one of these points of view, e.g. the classification of exotic spheres, and there are certainly topology researchers who specialize in either piecewise-linear or differentiable methods. Differential topology can be found in position 57Rxx on the 2010 Math Subject Classification.
Differential geometry, on the other hand, is a major field of mathematics with many subfields. It is concerned primarily with additional structures that one can put on a smooth manifold, and the properties of such structures, as well as notions such as curvature, metric properties, and differential equations on manifolds. It corresponds to the heading 53-XX on the MSC 2010, and the MSC divides differential geometry into four large subfields:
Classical differential geometry, i.e. the study of the geometry of curves and surfaces in $\mathbb{R}^2$ and $\mathbb{R}^3$, and more generally submanifolds of $\mathbb{R}^n$.
Local differential geometry, which studies Riemannian manifolds (and manifolds with similar structures) from a local point of view.
Global differential geometry, which studies Riemannian manifolds (and manifolds with similar structures) from a global point of view.
Symplectic and contact geometry, which studies manifolds that have certain rich structures that are significantly different from a Riemannian structure.
As a general rule, anything that requires a Riemannian metric is part of differential geometry, while anything that can be done with just a differentiable structure is part of differential topology. For example, the classification of smooth manifolds up to diffeomorphism is part of differential topology, while anything that involves curvature would be part of differential geometry.
Best Answer
You can read Introduction to Topological Manifolds, Introduction to Smooth Manifolds and Riemannian Manifolds by John Lee in that order.