I've seen copious usage of prepositions like "on" and "over" in mathematical texts with no concrete description of what they mean. Can someone please precisely define these terms for me, as in, what does it really mean when you say "let x be a y on z?
[Math] Meaning of “on” and “over” in mathematics
terminology
Related Solutions
In definitions, it is very common practice to use "if" even though "if and only if" is meant. (Personally, I always use "if and only if" explicitly). So you would not have trouble finding a book that said something like
Definition. A group $G$ is simple if $G$ is nontrivial and whenever $N\triangleleft G$, either $N=\{1\}$ or $N=G$.
But such a definition is meant to be understood to be saying that $G$ is simple if and only if the condition is met.
"Precisely" is asking for a condition that is both necessary and sufficient.
"Exactly when"; "if
...then...and conversely", among others.
So for the first question, one answer could be
They don't have to have anything in common, although a couple of them do. They don't all stem from a single source, and their uses depend on which field you are in.
Generally
In just plain English, the phrase "is characteristic of" means "is a distinguishing feature of." By extension in mathematics, it could be used this way to describe something that completely describes another thing. The generator of a cyclic group is a good example of this, since you can recover the entire group from a single generator.
More generally, mathematicians like to talk about "what characterizes" a certain thing. So, for example, the Artin-Wedderburn theorem is a characterization of the semisimple rings as finite products of matrix rings over division rings. The Ore condition is what characterizes which domains can be densely embedded in division rings.
Special uses
Characteristic subgroups in group theory are very special normal groups. Essentially, they are unmoved by automorphisms of the group. This makes them even more special than normal subgroups.
The characteristic polynomial doesn't describe the matrix, but it does characterize information about the transformation that the matrix represents. Really the particular matrix representation is secondary to the transformation.
Sometimes eigenvectors and eigenvalues are referred to as "characteristic" rather than "eigen." (This also suggests somewhat that "characteristic" is one of those overloaded math terms like "regular" or "normal" that pops up every time someone invents something new.)
The characteristic of a ring is important, but I don't know if I can tell you a single reason why. First of all, there are a lot of theorems that are first proven for characteristic zero. (I'm thinking in particular of some results in group rings.) This is usually because the very basic rings ($\Bbb Z,\Bbb R,\Bbb Q,\Bbb C$) are all characteristic zero, and maybe our intuition is better with them. Ordered fields, which are in some way bound up with our intuition of geometric length, are all characteristic zero too.
When the characteristic is nonzero, things are harder because you have to cope with a kind of (very interesting!) degeneracy. The characteristic 2 case seems like the "least nice" because of its appearance in some geometrically freak cases. Even though I've said "degeneracy" and "freak" now to describe these things, I still want to stress that they are interesting and important. Positive characteristic fields are the natural environment for algebraic coding theory, after all :)
The first time I encountered characteristic functions was in measure theory, where the characteristic function of a set is one which has value $1$ for elements of the set, and value $0$ elsewhere. Perhaps the motivation for calling it "characteristic" is that it clearly distinguishes which points are inside the set and which points are outside the set.
Another use of "character" is the one from representation theory, where you talk about the character afforded by a representation. I'm not aware of the true origins of the term, but I've always thought of it like this. The character of a representation is a distillation of some of the information carried by the representation. The information is distilled into a function from the group into a field. There, you can divine several important characteristics of the group. You might have also derived them directly from the representation, but the character might make things easier.
There is also something I know nothing about called the Euler characteristic which is a topological invariant. "Invariant" could be considered semantically close to "characteristic." They are both often used to describe qualities that are intrinsic to the object.
Best Answer
My general impression is that a foo on $X$ is some kind of function, loosely speaking, with domain $X$ while a foo over $X$ is some kind of function, loosely speaking, with codomain $X$. But these terms don't really have completely precise meanings; you learn how to use them from seeing how other people use them (the same way you learned how to use most of the words you know).