Let us assume two samples, A and B, where A are the results obtained with some standard method, and B are the results obtained with a new method, which is not necessarily more accurate, but has additional advantages (eg: lower cost).
So I'm interested in testing if B is "as good as" A, using non-inferiority hypothesis testing, i.e. that
Ho : $A – B >= \delta$
or, equivalently (?)
Ho : $A – \delta >= B$
where $\delta$ is the maximum clinically-acceptable margin of error.
(Please bear with me if my formulation is not perfect. I'm not a statistician; I'm just a researcher trying to statistically get my way out of a paper bag with minimal damage. Suggestions for improvements are welcome.)
I've seen this hypothesis tested with confidence intervals, which I'm weary of using since my sample size is small. Would it be correct to use Student's t-test to test this hypothesis? If no, why not?
Response to sheldon-cooper:
I'm not sure I fully understand what you mean by "the null hypothesis encompasses many values for the mean of one population"
Assuming that testing for Ho: $A >= B$ can validly be tested using Student's two-sample t-test, how does subtracting $\delta$ from $A$ change the validity of the test? In my perhaps naive understanding, you still get two samples from populations with unknown means that we want to test for equivalence, except that one has been artificially penalized.
Best Answer
I think the answer is no. T tests, basically, work as follows. You manipulate your input data to obtain something that (under the null hypothesis) is normally distributed with mean zero. For example, if the null hypothesis is that the data is normally distributed with mean 28, then the manipulation is simply subtracting 28 from the data. For more complex cases (e.g. if there are two populations with the same, but unknown, mean), the manipulation is a bit more involved, but still some manipulation is needed that gives you a normal distribution with zero mean. Once you obtain that, you use the fact that $\frac{N}{s}$ (where $s$ is sample standard deviation) is distributed according to Student t (that's where the t in t-test comes from) to determine confidence.
In your case, the null hypothesis encompasses many values for the mean of one population. I don't see an obvious way to manipulate it into something that has mean zero. For example, if you have paired data and subtract the two populations, you get $X_i - Y_i \sim N(m, \sigma)$ where $m \geq \delta$. You can further subtract $\delta$ to get mean $m \geq 0$. But that still encompasses many possible values of the mean. I don't see how to manipulate it further to get something that has just one possible value of the mean.