A 95% confidence interval means that 19 times out of 20 (95%), you would expect real measure (i.e. Truth value) to fall within this range of the sample measurement. 1 time out of 20 you would get unlucky with your sample, and the Truth value would fall outside of that range. (Reddit )
The chance that the random interval will contain the true population percentage is called the coverage probability of the interval. Given that The interval is random, because it is centered at the sample percentage, which is random. (berkeley.edu)
A measurement procedure or estimator is said to be biased if, on the average, it gives an answer that differs from the truth.
The average (expected) difference between the measurement and the truth. (i.e. )
For example, if you get on the scale with clothes on, that biases the measurement to be larger than your true weight (this would be a positive bias). The design of an experiment or of a survey can also lead to bias. Bias can be deliberate, but it is not necessarily so. See also nonresponse bias.
What is
Why
Unlikely the point estimate from MLE, this is less arbitary and more accurate. (MIT-Class22)
Used to report the confidence about the point estimates. (ITP p.559)
How
Interpretation:
This means that if you have 100 intervals, 95 of them will contain the true proportion, and 5% will not.
The wrong interpretation : there is a 95% chance that the true value of p will fall between 0.65 and 0.73.
The reason that this interpretation is wrong is that the true value is fixed out there somewhere. You are trying to capture it with this interval. So this is the chance is that your interval captures it, and not that the true value falls in the interval. (libretext)
Suppose we want to use a political poll to estimate the proportion of the population that supports candidate A, or equivalent the probability θ that a random person supports candidate A.