I predict you'll find this logistic regression example with R to be helpful for gleaning useful information from common binary classification problems.

Regression can be used on categorical responses to estimate probabilities and to classify.

We consider the case-control problem with stratified samples and assume a logistic model that does not include terms for strata, i.e., for fixed covariates the (prospective) probability of disease ...

There are many other techniques for binary classification, but logistic regression was one of the earliest developed and the technique is considered a fundamental machine learning skill for data ...