Hello everyone! I am trying to troubleshoot a problem. I modeled a classification problem. The precision and recall on the test set was 0.94 and 0.60 respectively for class 1.

However, when an out of time test was done, the precision and recall dropped drastically to 0.01 for precision and 0.57 to recall.

Any idea what the problem might be and where best to look.

I tried SVM, Logistic regression, and Random Forest and the result is consistent.