Machine Learning models have demonstrated immense success in making accurate predictions from unobserved data. However, judging performance primarily based on the predictive accuracy of ML models potentially leads to technical debt and other fundamental issues, especially in areas of application such as security, nondiscrimination, customer retention, etc. The objective of this talk is to enlighten the audience about some of the pitfalls in using widely popular ML algorithms and offers some recommendations to address these concerns.