If your background is mathematics only, you can start with the following two books:
1] Ross, S. M. (2012). A First Course in Probability (9th ed). Pearson Education Limited. - Introductory probability theory.
2] Freedman, D., Pisani, R., & Purves, R. (2007). Statistics (4th ed). New York: W. W. Norton & Company. - Introductory statistics.
If you decide to deepen your knowledge, this relatively concise and non-repetitive literature list on statistics, probability and their applications may help (read just the 2nd half of the linked page, called "Textbooks for independent study"; l you do not have to read the rest).