This book continues the mission of the previous text by the author, Lectures on Categorical Data Analysis , by expanding on the introductory concepts from that volume and providing a mathematically rigorous presentation of advanced topics and current research in statistical techniques which can be applied in the social, political, behavioral, and life sciences. It presents an intuitive and unified discussion of an array of topics in categorical data analysis, and the emphasis on structure over stochastics renders many of the methods, applicable in machine learning environments and for the analysis of big data. The book focuses on graphical models, their application in causal analysis, the analytical properties of parameterizations of multivariate discrete distributions, marginal models, and coordinate-free relational models. To guide the readers in future research, the volume provides references to original papers and also offers detailed proofs of most of the significant results. Like the previous volume, it features exercises and research questions, making it appropriate for graduate students, as well as for active researchers.