Data Preparation for Data Mining Using SAS
Are you a data mining analyst, who spends up to 80% of your time assuring data quality, then preparing that data for developing and deploying predictive models? And do you find lots of literature on data mining theory and concepts, but when it comes to practical advice on developing good mining views find little “how to information? And are you, like most analysts, preparing the data in SAS?
This book is intended to fill this gap as your source of practical recipes. It introduces a framework for the process of data preparation for data mining, and presents the detailed implementation of each step in SAS. In addition, business applications of data mining modeling require you to deal with a large number of variables, typically hundreds if not thousands. Therefore, the book devotes several chapters to the methods of data transformation and variable selection.
* A complete framework for the data preparation process, including implementation details for each step.
* The complete SAS implementation code, which is readily usable by professional analysts and data miners.
* A unique and comprehensive approach for the treatment of missing values, optimal binning, and cardinality reduction.
* Assumes minimal proficiency in SAS and includes a quick-start chapter on writing SAS macros.
* CD includes dozens of SAS macros plus the sample data and the program for the book's case study.
What people are saying - Write a review
A QUICK START
CHAPTER 5 DATA ACQUISITION AND INTEGRATION
CHAPTER 6 INTEGRITY CHECKS
CHAPTER 7 EXPLORATORY DATA ANALYSIS
CHAPTER 8 SAMPLING AND PARTITIONING
CHAPTER 13 ANALYSIS OF NOMINAL AND ORDINAL VARIABLES
CHAPTER 14 ANALYSIS OF CONTINUOUS VARIABLES
CHAPTER 15 PRINCIPAL COMPONENT ANALYSIS
CHAPTER 16 FACTOR ANALYSIS
CHAPTER 17 PREDICTIVE POWER AND VARIABLE REDUCTION II
CHAPTER 18 PUTTING IT ALL TOGETHER
APPENDIX LISTING OF SAS MACROS
&IDVar &MissPat &TypeVar &var &Xvar algorithms binary binning calculate call symput categorical variables cluster contingency table continuous variables create table CustID data _null_ Data &DSout data mining data preparation data warehouse Database decision tree defined delete dependent variable Description DSin Input distribution DSin Input dataset DSout DSVarMap eigenvalues example extract factor analysis finish the macro frequencies function GiniRatio Header i=1 to &Nvars imputed values left(_N_ likelihood function linear regression logistic regression loop macro variables mapping mend merge methods mining view missing pattern missing values nolist nominal variables number of records ordinal variables outliers output dataset p-value Parameter Description DSin Parameters of macro partitions population principal component proc datasets library=work proc sort proc sql noprint PROC UNIVARIATE procedures quit ratio regression model rollup sample SAS macro scoring view set &DSin split temp_cats temp_freqs Temp_TERM transactions transformation variable name variance VarList VarName
Page i - Sheth Object-Relational DBMSs: Tracking the Next Great Wave, Second Edition Michael Stonebraker and Paul Brown with Dorothy Moore A Complete Guide to DB2 Universal Database Don Chamberlin Universal Database Management: A Guide to Object/Relational Technology Cynthia Maro Saracco Readings in Database Systems, Third Edition Edited by Michael Stonebraker and Joseph M. Hellerstein Understanding...
Page i - Data on the Web: From Relations to Semistructured Data and XML Serge Abiteboul, Peter Buneman, and Dan Suciu Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations Ian Witten and Eibe Frank Joe Celko's SQL for Smarties: Advanced SQL Programming, Second Edition Joe Celko Joe Celko's Data and Databases: Concepts in Practice Joe Celko Developing Time-Oriented Database Applications in SQL Richard T. Snodgrass Web Farming for the Data Warehouse Richard D. Hackathorn...
Page i - Interfaces, & the Incremental Approach Michael L. Brodie and Michael Stonebraker Atomic Transactions Nancy Lynch, Michael Merritt, William Weihl, and Alan Fekete Query Processing for Advanced Database Systems Edited by Johann Christoph Freytag, David Maier, and Gottfried Vossen Transaction Processing: Concepts and Techniques Jim Gray and Andreas Reuter Understanding the New SQL: A Complete Guide Jim Melton and Alan R.
Page i - JDBC, and Related Technologies • Jim Melton and Andrew Eisenberg Database: Principles, Programming, and Performance, Second Edition • Patrick and Elizabeth O'Neil The Object Data Standard: ODMG 3.0 • Edited by RGG Cattell and Douglas K. Barry Data on the Web: From Relations to Semistructured Data and XML • Serge Abiteboul, Peter Buneman...
Page i - Transactional Information Systems: Theory, Algorithms, and Practice of Concurrency Control and Recovery Gerhard Weikum and Gottfried Vossen Spatial Databases: With Application to GIS Philippe Rigaux, Michel Scholl, and Agnes Voisard Information Modeling and Relational Databases: From Conceptual Analysis to Logical Design Terry Halpin Component Database Systems Edited by Klaus R. Dittrich and Andreas Geppert Managing Reference Data in Enterprise Databases: Binding Corporate...
Page i - Philippe Rigaux, Michel Scholl, and Agnes Voisard Information Modeling and Relational Databases: From Conceptual Analysis to Logical Design Terry Halpin Component Database Systems Edited by Klaus R. Dittrich and Andreas Geppert Managing Reference Data in Enterprise Databases: Binding Corporate Data to the Wider World Malcolm Chisholm Data Mining: Concepts and Techniques Jiawei Han and Micheline Kamber Understanding SQL and Java Together: A Guide to...
Page i - Giiting and Markus Schneider Joe Celko's SQL Programming Style Joe Celko Data Mining, Second Edition: Concepts and Techniques Ian Witten and Eibe Frank Fuzzy Modeling and Genetic Algorithms for Data Mining and Exploration Earl Cox Data Modeling Essentials, Third Edition Graeme C. Simsion and Graham...
Page i - Database Transaction Models for Advanced Applications, Edited by Ahmed K. Elmagarmid A Guide to Developing Client/Server SQL Applications, Setrag Khoshafian, Arvola Chan, Anna Wong, and Harry KT Wong The Benchmark Handbook for Database and Transaction Processing Systems, Second Edition, Edited by Jim Gray Camelot and Avalon: a Distributed Transaction Facility, Edited by Jeffrey L. Eppinger, Lily B. Mummert, and Alfred Z. Spector Readings in Object-Oriented Database Systems, Edited by Stanley B. Zdonik...
Page i - ... Modeling Essentials, Third Edition Graeme C. Simsion and Graham C. Witt Location-Based Services Jochen Schiller and Agnes Voisard Database Modeling with Microsft® Visio for Enterprise Architects Terry Halpin, Ken Evans, Patrick Hallock, Bill Maclean Designing Data-Intensive Web Applications Stephano Ceri, Piero...