Data Mining and Materials Informatics: a primer

1 Krishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Data Mining and Materials Informatics: a primerKrishna RajanDepartment of Materials Science and EngineeringNSF Intl. Materials Institute Combinatorial Sciences & Materials Informatics CollaboratoryIowa State UniversityKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 What is data? primary, secondary , derivative sources of dataWhat do we mean by Mining data? data correlations dimensional analysis approachdata correlations data miningWhat can we learn from data Mining ?

2 Classification data Mining databaseshierarchy of datatrends in dataPredictionpredicting structure-property relationshipscomputational informatics vs. computational Materials sciencedata Mining for building databasesOUTLINEK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 INFORMATICS Establish new correlations Identify outliers Enlarge database / virtual libraries Evaluate databases Establish predictionsWhat is it ?Why ? Searching for patterns of behavior among multivariate data sets Can pattern recognition lead to predictions?

3 Krishna RajanKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 COMPLEXITY OF BIOSYSTEMSK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Data + Correlations + Theory = Knowledge-base SimulationsSimulations Combinatorially derived datasetsCombinatorially derived datasets Digital librariesDigital libraries Spectral and imaging librariesSpectral and imaging libraries Machine learning Machine learning Data compressionData compression Pattern recognitionPattern recognition Atomistic based calculationsAtomistic based calculations Continuum based theoriesContinuum based theoriesULTRA LARGE SCALE

4 INFORMATION SPACEI nformatics-BasedDesignINFORMATICS STRATEGYM achine learning toolkit: Classification Prediction Hybrid toolsKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Ideker and Lauffenburger:(2003)INFORMATICS-BASED DESIGN STRATEGIESBIOLOGICAL ANALOGUECRYSTAL STRUCTURE ANALOGUENye (1950)Krishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Statistical ToolsCombinatorial & Spectral LibrariesLatent Variables /Partial Least Squares(PLS)Principal Component Analysis(PCA)Support Vector Machine(SVM) Materials Databases Experimental data Computational deriveddata sets SimulationsAssociation Mining (AM)

5 ClassificationPredictionInput & Output Krishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Requirements Global minima Categorical data Missing / variable data Skewed distributions Large data sets ScalablePitfalls Local minima Categorical data difficult Convergence difficult for large data sets Few outliers can lead to poor performanceMACHINE LEARNING AND Materials DISCOVERYK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 DATA CURATIONKNOWLEDGE DISCOVERYD atabase administration & management thermodynamic, crystallographic & propertydata bases combinatorial experimental dataOracle, Unix, Supercomputing, SQL taxonomy and ontology of materialsscience data data sharing , networking / cyber infrastructureJAVA, HTML, Python object oriented programming language visualization of high dimensional dataData Mining algorithms Clustering analysis Quantitative Structure-Activity Relationships (QSAR)

6 For Materials designDATA REPRESENTATIONDATA STORAGEK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Accelerated insertion of Materials into engineering systems Rapid multiscale design and optimization of Materials properties Establishment of new structure property correlations among large, heterogeneous and distributed data sets Discovery of new chemistries and compounds Formulation and / or refinement of new theories for Materials behavior Rapid identification of critical data and theoretical needs for future problems WHY COUPLE COMPUTATIONAL Materials SCIENCE AND INFORMATICS ?

7 Krishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 OriginalDataTransformedDataPatternsKnowl edgeData WarehousingFeature ExtractionData Mining & VisualizationInterpretationSOFT MODELING vs. HARD MODELINGData basesDimensionalAnalysis and/or TheoryConstitutive EquationsHard modelingHard modelingSoft modelingSoft modelingKrishna RajanKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th200622x22 (484 cells 2500 data points):Silicon nitride descriptorsDATA MAPK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 DIMENSIONALITY REDUCTIONK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 EIGENVALUE DECOMPOSITION eigenvalueeigenvectorIf V is nonsingular.

8 This become the eigenvalue decompositionEigenvalues on the diagonal of this diagonal matrixEigenvectors forming the columns of this matrixSpp =SPP= 1 SPP = Loading Matrix=Eigenvector MatrixEigenvalue MatrixKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 PREDICTIONSPLS Upgradeable linear predictive tool Quadratic and interaction terms :flexibilityCalculate latent factors from original predictor variablesT=XW where T- latent factors, X predictors, W- weightsUse latent factors to predict responseY=TQ+E where Y - responses, Q loadings, E- noise Wmaximizes covariance between Y and TFactorsUTResponsesKrishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 INFORMATICS AND THE PERIODIC TABLEK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti.

9 OH October 15th2006 DATA WAREHOUSINGK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th200602040050001000002000400012305100 2401020246020400500010000020004000123051 0024010202461 2 3 4 5 6 7 88 7 6 5 4 3 2 11. # of atoms/unit cell 2. Valence electron # 3. Electronegativity 4. 1st Ionization potential 5. Atomic radius 6. Melting point 7. Boiling point 8. DensityBIVARIATE MAPSK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006-2-1012-6-4-20246-6-4-20246-2-10 12-6-4-20246-6-4-20246PC1 PC2 PC3PC3 PC2 PC1 SEEKING PATTERNSK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006-4-3-2-1012-3-2-1012345 Scores on PC 2 ( )Scores on PC 3 ( )

10 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58Na, Mg, AlK, Ca, Sc, Ti, V, Cr, Mn, Fe, Co, Ni, Cu, Zn, and GaSr, Y, Zr, Nb, Mo, Tc, Ru, Rh, Pd, Ag, Cd, In, and SnCs, Ba, La, Ce, Pr, Nd, Sm, Eu, Gd, Tb, Dy, Ho, Er, Tm, Yb, Lu, Hf, Ta, W, Re, Os, Ir, Pt, Au, Hg, Tl, Pb, and BiEach cluster represent each row in the periodic tableMENDELEEV SEQUENCINGK rishna RajanTMS / ASM Materials Informatics WorkshopCincinatti, OH October 15th2006 Location of property in loading plot indicates influence of property on PC Atomic weight has no influence on PC1, high influence on PC2 and 3 Clustered properties indicate relationships Electrical and thermal conductivity Melting point and density Molar volume and atomic radius Melting and boiling points, heats of fusion and vaporization.