Digital Image Processing - Columbia University

1 1/29/20081 Digital Image ProcessingELEN E4830 Professors:Shahram EbadollahiLexing Xie1/29/20082 General InformationSpring 2008 Mondays 4:10~6:40pmLocation: Eng. Mudd 1127 Credits: on CVN4:10~5:20 part 15:20~5:30 break5:30~6:40 part 2 Target audience:First year Graduate and Senior level studentsCourse Webpage ~xlx/ee4830/1/29/20083 Staff Lecturers/Staff: Shahram EbadollahiResearch Staff Member, IBM Watson ResearchPhD from Columbia U. EE dept. Lexing XieResearch Staff Member, IBM Watson ResearchPhD from Columbia U. EE dept. TA: Wei Liu1/29/20084 How to reach us? Shahram Ebadollahi E-mail: Office hours: Mondays 3:00~4:00pm Office: 1312 Mudd Lexing Xie E-mail: Office hours: Mondays 3:00~4:00pm Office: 1312 Mudd Wei Liu E-mail: Office hours:TBD Office: 711 CEPSR Mailbox:TBDP lease contact the lecturer of the week for problems/question related to each lecture!1/29/20085 Our research Shahram Ebadollahi Image /Video content understanding Medical imaging informatics Lexing Xie multimedia content analysis, data mining statistical learning and signal Processing in multimedia1/29/20086 Pre-requisites Signals & Systems Linear Algebra Probability If you haven t taken these courses please see us after the class TODAY!

2 1/29/20087 Outline Part I [Shahram Ebadollahi] Course protocol, policy, and all that Introduction to DIP and examples of applications Course outline Brief review of signals and systems Break Part II [Lexing Xie] Introduction to MATLAB for Image Processing Brief review of linear algebra and probability1/29/20088 Course Protocols & Policies1/29/20089 Course textbook Digital Image Processing , 3rdEditionby Gonzalez and Woods, Prentice Hall 2008 (ISBN 9780131687288) Very well written book Broad coverage of the subject Accessible by wide audience Other references: see course web-page!1/29/200810 Assignments 6 assignments Due at: END OF DAY OF CLASS IN TA s MAILBOX OR EMAIL INBOX!(NO EXCEPTIONS) Solutions and graded homeworks will be handed out the week after you hand in your assignments. Types of questions in the assignment: Analytical ExperimentalA problem which require some programming and experimentation. 1) change parameters of an Image Processing algorithm, observe the effect, comment on your findings2) how do you think this Image could be enhanced?

3 Show it! Why this approach?1/29/2008112 Exams Midterm (03/10/2008) 150 minutes Open book Final 3 hours Open book1/29/200812 Grading Policy Homeworks: 30% Midterm: 30% Final: 40% All material will be covered in the final exam1/29/200813 DIP Introduction1/29/200814 Eye Physiology1/29/200815 Eye Physiology & Visual PerceptionRods & Cones Distribution in Retina 6~7 Million Highly sensitive to color Concentrated in Fovea Photopic (day light) vision 75~150 Million Sensitive to low illumination Distributed over Retina Scotopic (dim light) visionPhotoreceptor Cells1/29/200816 Electromagnetic Spectrum & moreGammaX-rayOpticalInfraredRadioCrab Pulsar1/29/200817 Image Image = 2d functionRyxf ),(Ryx ,),().,(),(yxryxiyxf=Illuminationreflect anceFyxf ),(01/29/200818 Image Image = 2d functionRyxf ),(Ryx ,xy),().,(),(yxryxiyxf=Illuminationrefle ctanceFyxf ),(0 YyXx 001/29/200819 Digital Imagexy Discretization Spatial sampling QuantizationZnmf ),(Znm ,)0,0()1,1( NMmn1010 NnMm1),(0 Lnmf0L-1 Picture Element(Pixel, Pel)1/29/200820 Digital Imagexy =)1,1()1,1()0,1()1,1()1,1()0,1()1,0()1,0 ()0,0(NMfMfMfNfffNffff 1/29/200821 Color ImageRGB025502550255R G B 1/29/200822 Digital Image ProcessingLow levelMid level =Pxxxx 21 High level1/29/2008231/29/200824 Digital Image ProcessingLow levelMid level =Pxxxx 21 High levelCommunication & Storage1/29/200825 What are we going to study?

4 Applications: medical, cbir, .. Compression (ch8) Recognition (ch12) Description (ch11) Segmentation (ch10) Image Processing (ch9) Restoration (ch5) Image Transform, Wavelets (ch7) Enhancement in Frequency Domain (ch4) Enhancement in Spatial Domain (ch3& 6) , Color and Multi-band Images (ch3 & 6), Image Fundamentals (ch2): Sensing, Sampling, and Mechanics, Introduction to Image Processing , Introduction to MATLAB study DIP? Image & video is a major communication media An Image is worth 1000 words! In all application domains, Image and video is becoming indispensable WWW, faster computation, more storage, proliferation of Image capture and consumption devices Need for more, better, faster, and more intelligent Image and video analysis It s fun!1/29/200827 Application Domains Consumer domain Storage, tagging, searching,.. Remote sensing Agriculture, Urban growth monitoring, .. Medical CAD, quantification, organization, assisted surgery.

5 Space explorations Image mosaic, Image matching, .. Art Working methods of painters, material used, .. Security Military .. and many more!1/29/200828 Application Domains Consumer domain Storage, tagging, searching,..mountain, snow, buildings, sky1/29/200829 Application Domains Remote sensing Agriculture, Urban growth monitoring, ..Urban growth in Washington between 1973 and 1985[ Image courtesy of NASA/LANDSAT]Multi-spectral imaging1/29/200830 Application Domains Medical CAD, quantification, organization, assisted surgery, ..Color doppler EchocardiogramBrain MRIC ardiac CTTissue MicroscopySpine X-rayBrain PET (Alzheimers)1/29/200831 Application Domains Space explorations Image mosaic, Image matching, ..Panoramic Image built from images taken from mars rover Spirit[ Image courtesy of NASA/JPL/Cornell]1/29/200832 Review of Signals & Systems