ECE 539 Digital Image Processing II - 3 hours credit


Professor: Dr. Scott E Umbaugh Office: Engineering Building, Room EB3037

Phone: 650-2524, 2948 e-mail: sumbaug@siue.edu


Class Format: Lecture and Project. Review lectures and topics of current interest in research areas of image processing, will be presented by the professor and guest lecturers. The students will also participate by presenting journal papers as well as their own term projects.

Description: Topics of current interest in image processing. Applications of image enhancement, image restoration, image reconstruction, multi-dimensional image processing. Group projects.

Objectives: To familiarize the student with current areas of research interest in image processing. Various paper presentations by the professor and students, and seminars by researchers will be used to achieve this goal. The students will become familiar with the literature - journals, magazines, conferences, etc. - in this research area.

Prerequisite: ECE439 or consent of instructor

Reference Text(s): Digital Image Processing, 4th Edition, Gonzalez and Woods, Pearson, 2018; Digital Image Processing and Analysis: Application with MATLAB and CVIPtools, 3rd Edition, SE Umbaugh, Taylor&Francis/CRC Press, 2018

COURSE SCHEDULE

Week

 

Summer

Fall

1

1

Image enhancement review, Meetings with professor for project discussion. Reading: Umbaugh – Chapter 8; Homework: Exercises 19-40, Supplementary exercises 1-6.

1

2

Image restoration review, Image reconstruction seminar; Image reconstruction, radon transform, backprojections, Fourier-slice theorem. Reading: Umbaugh – Chapter 9, Gonzalez & Woods – pp. 362-75, Homework – Umbaugh book; Chapter 9: Exercises 18-33, Supplementary exercises 1-8. NOTE: You can use your own homework on the Quiz

1

3

Work on homework, project research

2

4

One-hour quiz

3

5

Journal paper/project proposal presentations, project meetings

4-5

6-9

Project meetings

6

10

Progress presentations by students, project meetings

7

11-14

Seminars, project meetings

8

15

Project presentations

 

GRADE:

  • 20% Quiz
  • 10% Project proposal and journal paper presentation
  •  5% Progress report presentation, class participation, meetings, notebooks
  • 65% term project – paper (see below), presentation

TERM PROJECT

Term Project: The project may be from one of the active research areas here at SIUE:

1. Skin Lesion Detection and Evaluation

2. Retinal Fundus Image Evaluation

3. Veterinary Thermographic Image Analysis

4. CVIPtools Development

5. Matlab CVIP Toolbox Development

Or a topic of your choice approved by the professor.

You may choose any project relating to image analysis, enhancement or restoration. You are to perform graduate level research in your area of choice and to build on previous work for your project. Projects will be individual or groups of two students.

A paper will be written describing the project and discussing what was learned during the project. The final paper will be about 25 to 50 pages, typed, double-spaced (excluding appendices). Include images in the paper!

Ø  In addition to handing in a paper copy of the report, email me a soft copy of the Word file. Before you send me the file give it a meaningful name that includes your last name(s) and the project title.

Your final paper will conform to the following format:

Paper Format Outline

  • 1. Title page (project title, names, course number, date, etc.)
  • 2. Table of contents with page numbers for: different sections, figures, appendices, etc.
  • 3. Abstract - 1 page or less. Concise description of what is contained in the paper, include brief summary of results.
  • 4. Introduction/Project overview - about 1 to 2 pages.
  • 5. Body of paper. Broken down into sections as required for your part of the project. For example: Background/theory, experimental methods, discussion and analysis of results, program descriptions, etc. Present results using graphs, images, etc., about 10 to 25 pages
  • 6. Summary and conclusions. Summarize any results and draw conclusions as based on these results. About 1 to 4 pages.
  • 7. Suggestions for future work. Include any ideas you have based on your work and conclusions about followup experiments and/or research. 1 to 2 pages.
  • 8. References. Be sure your references are complete. Avoid web sites as references – these come and go – find the source, which is usually a published paper.
  • 9. Appendices - related background information, program listings, etc.

General: reports should be typed, double spaced, pages numbered starting with abstract. The number of pages listed above are only guidelines, do what is necessary, but keep it concise. DO NOT put in plastic folder, simply staple in upper left hand corner.

The students will give a presentation of the project during the last week of the semester.

Grading: The project is worth 65% of your grade, broken down as follows:

  • - 15% Difficulty and complexity
  • - 20% Quality of work and success
  • - 10% Quantity of work
  • - 10% Project paper
  • - 10% Project presentation

Suggested Project Process:

  • 1) Define the project you wish to pursue
  • 2) Library/Internet research for existing algorithms
  • 3) Acquire image database for training and testing
  • 4) Use CVIPtools for preliminary analysis
  • 5) Define C or Matlab function(s), to implement project
  • 6) Code and debug your function(s)
  • 7) Develop your algorithms with training image set
  • 8) Process test images/do the experiments
  • 9) Analyze results using appropriate metrics, tabulate or plot, etc.
  • 10) Write report, include images
  • 11) Demonstration to the class

Class Attendance Policy: Based on University Class Attendance Policy 1I9: It is the responsibility of students to ascertain the policies of instructors with regard to absence from class, and to make arrangements satisfactory to instructors with regard to missed course work. Failure to attend the first session of a course may result in the student’s place in class being assigned to another student.

Class Policies:  If you have a documented disability that requires academic accommodations, please go to Disability Support Services for coordination of your academic accommodations. DSS is located in the Student Success Center, Room 1270; you may contact them to make an appointment by calling (618) 650-3726 or sending an email to disabilitysupport@siue.edu.  Please visit the DSS website located online at: www.siue.edu/dss  for more information.

Students are expected to be familiar with and follow the Student Academic Code. It is included in the SIUE Policies and Procedures under Section 3C2.2.

COVID-19 Pandemic Policies Related to Classroom Instruction (Fall 2020)

Health and Safety

Consistent with the Illinois Board of Higher Education guidance contained in “Safely Launching Academic Year 2020” released on June 23, 2020 and guidelines established by Governor J. B. Pritzker and Restore Illinois, Southern Illinois University Edwardsville has implemented a new policy to help ensure the safety of all students, faculty and employees during the pandemic. The measures outlined below are required and any student who does not comply may be in violation of the COVID-19 People-Focused Health and Safety Policy, as well as the University’s Student Code of Conduct

The full text of the COVID-19 People-Focused Health and Safety Policy can be found here:  https://www.siue.edu/policies/Covid.shtml.

 

Classrooms, Labs, Studios, and Other Academic Spaces

 

While in the classroom, lab, studio, or other academic spaces, students shall practice social distancing measures by maintaining a distance of at least six feet from others in the classroom and wearing a face covering. Extra care should be taken upon entering and leaving the classroom spaces. Classroom furniture should not be rearranged, and furniture that has been taped off or covered should not be used.

 

Students who forget to wear a face mask or face shield will be reminded of their obligation to comply with SIUE’s COVID-19 People-Focused Health and Safety Policy and temporarily asked to leave the class until they are able to conform to the policy.  Students who forget or lose their face coverings may be able to obtain replacements from a friend, a faculty member, or a nearby departmental office. Face coverings are also available for purchase in the Cougar Store (MUC). 

 

Students who refuse to wear a face covering will be asked to leave the classroom and referred to the Dean of Students for non-compliance with community health and safety protocols.  Repeated non-compliance may result in disciplinary actions, including the student being administratively dropped from an on-ground/face-to-face course or courses without refund if no alternative course format is available.

If a student has a documented health condition which makes wearing a face covering medically intolerable, that student should contact ACCESS to explore options with the understanding that ACCESS will not grant accommodations which excuse the need for a face covering while on campus or in the classroom.  ACCESS will work with qualifying individuals to find reasonable alternatives, whenever such solutions are available. Please call or contact the ACCESS Office via email to schedule an online appointment to discuss potential alternatives.  ACCESS office (Student Success Center, Room 1203, 618-650-3726, and myaccess@siue.edu).

General Health Measures

 

At all times, students should engage in recommended health and safety measures, which include:

·         Conducting a daily health assessment.    If you have COVID-19 symptoms, but not yet tested positive, have had COVID-19 close contact exposure, or are COVID-19 diagnosed as presumptive or confirmed positive, stay home and contact your health provider or SIUE Health Service at cougarcare@siue.edu or 618-650-2842.  More information is available on the SIUE COVID-19 website.

·         Frequent washing or disinfecting of hands.

·         Social distancing by maintaining a distance of at least six feet from others.

·         Face masks or face coverings that cover the nose and mouth are required in indoor public spaces regardless of the ability to maintain social distance. Indoor public spaces include common spaces or community settings that anyone can access, such as reception areas with walk-in access, restrooms, hallways, classrooms, teaching and research laboratories, as well as common spaces in residence halls, conference rooms, lobbies, and break rooms.

·         Adhere to directional signs and traffic flow patterns in buildings and offices.  Doors for entering and exiting buildings will be designated. Where multiple doors exist, in and out doors will be marked with “Entrance” and “Exit” signs.
Plans that consider traffic flow in and out of buildings, and within buildings (i.e. stairs, hallways, etc. where possible) will be marked. 

Academic Integrity

Students are reminded that the expectations and academic standards outlined in the Student Academic Code (3C2) apply to all courses, field experiences and educational experiences at the University, regardless of modality or location.  The full text of the policy can be found here: https://www.siue.edu/policies/3c2.shtml.

Recordings of Class Content

Faculty recordings of lectures and/or other course materials are meant to facilitate student learning and to help facilitate a student catching up who has missed class due to illness. As such, students are reminded that the recording, as well as replicating or sharing of any course content and/or course materials without the express permission of the instructor of record, is not permitted, and may be considered a violation of the University’s Student Conduct Code (3C1), linked here: https://www.siue.edu/policies/3c1.shtml.

Potential for Changes in Course Schedule or Modality

As the COVID-19 pandemic continues, there remains a possibility that planned classroom activities will need to be adjusted.  Depending on circumstances and following state-issued recommendations, potential changes include changes in course modality (e.g., transition from face-to-face to online) or in course scheduled meetings.  These changes would be implemented to ensure the successful completion of the course.  In these cases, students will be provided with an addendum to the class syllabus that will supersede the original version.

COMPUTER RESOURCES AVAILABLE

Hardware:

  • 13 Windows imaging workstations, frame grabber and image compression boards
  • HP color scanner, 1200 dpi
  • HP Color Laser Printer
  • Digitizing stations with CCD cameras, zoom and standard lenses, controlled light boxes
  • Sony digital Mavica still/MPEG camera, XGA resolution (768x1024)
  • Canesta’s DP205 3-D camera

Software:

  • CVIPtools: a comprehensive Computer Vision and Image Processing package developed at SIUE – Windows and UNIX
  • MATLAB: CVIP, Image Processing, Neural Network, and Digital Signal Processing Toolboxes
  • PARTEK: Pattern Recognition software with tutorials, comprehensive statistical pattern recognition and some neural network functions - Windows
  • Image databases: Image Databases
  • Microsoft Office, word processing, presentations, etc
  • Microsoft Visual Studio

THE RESEARCH ENGINEER'S NOTEBOOK

NOTE: In ECE 539 you are required to keep a research engineer's notebook which will be reviewed by the professor during group meetings.

INTRODUCTION: The technical notebook is one of the most important tools for any engineering work. This includes: basic research, product development, or engineering design. It is primarily for the researcher's own use, but another person with similar technical background should be able to understand and duplicate any experiment, data, and conclusion, or to prepare a technical report following only the notebook.

There are many reasons to keep an accurate and complete record of your work:

  • to establish the authenticity of the work.
  • to defend patents.
  • to act as a basis for technical reports and articles.
  • to avoid duplication of effort.

The nature of the work and the purpose of the research will influence the content and format of the notebook.

CONTENT REQUIREMENTS: The notebook must be understandable to a person with a comparable technical background. It must be legible. It must be complete; for example, "We got code from book" is NOT an acceptable entry - what code ?, what page ?, what does it do ?, did you have to recompile it ?, etc.

The notebook must answer the following questions:

  • WHAT WAS DONE? This includes the approach to the research problem. Any ideas generated should be included. Algorithmic flowcharts, references used, notes taken, etc. should be included.
  • WHO DID IT? List all those who participate in the project for a given entry, including yourself, at the beginning of each entry. Any corrections or alterations should be initialed.
  • WHEN WAS IT DONE? It must be obvious to any reader when the work was performed. Date all pages and entries; entries that extend beyond one page should be dated on each page. Do not leave blank spaces and NEVER "back-date" entries (NEVER make ANY false entries in your engineering notebook).

General: The typical engineers notebook available in bookstores will be blue, brown or black, is approximately 9" X 12", and has about 100 to 150 pages. The notebook will be bound, never loose-leaf, and the pages should be numbered consecutively, preferably by the printer. For the our purposes you may use spiral notebooks, as long as each page is numbered and each entry is dated.

A neat, organized and complete notebook record is as important as the investigation itself. The notebook is the original record of what was done. It is not a report to be written after completing an investigation. Do not write on scratch paper expecting to transfer it later to the notebook. Use a blue or black non-erasable pen. Errors are not erased, but simply marked through with a single line so that they still can be read - later you may discover that your "error" contains important information.

Leave the first page or two in the notebook blank for a Table of Contents. This is necessary so that your work can easily be referenced. Use only the right-hand, odd-numbered pages for the notebook record. Use the left-hand, even-numbered pages for sketches, rough calculations, and memos to yourself. You may also place diagrams and graphs on the left, opposite corresponding procedures and calculations. Do not leave any blank spaces/pages in the notebook.

Format - Technical Diary

Organization of this format type is left to the engineer. This format is suited to experimental work, design work, and research. The general format and content requirements must be met. Notes, program code, flowcharts, procedures, data, and calculations are blended together logically and chronologically to form a step-by- step diary describing work. Observations and conclusions are entered as they are made, and summarized at the logical end of a section. This format is well suited for research.

Brief Bibliography

Books

  • Digital Image Processing, R.C.Gonzalez & R.Woods, Addison-Wesley, 2002
  • 1. Computer and Robot Vision, R.M. Haralick and L.G. Shapiro, Addison-Wesley, 1992
  • 2. Machine Vision, Jain, Kasturi, Schnuck, McGraw-Hill, 1995
  • 3. Robot Vision, B.K.P.Horn, MIT Press, 1986
  • 4. Computer Vision, D.H.Ballard & C.M.Brown, Prentice Hall, 1982
  • 5. Object Recognition by Computer, W.E.L. Grimson, MIT Press, 1990
  • 6. Syntactic Pattern Recognition: An Introduction, R.C.Gonzalez and M.G.Thomason
  • 7. Pattern Classification and Scene Analysis, R.O. Duda and P.E. Hart, Wiley 1973
  • 8. Pattern Recognition Statistical, Structural and Neural Approaches, R.J Schalkoff, Wiley, 1992
  • 9. Artificial Intelligence: An Engineering Approach, R.J. Schalkoff, McGraw-Hill, 1990
  • 10. Pattern Recognition Engineering, M. Nadler and E.P. Smith, Wiley, 1993
  • 11. Digital Image Processing and Computer Vision, R.J. Schalkoff, Wiley, 1989
  • 12. The Image Processing Handbook, J.C. Russ, CRC Press, 1992
  • 13. Digital Image Processing, K.R. Castleman, Prentice Hall, 1996
  • 14. Digital Image Processing, R.C.Gonzalez & R.Woods, Addison-Wesley, 1992
  • 15. Digital Image Processing, W.K. Pratt, Wiley 1991
  • 16. Fundamentals of Digital Image Processing, A.K. Jain, Prentice Hall, 1989
  • 17. Digital Picture Processing, A. Rosenfeld and A.C. Kak, Academic Press 1982
  • 18. Digital Pictures, A.N. Netravali and B.G. Haskell, Plenum Press 1988
  • 19. Vision in Man and Machine, M.D. Levine, McGraw Hill 1985

Journals

  • 1. IEEE Transactions on Image Processing
  • 2. IEEE Engineering in Medicine and Biology
  • 3. Computer Vision, Graphics and Image Processing (CVGIP)
  • 4. CVGIP: Graphical Models and Image Processing
  • 5. CVGIP: Image Understanding
  • 6. IEEE Transactions on Medical Imaging
  • 7. Computerized Medical Imaging and Graphics
  • 8. IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 9. IEEE Transactions on Computers
  • 10. Pattern Recognition
  • 11. IEEE Transactions on Signal Processing
  • 12. IEEE Transactions on Neural Networks
  • 13. IEEE Transactions on Geoscience and Remote Sensing
  • 14. Photogrammetric Engineering and Remote Sensing
  • 15. International Journal of Remote Sensing
  • 16. Journal of Visual Communication and Image Representation
  • 17. IEEE Transactions on Robotics and Automation
  • 18. ACM Siggraph publications
  • 19. Numerous Conference Proceedings and other journals from:

IEEE - Institute of Electrical and Electronic Engineers

SPIE - The International Society for Optical Engineering

SMPTE - The Society of Motion Picture and Television Engineers

PRS - Pattern Recognition Society

ACM - Association for Computing Machinery