This advanced undergraduate course is about the fundamentals of computational photography, an emerging new research area which brings together the advancements in computer graphics, computer vision and image processing to overcome the limitations of conventional photography. The course is structured around basic topics such as cameras and image formation, high dynamic range imaging, edge-aware filtering, gradient-domain processing, deconvolution, blending and compositing, visual quality assessment, deep image enhancement, neural rendering.
The main goal of this course is to introduce students a number of different computational techniques to capture, manipulate and enrich visual media. The students are expected to develop a foundational understanding and knowledge of concepts that underly computational photography. The students will also be expected to gain hand-on experience via a set of programming assignments supplied in the complementary BBM 446 Computational Photography Practicum.
The course is taught by Erkut Erdem, and the teaching assistant is Ardan Yılmaz.
Lectures: Mondays at 09:40-12:30 (Seminar Hall)
Practicum: Mondays at 16:40-18:30 (D8)
Policies: All work on assignments must be done individually unless stated otherwise. You are encouraged to discuss with your classmates about the given assignments, but these discussions should be carried out in an abstract way. That is, discussions related to a particular solution to a specific problem (either in actual code or in the pseudocode) will not be tolerated.
In short, turning in someone else’s work, in whole or in part, as your own will be considered as a violation of academic integrity. Please note that the former condition also holds for the material found on the web as everything on the web has been written by someone else.
The course webpage will be updated regularly throughout the semester with lecture notes, presentations, assignments and important deadlines. All other course related communications will be carried out through ed. Please enroll it by following the link https://edstem.org/eu/join/Up3fMG.
Good math (calculus, linear algebra, statistics) and programming skills. An introductory course in image processing (BBM413), and/or computer vision (BBM416) and/or machine learning (BBM406) is highly recommended.
Grading for BBM444 will be based on
Grading for BBM446 will be based on
|Feb 27||Introduction, Digital photography [slides]||Brian Hayes, Computational Photography, American Scientist 96, 94-99, 2008|
|Mar 6||Image formation [slides]||Szeliski, Chapter 2
Forsyth and Ponce, Chapter 1.1
Antonio Torralba and William T. Freeman, Accidental pinhole and pinspeck cameras, CVPR 2012
|Mar 13||Noise and Color [slides]||Assg1 out
Szeliski, Chapter 2.3, 3.1.2, 10.1
Forsyth and Ponce, Chapter 3
Michael S. Brown, Understanding the In-Camera Image Processing Pipeline for Computer Visions, CVPR 2016 Tutorial
S.J. Gortler, Chapter 19 (Color) of Foundations of 3D Computer Graphics, MIT Press, 2012
|Mar 20||Exposure and high-dynamic-range imaging [slides]||Szeliski, Chapter 10.1, 10.2
Paul E. Debevec and Jitendra Malik, Recovering High Dynamic Range Radiance Maps from Photographs, SIGGRAPH 1997
Tomoo Mitsunaga and Shree K. Nayar, Radiometric Self Calibration, CVPR 1999
Erik Reinhard et al., Photographic tone reproduction for digital images, CVPR 1999
|Mar 27||Edge-aware filtering||Assg1 due, Assg2 out
Szeliski, Chapter 3.2, 3.3
|Apr 3||Gradient-domain image processing||Course project proposal due
Szeliski, Chapter 3.1.3, 3.5.5, 10.4.3
|Apr 10||Focal stacks and lightfields||Assg2 due
Szeliski, Chapter 12.1.3, 14.3
|Apr 17||Deconvolution, Coded photography||Assg 3 out
Szeliski, Chapter 3.4.3, 3.4.4, 10.1.4, 10.3
|Apr 24||Midterm Exam|
|May 1||No Lecture (National Holiday)||Assg3 due|
|May 8||Convolutional Neural Networks||Project progress reports due
Szeliski, Chapter 5.1,5.3,5.4
|May 15||Deep Generative Models and their applications||Szeliski, Chapter 5.5.4|
|May 22||Visual quality assessment||Assg4 due|
|May 29||Project presentations, Course wrap-up||Final project reports due|