Course Information
About
This advanced undergraduate course is about the fundamentals of computational photography, an emerging new research area which brings together the advancements in computer graphics, computer vision and image processing to overcome the limitations of conventional photography. The course is structured around basic topics such as cameras and image formation, high dynamic range imaging, edge-aware filtering, gradient-domain processing, deconvolution, blending and compositing, visual quality assessment, deep image enhancement, neural rendering.
The main goal of this course is to introduce students a number of different computational techniques to capture, manipulate and enrich visual media. The students are expected to develop a foundational understanding and knowledge of concepts that underly computational photography. The students will also be expected to gain hand-on experience via a set of programming assignments supplied in the complementary BBM 446 Computational Photography Practicum.
The course is taught by Erkut Erdem, and the teaching assistants are Ali Baran Tasdemir and Orhan Demirci.
Time and Location
Lectures: Mondays at 12:40-15:30 (D3)
Practicum: Mondays at 15:40-17:30 (D1)
Reference Books
- Computer Vision: Algorithms and Applications, Richard Szeliski, Second Edition, 2022 (pdf available online).
- Photography (10th edition), Barbara London, Jim Stone, and John Upton, Pearson, 2010
- Computer Vision: A Modern Approach (2nd Edition), David Forsyth and Jean Ponce, Prentice Hall, 2012.
Policies: All work on assignments must be done individually unless stated otherwise. You are encouraged to discuss with your classmates about the given assignments, but these discussions should be carried out in an abstract way. That is, discussions related to a particular solution to a specific problem (either in actual code or in the pseudocode) will not be tolerated.
In short, turning in someone else’s work, in whole or in part, as your own will be considered as a violation of academic integrity. Please note that the former condition also holds for the material found on the web as everything on the web has been written by someone else.
Communication
The course webpage will be updated regularly throughout the semester with lecture notes, presentations, assignments and important deadlines. All other course related communications will be carried out through ed. Please enroll it by following the link https://edstem.org/eu/join/WPjgMn.
Pre-requisites
Good math (calculus, linear algebra, statistics) and programming skills. An introductory course in image processing (BBM413/AIN430), and/or computer vision (BBM416/AIN431) and/or machine learning (BBM406/AIN311) is highly recommended.
Course Requirements and Grading
Grading for BBM444/AIN434 will be based on
- Class participation (5%),
- Course project (done in pairs) (30%),
- Midterm exam (30%), and
- Final exam (35%).
Grading for BBM446 will be based on
- Four assignments (done individually) (25% each).
Schedule
| Date | Topic | Notes |
| Feb 16 | Introduction, Digital photography [slides] | Brian Hayes, Computational Photography, American Scientist 96, 94-99, 2008 |
| Feb 23 | Image formation [slides] | Szeliski, Chapter 2 Forsyth and Ponce, Chapter 1.1 Antonio Torralba and William T. Freeman, Accidental pinhole and pinspeck cameras, CVPR 2012 |
| Mar 2 | Noise and Color | Assg1 out Szeliski, Chapter 2.3, 3.1.2, 10.1 |
| Mar 9 | Exposure and high-dynamic-range imaging | Szeliski, Chapter 10.1, 10.2 |
| Mar 16 | Edge-aware filtering | Assg1 due, Assg2 out Szeliski, Chapter 3.2, 3.3 |
| Mar 23 | Gradient-domain image processing | Course project proposal due Szeliski, Chapter 3.1.3, 3.5.5, 10.4.3 |
| Mar 30 | Focal stacks and lightfields | Assg2 due Szeliski, Chapter 12.1.3, 14.3 |
| Apr 6 | Feedback session on projects | Assg 3 out |
| Apr 13 | Midterm Exam | |
| Apr 20 | Deconvolution, Coded photography | Assg3 due Szeliski, Chapter 3.4.3, 3.4.4, 10.1.4, 10.3 |
| Apr 27 | Deep Learning Basics for Computational Photography | Project progress reports due Assg4 out Szeliski, Chapter 5.1,5.3,5.4 |
| May 4 | Deep Generative Models and their applications | Szeliski, Chapter 5.5.4 |
| May 11 | Visual quality assessment | Assg4 due |
| May 18 | Project presentations, Course wrap-up | Final project reports due |
Resources
Related Conferences
- IEEE International Conference on Computer Vision (ICCV)
- European Conference on Computer Vision (ECCV)
- IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- SIGGRAPH
- SIGGRAPH Asia
- IEEE International Conference on Computational Photography (ICCP)
- Advances in Neural Information Processing Systems (NeurIPS)
- International Conference on Learning Representations (ICLR)
Reference Journals
- ACM Transactions on Graphics (ACM TOG)
- IEEE Transactions on Image Processing (IEEE TIP)
- IEEE Transactions on Multimedia (IEEE TMM)
- IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI)
- International Journal of Computer Vision (IJCV)
- Computer Vision and Image Understanding (CVIU)
- Image and Vision Computing (IMAVIS)
Python Resources
- Python/numpy Tutorial.
- scikit-learn: Machine learning in Python
Linear Algebra
- A Geometric Review of Linear Algebra, by Eero Simoncelli
- An Introduction to Linear Algebra in Parallel Distributed Processing, by M.I. Jordan
Resources for scientific writing and talks
- Notes on writing, by Fredo Durand
- How to write a great research paper, by Simon Peyton Jones (video)
- Small Guide To Giving Presentations, by Markus Püschel
- Giving an effective presentation: Using Powerpoint and structuring a scientific talk, by Susan McConnell (video)
- Writing papers and giving talks, by Bill Freeman (notes)