Advanced Topics in Computer and Human Vision

Course Staff :
Shimon Ullman
Ronen Basri
Michal Irani
T.A.:
Eli Shechtman and Tal Hassner

Sun 14.00-16.00, Ziskind 1

Messages
Topics that will be Covered

• Texture synthesis
• Image completion
• Separating style from content
• Semantics of words and pictures
• Multiscale Stochastic Modeling and Estimation
• Space-Time Stereo
• Subspace methods for rigid and non-rigid motions
• Animating human motion
• Fast detection and matching
• Rendering and reconstruction under complex BRDFs
• Kernel methods
• Classification by multiple decision trees

Links of Interest

• March 4, 2003: Below is a preliminary list of topics for the upcoming course. Please note that this is only a preliminary list, topics and lists of papers are not finalized yet, and are subject to changes.
• March 4, 2003: To be added to the mailing list of this course, please contact Eli.
• March 16, 2003 : Please note that papers marked in red are the reading assignments for the week.
• March 17, 2003 : A new topic was added to the list - Multiscale Stochastic Modeling and Estimation.
• March 19, 2003 : The lecture on the 30'th of March will consist of two seperate talks ("Classification..." and "Texture..."). Note that each has its own reading assignment. Please read both papers before the lecture.
• March 23, 2003 : The topics for the first lesson have changed (again) and now only include "Texture synthesis". There is only one reading assignment for this talk.
• March 27, 2003 : Final talk assignmnets and dates are now posted below.
• June 15, 2003 : Note the title and paper changes for the last talk (scheduled for the 22.6.03).

Texture synthesis

Date : 30.3.03
Speakers : Tal Hassner, Zeev Litichever.
Papers:

• A. A. Efros and W. T. Freeman; "Image Quilting for Texture Synthesis and Transfer"; SIGGRAPH 01.
• A. A. Efros and T. K. Leung; "Texture Synthesis by Non-parametric Sampling", ICCV 99.
• J. S. De Bonet; "Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images"; ACM SIGGRAPH Computer Graphics 1997.
• Z. Bar-Joseph, R. El-Yaniv, D. Lischinski, and  M. Werman; "Texture mixing and texture movie synthesis using statistical learning"; IEEE Transactions on Visualization and Computer Graphics, 7(2), 2001, pp. 120-135.
• D. Heeger and J. Bergen; "Pyramid based texture analysis/synthesis"; Computer Graphics, pp. 229-238, SIGGRAPH 95, 1995.

Additional files: Talk slides (zipped PPT). Movie sequences not included. Note - very large file (19,857 KB).
 

Image completion

Date : 6.4.03
Speakers : Lihi Zelnik-Manor and Bernard Sarel
Papers:

• C. Ballester, M. Bertalmío, V. Caselles and G. Sapiro; "Image Inpainting"; SIGGRAPH 2000.
• T.F.Chan, J.Shen; "Mathematical Models for Local Nontexture Inpaintings"; SIAM J. of Applied Mathematics, Volume 62, Number 3, 2002.
• M.M.Oliveira, B.Bowen, R.McKenna, Y.-S.Chang; "Fast Digital Image Inpainting"; VIIP 2001.
• C.Ballester, M.Bertalmio, V.Caselles, G.Shapiro, J.Verdera; "Filling-In by Joint Interpulation of Vector Fields and Gray Levels"; IP2001.
• Iddo Drori.
• D.Zur, S.Ullman; "Filling-in of Retinal Scotomas"; (forthcoming).
• T.Chan, S.H.Kang, J.Shen; "Euler's Elastica and Curvature Based Inpainting" , SIAM J. Appl. Math., April 2001.

Additional Links:
http://www-mount.ee.umn.edu/~guille/inpainting.htm
http://www.math.ucla.edu/~imagers/htmls/inp.html
Additional files: Talk slides and movie sequences (zipped PPT). Note - very large file (23,631KB).
 

Separating style from content

Date : 13.4.03
Speakers : Evgeniy Bart, Dan Levi
Papers:

• A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin; "Image analogies"; In SIGGRAPH'01.
• J. B. Tenenbaum, W. T. Freeman; "Separating style and content with bilinear models";  Neural Computation 12 (6), 1247-1283 (2000).
• I.Drori, D.Cohen-Or, H.Yeshurun; "Example-based Style Synthesis"; CVPR03  (forthcoming).

Additional files: Talk slides, PPT file (13,970KB).
 

Semantics of words and pictures

Date : 27.4.03
Speakers : Gal Zahavi, Ilan Gendelman
Papers:

• K.Barnard, D.Forsyth; "Learning the semantics of words and pictures"; ICCV'2001.
• P.Duygulu, K.Barnard, N.Freitas and D.Forsyth; "Object Recognition as Machine translation: Learning a Lexicon for a Fixed Image Vocabulary"; ECCV'2002.
• K.Barnard, P.Duygulu, D.Forsyth; "Clustering Art"; CVPR'2001.
• D. Keren; "Recognizing Image “Style”and Activities in Video Using Local Features and Naive Bayes"; Pattern Recognition Letters (forthcoming).

Additional files: Talk slides, PPT file (5,436KB).
 

Multi-scale probabilistic methods

Date : 4.5.03
Speakers : Nataliya Makedonska, Marina Ousov-Fridin
Papers:

• J.-M.Laferté, P.Pérez, F.Heitz; "Discrete Markov Image Modeling and Inference on the Quadtree"; IP'2000.
• N.J.Adams, C.K.I.Williams; "Dynamic Trees: Learning to Model Outdoor Scenes"; ECCV'2002.
• C. Bouman, M. Shapiro; "A multiscale random field model for Bayesian image segmentation"; IP'1994.
• W. Irving and P. Fieguth, A. Willsky; "An overlapping tree approach to multiscale stochastic modeling and estimation"; IP'1997.

Additional files: Talk slides, PPT file (1,692KB).
 

Space-Time Stereo

Date : 11.5.03
Speakers : Meital Benrey, Dor Givon
Papers:

• L.Zhang, B.Curless, S.M.Seitz; "Spacetime Stereo: Shape Recovery for Dynamic Scenes"; CVPR'03 (forthcoming).
• Ravi Ramamoorthi; "Space-Time Stereo"; CVPR'2003 (forthcoming).
• Y.Caspi, D.Simakov, M.Irani; "Feature-Based Sequence-to-Sequence Matching", VAMODS (Vision and Modelling of Dynamic Scenes) workshop, with ECCV 2002, Copenhagen.
• J.Davis, R.Ramamoorthi, S.Rusinkiewicz; "Spacetime Stereo : A Unifying Framework for Depth from Triangulation"; CVPR 2003.

Additional files:
 

Subspace methods for rigid and non-rigid motions

Date : 18.5.03
Speakers : Tomer Peled, Gilad Barkan
Papers:

• L.Torresani, D.Yang, G.Alexander, C.Bregler; "Tracking and Modeling Non-Rigid Objects with Rank Constraints"; CVPR 2001.
• L.Torresani, C.Bregler; "Space-Time Tracking"; ECCV 2002.
• C.Bregler, A.Hertzmann, H.Biermann; "Recovering Non-Rigid 3D Shape from Image Streams"; CVPR 2000.
• M. Irani; "Multi-Frame Optical Flow Estimation Using Subspace Constraints"; ICCV'1999.
• M.Irani; "Multi-Frame Correspondence Estimation Using Subspace Constraints", IJCV July-August 2002.
• M.Brand, R.Bhotika; "Flexible flow for 3D nonrigid tracking and shape recovery"; CVPR'2001.
• M.Brand; "Morphable 3D models from video"; CVPR'2001.

Additional files: Talk slides, zipped PPS files (8,079KB)
 

Animating human motion

Date : 25.5.03
Speakers : Simon Adar, Yoram atir
Papers:

K.Pullen, C.Bregler; "Motion Capture assisted Animation: Texturing and Synthesis"; SIGGRAPH 2002.

K.Pullen, C.Bregler; "Synthesis of Cyclic Motions with Texture"; ACM Transactions on Graphics, 2002.

C. K.Liu, Z.Popovic; "Synthesis of Complex Dynamic Character Motion from Simple Animations"; SIGGRAPH 2002.

C.Bregler, L.Loeb, E.Chuang, H.Deshpande; "Turning to the Masters: Motion Capturing Cartoons", SIGGRAPH 2002.

Additional files: Talk slides, PPT file (6,445KB).
 

Fast detection and matching

Date : 1.6.03
Speakers : Yaron Ukrainitz, Boris Epshtein
Papers:

• P.Viola and M.Jones; "Robust Real-time Object Detection"; International Journal of Computer Vision - to appear.
• Yacov Hel-Or and Hagit Hel-Or; "Real Time Pattern Matching Using Projection Kernels"; Submitted to the ICCV,  March 2003 (forthcoming).
• Daniel Keren, Margarita Osadchy, and Craig Gotsman; "Antifaces: A Novel, Fast Method for Image Detection"; PAMI vol. 23, no. 7, july 2001.

Additional files: Talk slides, first part - zipped PPT (2,707KB). Talk slides, second part - zipped PPT (2,051KB).
 

Rendering and reconstruction under complex BRDFs

Date : 8.6.03
Speakers : Uri Bendor, Adi Makmal
Papers:

• A.Hertzmann, S.M.Seitz; "Shape and Materials by Example:A Photometric Stereo Approach"; CVPR'03 (forthcoming).
• Ravi Ramamoorthi and Pat Hanrahan; "Frequency Space Environment Map Rendering"; Computer Graphics (SIGGRAPH 2002 Proceedings).
• D.Wood, D.Azuma, W.Aldinger, B.Curless, T.Duchamp, D.Salesin, W.Stuetzle; "Surface Light Fields for 3D Photography"; SIGGRAPH, 2000.
• Y.Yu, P.Debevec, J.Malik, T.Hawkins; "Inverse Global Illumination:Recovering Reflectance Models of Real Scenes from Photographs"; SIGGRAPH 1999.
• P.Debevec, T.Hawkins, C.Tchou, H.-P.Duiker, W.Sarokin, M.Sagar; "Acquiring the Reflectance Field of a Human Face"; SIGGRAPH 2000.

Additional files: Talk slides - PPT (4,257KB). Algorithm description movie (1,292KB). Synthetic walk through movie (6,819KB).
 

Kernel Methods

Date : 15.6.03
Speakers : Lena Gorelik, Jason Friedman
Papers:

• K.R.Muller, S.Mika, G.Ratsch, K.Tsuda, B.Scholkopf; "An Introduction to Kernel-Based Learning Algorithms"; IEEE Trans on Neural Networks, vol. 12, no. 2, march, 2001.
• C.J.C. Burges; "A Tutorial on Support Vector Machines for Pattern Recognition"; 1998.

Additional files: Talk slides - PPT (1,068KB).
 

Classification by multiple decision trees

Date : 22.6.03
Speakers : Ayelet Akselrod, Eran Shimonovitz
Papers:

• Y. Amit, D. Geman, K. Wilder; " Joint induction of shape features and tree classifiers"; PAMI 1997.
• Y.Freund, R.E. Schapire; "A short introduction to boosting. Journal of Japanese Society for Artificial Intelligence", Journal of Japanese Society for Artificial Intelligence 14(5):771-780, September, 1999.
• T.G  Dietterich; "An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization";

Machine Learning, 40(2):139-158, 2000.
• Y. Amit; "2D Object Detection and Recognition, Models, Algorithms, and Networks"; MIT PRESS, 2002.
• Y. Amit, D. Geman; "Shape quantization and recognition with randomized trees"; Neural computation 1545-1588, 9, 1997.

Additional files: Talk slides - PPT (3,829KB).
Additional references:

• R.E. Schapire, Y.Freund, P.Bartlett, W. Sun Lee. Boosting the margin: A new explanation for the effectiveness of voting methods. The annals of statistics, 26(5): 1651-1686, 1998.
• L.Breiman Bagging predictors, Machine Learning, Vol 24, no. 2, pp.121-167, 1996.
• H. Drucker & C. Cortes, Boosting decision trees. Advances in neural information processing systems 8, 479-485, 1996
• J.R. Quinlan, Bagging, Boosting, & C4.5, Proc. 13th Conf. Artificial Intelligence, 725-730, 1996

Previous Advanced Courses

Advanced Topics in Computer and Human Vision 2002
Advanced Topics in Computer and Human Vision 2001
Statistical methods in Computer Vision 2000

Computer Vision Links :

Computer Vision Group at the Weizmann Institute of Science.
Computer Vision Group weekly seminar. To join the Vision Seminar mailing list, please contact Leah Mory requesting to join seminar13.