Erkut Erdem

Associate Professor

Computer Vision Laboratory (HUCVL)
Dept. of Computer Engineering
Hacettepe University


Office: 112
Address: Beytepe Campus, Ankara, Turkey TR-06800
e-mail: erkut at cs dot hacettepe dot edu dot tr
Phone: +90 312 297 7500 / 147
Fax: +90 (312) 297 7502



My research centers on the areas of computer vision and machine learning. I believe the right algorithms and representations are the ones that take into account the contextual influences. Thus, the research objective that my students and I pursue is to incorporate different kinds of context (spatial, temporal and/or cross-modal) into all levels of visual processing from low to intermediate and high-level vision.

Current research interests: Visual Saliency Prediction, Automatic Image Description, Video/Photoset Summarization, Image Filtering, Image Editing



Hacettepe University
Faculty Member
2010-now
Ecole Nationale
Supérieure des Télécommunications
Post-doctoral Researcher
2009-2010
Middle East Technical University
1997-2008
Ph.D., 2008
M.Sc., 2003
B.Sc., 2001

University of California
Los Angeles
Visiting Researcher
Oct. 2007 - Dec. 2007
Virginia Bioinformatics Institute, Virginia Tech
Visiting Researcher
Jul. 2004 - Aug. 2004

News and highlights

So excited to announce that I am co-affiliated with Koç University and İş Bank Artificial Intelligence Center (KUIS AI) as a research fellow.

I'm looking for motivated MSc/PhD students. Scholarships are available, please send me your CV if interested!

 

[February 2021]: I will be teaching the undergraduate-level course: BBM406 Fundamentals of Machine Learning.

[February 2021]: Our work on dense video captioning has been accepted for publication in Pattern Recognition Letters.

[January 2021]: Our work on learning visually-grounded cross-lingual representations got accepted to EACL 2021.

[October 2020]: Our work on visual story graphs has been accepted for publication in Signal Processing: Image Communication.

[May 2020]: Our ACM TOG paper on manipulating transient attributes of natural scenes was featured on Two Minute Papers.

[January 2020]: Our joint work with the Cognition, Learning and Robotics (CoLoRs) lab at Bogazici University on reasoning about action effects on articulated multi-part objects has been accepted to ICRA 2020.

[November 2019]: Our work on weakly-supervised dynamic saliency prediction has been accepted for publication in Signal Processing: Image Communication.

[October 2019]: Our work on manipulating transient attributes of natural scenes via hallucination has been accepted for publication in ACM Transactions on Graphics.

[September 2019]: Our work about reasoning on procedural data is accepted to CoNLL 2019: "Procedural Reasoning Networks for Understanding Multimodal Procedures".

[April 2019]: I will give a tutorial on "Multimodal Learning with Vision and Language" together with Aykut Erdem at IPTA 2019.

[February 2019]: Our joint work with ICON lab at UMRAM, Bilkent University on multi-contrast MRI synthesis with GANs has been accepted for publication in IEEE Transactions on Medical Imaging.

[December 2018]: I will give a talk on Integrated Vision and Language at ITURO 2019.

[December 2018]: I have received The Young Researcher Award given by Turkish Academy of Sciences.

[August 2018]: Our work on multimodal machine comprehension is accepted to EMNLP 2018: "RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes". Read our paper, download the data, and submit your predictions at our project website.

Curriculum Vitae (as of October 2020)

Selected Publications

  • Belief Regulated Dual Propagation Nets for Learning Action Effects on Articulated Multi-Part Objects,
    A. E. Tekden, A. Erdem, E. Erdem, M. Imre, M. Y. Seker, and E. Ugur, International Conference on Robotics and Automation (ICRA) 2020, Paris, France, May-June 2020
    :: pdf
    :: project page
    :: video

  • Manipulating Attributes of Natural Scenes via Hallucination,
    L. Karacan, Z. Akata, A. Erdem and E. Erdem, ACM Transactions on Graphics, accepted for publication, 2019
    :: pdf
    :: project page (with code)

  • Procedural Reasoning Networks for Understanding Multimodal Procedures,
    M.S. Amac, S. Yagcioglu, A. Erdem, and E. Erdem, The SIGNLL Conference on Computational Natural Language Learning (CoNLL), Hong Kong, November 2019
    :: pdf
    :: project page (with code)

  • Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks,
    S. U. H. Dar, M. Yurt, L. Karacan, A. Erdem, E. Erdem, T. Cukur, IEEE Transactions on Medical Imaging, Vol. 38, No.10, pp. 2375-2388, October 2019
    :: pdf

  • RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipes,
    S. Yagcioglu, A. Erdem, E. Erdem, and N. Ikizler-Cinbis, Conference on Empirical Methods in Natural Language Processing (EMNLP) 2018, Brussels, Belgium, October-November 2018
    :: pdf
    :: project page (with data and leaderboard)

  • Spatio-Temporal Saliency Networks for Dynamic Saliency Prediction,
    C. Bak, A. Kocak, E. Erdem and A. Erdem, IEEE Transactions on Multimedia, 20(7). pp. 1688-1698, July 2018.
    :: pdf

  • Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networks,
    S. U. H. Dar, M. Yurt, L. Karacan, A. Erdem, E. Erdem, T. Cukur, arXiv preprint arXiv:1802.01221, February 2018
    :: pdf

  • Alpha Matting with KL-Divergence Based Sparse Sampling,
    L. Karacan, A. Erdem and E. Erdem, IEEE Transactions on Image Processing, 26(9), pp. 4523-4536, September 2017
    :: pdf

  • Re-evaluating Automatic Metrics for Image Captioning,
    M. Kilickaya, A. Erdem, N. Ikizler-Cinbis and E. Erdem, The 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2017), Valencia, Spain, April 2017
    :: pdf

  • An Objective Deghosting Quality Metric for HDR Images,
    O. T. Tursun, A. O. Akyuz, A. Erdem and E. Erdem, Computer Graphics Forum (Eurographics 2016), 35(2), pp. 139-152, May 2016
    :: project page (with code)
    :: pdf

  • Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures,
    R. Bernardi, R. Cakici, D. Elliott, A. Erdem, E. Erdem, N. Ikizler-Cinbis, F. Keller, A. Muscat, B. Plank, Journal of Artificial Intelligence Research, 55, pp. 409-442, February 2016
    :: pdf

  • Image Matting with KL-Divergence Based Sparse Sampling,
    L. Karacan, A. Erdem and E. Erdem, IEEE International Conference on Computer Vision (ICCV 2015),, Santiago, Chile, December 2015
    :: project page
    :: pdf

  • The State of the Art in HDR Deghosting: A Survey and Evaluation,
    O. T. Tursun, A. O. Akyuz, A. Erdem and E. Erdem, Computer Graphics Forum (Eurographics State-of-the-art Report (STAR) 2015), 34(2), pp. 683-707, May 2015
    :: pdf

  • Structure Preserving Image Smoothing via Region Covariances,
    L. Karacan, E. Erdem and A. Erdem, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2013), Vol. 32, No. 6, November 2013
    :: project page (with code)
    :: pdf

  • Visual saliency estimation by nonlinearly integrating features using region covariances,
    E. Erdem and A. Erdem, Journal of Vision, Vol. 13, No. 4, pp. 1-20, March 2013
    :: project page (with code)
    :: pdf


For a full list of publications, please see the Publications page.

Students

Ph.D. Students

M.Sc. Students

Former Students

Teaching

Current

Undergraduate

Past

Undergraduate

Graduate

image courtesy: iwdrm