Open Access Open Access  Restricted Access Subscription Access


Julien Letellier, Jens Reinhardt, Peter Scholl, Jürgen Sieck, Michael Thiele-Maas


While not a new concept, Augmented Reality (AR) has gained increasing momentum in the last few years through the widespread propagation of high-performance mobile devices. These powerful handheld devices allow users to see the real world enhanced with computer-generated content anywhere at anytime. This has led to a massive rise of AR technology; large companies and start-ups are adding affordable AR accessories to their product portfolios. In this paper we describe a joint project between our research group and the Konzerthaus Berlin to use AR to enrich the Konzerthaus’ printed media. With the aid of AR, the readers of the seasonal brochure of the Konzerthaus Berlin are given the opportunity to access additional content complementing the brochure. These contents include images, illustrations, audio, video, simple 2D and 3D animations, interactive media as well as 3D objects. The application was implemented using Vuforia and Unity. This is an extended version of the paper presented at the Conference on Culture and Computer Science 2017 [17].


Augmented Reality; Mobile Augmented Reality; Printed Media; Natural Feature Tracking.

Full Text:



C. Perey, “Print and publishing and the future of augmented reality,” Inf. Services and Use, Vol. 31, No. 1-2, pp. 31-38, 2011.

R.T. Azuma, “A survey of augmented reality,” Presence Teleoperators and Virtual Environments, Vol. 6, Issue 4, pp. 355-385, 1997.

D. van Krevelen, R. Poelman, “A survey of augmented reality technologies, applications and limitations,” The International Journal of Virtual Reality, Vol. 9, Issue 2, 2010.

R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, Vol. 21, Issue 6, pp. 34-47, 2001.

Y. Pang, M.L. Yuan, A.Y.C. Nee, S.-K. Ong, K. Youcef-Toumi, “A markerless registration method for augmented reality based on affine properties,” Proceedings of the 7th Australasian User Interface Conference, 50, 2006.

J. Li, M. Slembrouck, F. Deboeverie, “A hybrid pose tracking approach for handheld augmented reality,” Proceedings of the 9th International Conference on Distributed Smart Camera, ICDSC’15, 2015.

T.C. Young, S. Smith, “An interactive augmented reality furniture customization system,” Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, 2016, pp. 662-668.

I. Barandiaran, C. Paloc, M. Graña, “Real-time optical markerless tracking for augmented reality applications,” Journal of Real-Time Image Processing, Vol. 5, Issue 2, pp. 129-138, 2009.

T.W. Kao, H.C. Shih, “A study on the markerless augmented reality for picture books,” Proceedings of the IEEE International Symposium on Consumer Electronics (ISCE), 2013, pp. 197-198.

X. Yang, K.-T.T. Cheng, “Accelerating SURF detector on mobile devices,” Proceedings of the ACM International Conference on Multimedia, 2012, pp. 569-578.

T. Tanikawa, H. Uzuka, T. Narumi, M. Hirose, “Integrated view-input AR interaction for virtual object manipulation using tablets and smartphones,” Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology, ACE’15, 2015.

M. Kovalenko, S. Antoshchuk, J. Sieck, “Visual hand tracking and gesture recognition for human-computer interaction,” Proceedings of the International Conference on Culture & Computer Science, ICCCS’16, 2016.

K. Terajima, T. Komuro, M. Ishikawa, “Fast finger tracking system for in-air typing interface,” Proceedings of the “Extended Abstracts on Human Factors in Computing Systems” CHI EA’09, ACM, April 4-9’2009, pp. 3739-3744.

N. Hagbi, O. Bergig, J. El-Sana, M. Billinghurst, “Shape recognition and pose estimation for mobile augmented reality,” Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality, 2009.

W. Hürst, C. Van Wezel, “Gesture-based interaction via finger tracking for mobile augmented reality,” Multimedia Tools and Applications, Vol. 62, Issue 1, pp. 233-258, 2013.

A. Henrysson, M. Billinghurst, M. Ollila, “Virtual object manipulation using a mobile phone,” Proceedings of the International Conference on Augmented Tele-Existence, 2005, pp. 164-171.

J. Letellier, F. Pfeiffer, J. Reinhardt, P. Scholl, J. Sieck, M. Thiele-Maas, “Enhancement of printed content using augmented reality,” Proceedings of the International Conference “Kultur und Informatik: Mixed Reality”, 2017, pp. 209-226.

M. Billinghurst, A. Clark, G. Lee, “A survey of augmented reality,” Foundations and trends® in Human-Computer Interaction, Vol. 8, Issue 2-3), pp. 73-272, 2015.

M. Fiala, “ARTag, a fiducial marker system using digital techniques,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 2005, vol. 2, pp. 590-596.

E. Peters, B. Heijligers, J. de Kievith, X. Razafindrakoto, R. van Oosterhout, C. Santos, et al., “Design for collaboration in mixed reality: technical challenges and solutions,” Proceedings of the 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES, IEEE), 2016, pp. 1–7.

R. Dörner, W. Broll, P. Grimm, B. Jung, Virtual und Augmented Reality (VR/AR): Grundlagen und Methoden der Virtuellen und Augmentierten Realität, Springer Vieweg, 2014.


  • There are currently no refbacks.