Welcome to the Computer Vision and Multimedia Lab website.GET IN TOUCH
- 3D models of fantastic animals
- Tactile version of Lucania ’61
- Occhio all’Arte!
- Virtual reconstruction of the "Arca di Sant'Agostino"
- Virtual reconstruction of Pavia in the XVI century
- Writing analysis of Stradiviari's relics
- 3D design and reproduction of the first stone laid for the Certosa of Pavia
- Tactile image of the painting "Christ and the Samaritan woman"
- Image processing and 3D modeling of historical musical instruments
- 3D reconstructions, applications for eye and gesture human-computer interaction, and tactile images
- Virtual reconstruction of the "Macchina Vasariana"
- CD-rom “Pavia città d’arte”
- >> publications
Digital Humanities projects / Progetti in ambito Beni Culturali
Here follows a brief description of the activities carried out for promotion, dissemination and accessibility of cultural heritage.
The laboratory has several models of eye-trackers, useful both for gaze-based computer interaction and for the study of methods of observation of different types of stimuli (including artworks).
Here is a list of Digital Humanities projects:
> 3D models of fantastic animals (2019): 3D transposition of the drawings made by the young patients of the pediatric oncohematology departments of the Policlinico San Matteo. The designed fantastic hybrid creatures will be printed in 3D and given to the little authors to be painted and finally exhibited in the hospital aisles and rooms. This activity is part of the project "Colla d'Oro" / "Golden glue", promoted by Prof. Andrea Pietrabissa (director DEA - Policlinico San Matteo), and comes from the Japanese technique kintsugi, which uses pure gold paste to repair broken ceramic objects. The older boys (10 years and older) will in fact be engaged in painting 3D heads, under the supervision of volunteer art teachers. The basic idea is that scars are not hidden, but exhibited in such a way that when repaired they acquire even greater value.
> Tactile version of Lucania ’61 (2019), the canvas that Carlo Levi painted to describe the Basilicata region and to honor the Lucan friend Rocco Scotellaro. The large canvas (18.50 meters x 3.20 meters) is kept in the Levi Room of the National Museum of Medieval and Modern Art in Matera. The artwork was commissioned by the Committee for the Celebrations of the Centenary of the Unity of Italy to represent Basilicata at the Italia 61 exhibition (Turin, May 1961). The 3D model for the tactile version will be printed and displayed in Matera.
> Occhio all'Arte! (2019). Contract for research activities related to the PROTOLAB project, funded by Confindustria Pavia, for the technology transfer between universities and companies, concerning the creation of an ocular interaction system to "explore" images of works of art. It will be presented at the end of December 2019 in Matera, during the closing ceremonies of "Matera European Capital of Culture 2019". The project proposes an alternative way of using "augmented content" applied to cultural heritage, through the use of an "eye tracker". The innovative interaction modality allows the user to choose which parts to scan and when, and to enjoy various contents without the need to use hands or other input devices (such as mouse). This makes the interaction more intuitive and engaging, as well as having an undoubted relevance in the context of assistive technologies.
> Image processing and 3D modeling of historical musical instruments. Activity in progress since 2014 in collaboration with Arvedi Laboratory of Non Invasive Diagnostics of University of Pavia, located inside Museo del Violino of Cremona (Italy). The objective is the analysis of surface and morfology of historical musical instruments, with a special focus on violins and other string musical instruments held in the museum. Histrorical violins are a very unique kind of artworks since are both preserved in museums and also played. The multiple restorations occurred during centuries to maintain the instruments in use have created a very complex surface, hard to correctly interpret. Main tracks of this project include: analysis of UV Induced Fluorescence (UVF) images; 3D scan and modelling; Human-Comptuter Interaction (HCI) applications for scientific dissemination.
> Virtual reconstruction of the "Arca di Sant'Agostino" (2019) made with 3D models realized by the students of the Computer Vision course - academic years 2017/2018 and 2018/2019 - of the Master's degree in Computer Engineering of the University of Pavia (Italy).
> DAFNE (2019). The international Digital Anastylosis of Frescoes challeNgE (DAFNE) concerned with collecting outstanding contributions to the field of Anastylosis. The goal was to develop tools enabling digital reconstruction of heavily damaged frescoes, supporting their restoration through the solution of the ‘puzzles’ formed by the remaining fragments, often mixed with spurious elements. The Computer Vision and Pattern Recognition communities were involved in the project, for the application of advanced computer techniques, such as machine learning and deep learning, to the development of adequate IT tools. The challenge could be approached in two different ways: 1) with an automatic approach, aimed at identifying a digital process for the reconstruction of a sort of complex and incomplete puzzle; 2) with a manual approach, to allow the inclusion of people who "think through images", that, using a specially developed software could move the fragments images 'by hand' and get the corresponding coordinate table (the condition of visual thinking is relatively widespread within the autistic spectrum). Twenty-eight teams (altogether 52 people) enrolled in the competition, with participants from eight different countries (Brazil, Bulgaria, France, Germany, Italy, Portugal, United Kingdom, United States). Nine different solutions were received (from 17 people, grouped into three teams of two people, a team of three, a team of four, and four individual).
> Virtual reconstruction of Pavia in the XVI century (2018) made with 3D models realized by the students of the Computer Vision course - academic years 2015/2016 and 2016/2017 - of the Master's degree in Computer Engineering of the University of Pavia (Italy). Pictures: 1) the city of Pavia in the XVI century, a 3D reconstruction of the whole city and 2) some 3D models of specific monuments
> Writing analysis of Stradiviari's relics. Activity carried out from 2016 to 2018 in collaboration with Arvedi Laboratory of Non Invasive Diagnostics of University of Pavia, located inside "Museo del Violino" of Cremona (Italy). The goal was studying the working notes present on Antonio Stardivari's relics, a collection of artifacts, technical drawings and wood molds used by the famous violin maker between the 17th and the 18th century, currently held in "Museo del Violino".
> 3D design and reproduction of the first stone laid for the Certosa of Pavia (2016) taken from a panel of the sanctuary's portal. The project is the degree thesis in Electronic and Computer Engineering (a.y. 2015/16) of Pavesi Bianca, entitled "Modelling, rendering and 3D printing of characters and scenes of the cultural heritage of Pavia: the first stone laid for the Certosa", supervisor: Virginio Cantoni, co-supervisors: Alfredo Brega and Manola Dettori. The 3D printing is for the Visconti Documentation Center at the Belgioioso castle, where it will also be useful for educational initiatives.
> Tactile image of the painting "Christ and the Samaritan woman" by Annibale Carracci (2016): it is located, beside the original artwork, at the Pinacoteca of Brera in Milan (Italy), in Room XXVIII. It was made in collaboration with the Institut of Information and Communication Technologies of the Bulgarian Academy of Sciences and the staff of the Educational Services of the Pinacoteca of Brera, and it was shown the first time on the 9th of November 2016 to associations and organizations of blind and low vision people.
> 3D reconstructions, applications for eye and gesture human-computer interaction, and tactile images (2015) for the exhibition “1525-2015. Pavia, the Battle, the Future. Nothing was the same again”, satellite even of Expo 2015, held at the Visconti Castle in Pavia, from the 14th of June to the 15th of November 2015: multimedia and multimodal applications for an exhibition path in which art, science and technology meet. Pictures: some 3D printing of 3D reconstructions of characters/objects depicted in seven ancient tapestries of the Battle of Pavia
> Virtual reconstruction of the "Macchina Vasariana" (2004): a 3D printed scale reproduction was exhibited as element of a tactile path for blind and visually impaired people at the event “Abilitando, where technology meets disability”, held the 25-26 of September 2015 at the Monumental Complex of Bosco Marengo (Italy).
> CD-rom “Pavia città d’arte” (Pavia city of art) (2000): the virtual visitor has the chance to see urban and architectural views and landscapes of the "old Pavia", in four thematic itineraries, with music and narrated text, videos, images, QTVR virtual reconstructions and textual descriptions.
- V. Cantoni, M. Mosconi, A. Setti (2020). Javastylosis: a tool for computer-assisted chromatic and semantics based anastylosis of frescoes, in CompSysTech’20 Proceedings, 21st International Conference on Computer Systems and Technologies, 19-20 June 2020, University of Ruse, Bulgaria, ACM International Conference Proceeding Series, ACM Digital Library, (accepted, to appear).
- F. Auricchio, V. Cantoni, G. Caserta, L. Lombardi, S. Marconi, M. Mosconi, R. Nour, A. Pietrabissa, M. Pini, A. Setti (2020). Channeling Artwork Content for Visually Impaired People, in V. Cappellini (a cura di), Electronic Imaging & the Visual Arts. Eva 2020 Florence, (accepted, to appear).
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli (2019). Segmentation of Multi-temporal UV-Induced Fluorescence Images of Historical Violins, in Cristani M., Prati A., Lanz O., Messelodi S., Sebe N. (eds.), New Trends in Image Analysis and Processing, ICIAP 2019. Lecture Notes in Computer Science, vol 11808, pp. 81-91, Springer, Cham, print ISBN: 978-3-030-30753-0, online ISBN: 978-3-030-30754-7, DOI:10.1007/978-3-030-30754-7_9
- Virginio Cantoni, Luca Lombardi, Giovanna Mastrotisi, Alessandra Setti (2019). Digital Anastylosis of Frescoes challenge (DAFNE), 35° convegno internazionale SCIENZA E BENI CULTURALI.2019, Il patrimonio culturale in mutamento. Le sfide dell'uso, Giornate di studi internazionali, Bressanone, 01-05 luglio 2019, Arcadia Ricerche ed., pp. 1067-1075, ISBN 978-88-95409-23-8
- Virginio Cantoni, Mauro Mosconi, Alessandra Setti (2019). Technological innovation and its enhancement of cultural heritage, 2019 IEEE International Symposium on INnovations in Intelligent SysTems and Applications (INISTA), Sofia, Bulgaria, 3-5 July 2019, ISBN: 978-1-7281-1862-8, DOI:10.1109/INISTA.2019.8778378
- Alireza Rezaei, Emanuel Aldea, Piercarlo Dondi, Marco Malagodi, Sylvie Le Hégarat (2019). Detecting alterations in historical violins with optical monitoring, Proc. SPIE 11172, Fourteenth International Conference on Quality Control by Artificial Vision, 1117210 (16 July 2019), DOI:10.1117/12.2521702
- Piercarlo Dondi, Luca Lombardi, Marco Porta, Tommaso Rovetta, Claudia Invernizzi, Marco Malagodi (2019). What do luthiers look at? An eye tracking study on the identification of meaningful areas in historical violins, Multimedia Tools and Applications, Vol. 78, Issue 14, pp. 19115-19139, DOI: 10.1007/s11042-019-7276-2
- Virginio Cantoni, Luca Lombardi, Giovanna Mastrotisi, Alessandra Setti (2019). The DAFNE Project: Human and Machine Involvement, in V. Cappellini (a cura di), Electronic Imaging & the Visual Arts. Eva 2019, pp. 24-31, Firenze University Press, ISBN (online PDF): 978-88-6453-707-8
- Virginio Cantoni, Piercarlo Dondi, Luca Lombardi, Alessandra Setti (2019). Teaching Computer Graphics through a Digital Humanities project, IEEE Computer Graphics and Applications, Volume 39, Issue 2, pp. 89-94, DOI:10.1109/MCG.2019.2895487
- Virginio Cantoni, Luca Lombardi, Alessandra Setti, Stanislav Gyoshev, Dimitar Karastoyanov, and Nikolay Stoimenov (2018). Art masterpieces accessibility for blind and visually impaired people, in Miesenberger K., Kouroupetroglou G. (eds), Computers Helping People with Special Needs. ICCHP 2018, Lecture Notes in Computer Science, vol 10897, Springer, Cham, Proceedings of the 16th International Conference on Computers Helping People with Special Needs (ICCHP 2018), July 11-13, 2018, Linz, Austria, pp. 267-274, DOI:10.1007/978-3-319-94274-2_37, Print ISBN 978-3-319-94273-5, Online ISBN 978-3-319-94274-2
- Stanislav Gyoshev, Dimitar Karastoyanov, Nikolay Stoimenov, Virginio Cantoni, Luca Lombardi, and Alessandra Setti (2018). Exploiting a graphical Braille display for art masterpieces, in Miesenberger K., Kouroupetroglou G. (eds), Computers Helping People with Special Needs. ICCHP 2018, Lecture Notes in Computer Science, vol 10897, Springer, Cham, Proceedings of the 16th International Conference on Computers Helping People with Special Needs (ICCHP 2018), July 11-13, 2018, Linz, Austria, pp. 237-245, DOI:10.1007/978-3-319-94274-2_33, Print ISBN 978-3-319-94273-5, Online ISBN 978-3-319-94274-2.
- Virginio Cantoni, Mauro Mosconi, Alessandra Setti (a cura di) (2018). Ricostruzione virtuale di Pavia nel XVI secolo / Virtual Reconstruction of Pavia in the 16th century, Pavia University Press, ISBN: 978-88-6952-085-3.
- Piercarlo Dondi, Luca Lombardi, Irene Rocca, Marco Malagodi, Maurizio Licchelli (2018). Multimodal workflow for the creation of interactive presentations of 360 spin images of historical violins, Multimedia Tools and Applications, Springer Science+Business Media, LLC, part of Springer Nature 2018, Springer US, November 2018, Volume 77, Issue 21, pp. 28309–28332, Print ISSN: 1380-7501, Online ISSN: 1573-7721, DOI:10.1007/s11042-018-6046-x
- Piercarlo Dondi, Alessandro Danani, Luca Lombardi, Marco Malagodi, Maurizio Licchelli (2018). Handwriting identification of short historical manuscripts, Proceedings of DAS2018 - 13th IAPR International Workshop on Document Analysis Systems, Vienna, Austria, 24-27 April 2018, DOI:10.1109/DAS.2018.45.
- Virginio Cantoni, Piercarlo Dondi, Luca Lombardi, Nahumi Nugrahaningsih, Marco Porta, Alessandra Setti (2018). A Multi-Sensory Approach to Cultural Heritage: The Battle of Pavia Exhibition, in IOP Conference Series: Materials Science and Engineering, vol. 364, conference 1, number 012039, Proceedings of Florence Heritech, Florence 16-18 May 2018, DOI:10.1088/1757-899X/364/1/012039
- Virginio Cantoni, Mauro Mosconi, Alessandra Setti, Haochen Wang (2018). Le nuove tecnologie multimediali nelle Digital Humanities insegnate con un approccio di experiential learning, in La formazione nell’era delle Smart City. Esperienze ed orizzonti, a cura di Elena Caldirola e Giuseppe Pirlo, Cisalpino - Monduzzi Editoriale, pp. 451-465, DOI:10.12894/1128
- Giacomo Patrucco, Filiberto Chiabrando, Piercarlo Dondi, and Marco Malagodi (2018). Image and Range-Based 3D Acquisition and Modeling of Popular Musical Instruments, Proceedings from the Document Academy, Vol. 5, Iss. 2, Article 9.
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli (2017). 3D modelling and measurements of historical violins, ACTA IMEKO, Vol 6, No3, Sep. 2017, pp. 29-34, DOI: http://dx.doi.org/10.21014/acta_imeko.v6i3.455.
- Piercarlo Dondi, Luca Lombardi, Claudia Invernizzi, Tommaso Rovetta, Marco Malagodi and Maurizio Licchelli (2017). Automatic analysis of UV induced fluorescence imagery of historical violins, Journal on Computing and Cultural Heritage (JOCCH), Volume 10 Issue 2, March 2017, ACM New York, NY, USA, doi:10.1145/3051472.
- Piercarlo Dondi, Giusj Valentina Fichera, Claudia Invernizzi, Maurizio Licchelli, Marco Malagodi, Tommaso Rovetta, (2017) The Messie model, research on materials and study of moulds, in Alf G., Cacciatori F., "The Absolute Stradivari, the Messie violin 1716/2016", Cremona, Fondazione Museo del Violino Antonio Stradivari, 2016, pp.89-112, ISBN: 8890917970
- Giusj Valentina Fichera, Piercarlo Dondi, Maurizio Licchelli, Luca Lombardi, Stefano Ridolfi, Marco Malagodi, (2016). A combined approach for the attribution of handwriting:the case of Antonio Stradivari’s manuscripts, Applied Physics A, Vol. 122, Issue 11, article 970 November 2016, DOI:10.1007/s00339-016-0497-6.
- Tommaso Rovetta, Alessandra Chiapparini, Piercarlo Dondi, Giusj Valentina Fichera, Claudia Invernizzi, Marco Malagodi, Maurizio Licchelli (2016). Metodi analitici non invasivi per lo studio dei materiali degli strumenti musicali antichi, in Archeomatica, anno VII #2, pag. 20-25, July 2016.
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli (2016). Automatic identification of varnish wear on historical instruments: The case of Antonio Stradivari violins, Journal of Cultural Heritage, Vol 22 (Nov-Dec 2016), pp. 968-973, Elsevier, DOI:10.1016/j.culher.2016.05.010.
- Virginio Cantoni, Luca Lombardi, Marco Porta, Alessandra Setti (2016). Interactive, Tangible and Multi-Sensory Technology for a Cultural Heritage Exhibition: the Battle of Pavia, in S. Margenov et al. (eds.), ACOMIN 2015 conference, Innovative Approaches and Solutions in Advanced Intelligent Systems, Studies in Computational Intelligence 648, Springer International Publishing Switzerland, ISBN: 978-3-319-32206-3, Chapter DOI:10.1007/978-3-319-32207-0_6.
- Virginio Cantoni, Dimitar Karastoyanov, Mauro Mosconi, Alessandra Setti eds. (2016). Pavia, la Battaglia, il Futuro. 1525-2015 Niente fu come prima. CVML e SMART Lab alla Mostra, Pavia University Press, 112 pp., ISBN: 978-88-6952-035-8.
- Virginio Cantoni, Lorenzo Merlano, Nahumi Nugrahaningsih, Marco Porta (2016). Eye Tracking for Cultural Heritage: a Gaze-controlled System for Handless Interaction with Artworks, Proceedings of the 17th International Conference on Computer Systems and Technologies 2016, ACM New York, CompSysTech 2016, June 23-24, Palermo, Italia, pp. 307-314, DOI:10.1145/2983468.2983499.
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli, and Fausto Cacciatori (2016). Color-based automatic detection of worn out varnishes on Stradivari's “Scotland University” violin back plate, Color Research & Application, Special Issue: Bridging Science with Art, Volume 41, Issue 3, pages 313–316, article first published online: 29 DEC 2015, Wiley Periodicals, Inc. Col Res Appl, DOI: 10.1002/col.22012.
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli, (2016). Measuring Stradivari violin “Cremonese” (1715) by 3D Modeling, in Proocedings of 2nd IMEKO International Conference of Metrology of Archaeology and Cultural Heritage (MetroArcheo 2016), pp. 29-33, IMEKO, Torino 19-21 October 2016, ISBN: 978-92-990075-4-9.
- Piercarlo Dondi, Luca Lombardi, Marco Malagodi, Maurizio Licchelli, Tommaso Rovetta, Claudia Invernizzi (2015). An Interactive Tool for Speed up the Analysis of UV Images of Stradivari Violins, New Trends in Image Analysis and Processing, Proceedings of ICIAP 2015 International Workshops, Genoa, Italy, September 7-8, 2015, Volume 9281 of the series Lecture Notes in Computer Science, Springer International Publishing, pp 103-110, Print ISBN: 978-3-319-23221-8, Online ISBN: 978-3-319-23222-5.
- Virginio Cantoni (2015). Expo 2015: La Battaglia di Pavia secondo gli studenti di Virginio Cantoni, report in GIRPRNewsletter, Vol. 7, N. 1.
- Dondi Piercarlo, Invernizzi Claudia, Licchelli Maurizio, Lombardi Luca, Malagodi Marco, Rovetta Tommaso (2015). Semi-automatic system for UV images analysis of historical musical instruments, Proc. SPIE 9527, Optics for Arts, Architecture, and Archaeology V, 95270H, doi:10.1117/12.2184744.
- Marco Malagodi, Tommaso Rovetta, Piercarlo Dondi, Claudia Invernizzi, Giusj Valentina Fichera, Maurizio Licchelli (2015). La materia del Cremonese, in Il Cremonese 1715-2015, 300° anniversario, Fondazione Museo del Violino Antonio Stradivari Cremona.