The Violin Ontology: Massimiliano Zanoni, Francesco Setragno, Augusto Sarti
The Violin Ontology: Massimiliano Zanoni, Francesco Setragno, Augusto Sarti
The Violin Ontology: Massimiliano Zanoni, Francesco Setragno, Augusto Sarti
Abstract: Bowed musical instruments have been the subject of algorithms for classification/recognition applications; translating
scientific investigations for centuries. Yet, the physical phenomena scientific descriptors/features in more intuitive terms for the com-
that are behind their timbral quality are still far from being fully munitiy of instrument makers and that of musicians; and more.
understood. This is one of the reasons why the art of violin making Several studies from different disciplines are already present in
is still so strongly tied to tradition. This manuscript describes early the literature and the presence of several forums for instrument
results in a study of the relations that exist between timbral and acoustic makers on the Web stresses the needs of sharing information in
characteristics of such instruments and their high-level descriptors. In this particular area. However, to the best of our knowledge,
particular, we propose a suitable ontology for a timbral characterization an expressive representation of the knowledge and an excellent
of violins, where every resource is connected and provided with formally organization of information, able to provide powerful tools for
defined semantics. Semantic web technologies have taught us how searching and sharing, are still needed.
ontologies can become a powerful tool for gathering and managing Numerous data knowledge paradigms have been developed for
knowledge in specific areas of interest, where resources are connected a variety of applications, often based on XML [1, 2]. Such
and described with formally defined semantics. This, in fact, represents paradigms, however, are not expressive enough for defining seman-
a crucial step for building applications that reason over Web data. tic relationships and constraints over information [3]. The lack of
In this paper we present an ontology for knowledge representation of semantics, in fact, makes interoperability difficult, and often hinders
violins, as part of a wider ontology of bowed instruments. With this the automatic reasoning over data [4]. For this reason, in order
ontology we capture timbral and acoustic aspects of violins as well as to capture, formalize and organize the knowledge we need to take
violin making and properties of the materials used for their production. advantage of Semantic Web methodologies [5, 6].
We collected and organized semantic descriptors used by numerous
violin makers (from natural language) to describe sound proprieties The development of tools for Semantic Web has become partic-
of musical instruments. We also developed an initial model of the ularly popular in past few years. Semantic Web supports the
relation between semantic descriptors and low-level audio features. collection and the linkage of structured formalization of knowledge.
The ontology that we present in this study formalizes the semantics In this context, ontologies are a very useful tool for expressing
of the high-level descriptors and investigates the relation with low- knowledge in a specific area of interest. In ontologies, resources
level features. The terminology has been collected through a series are equipped with formally defined semantics. Each resource can
of interviews with violin makers in the city of Cremona (Italy), world be also connected to others in order to express semantic relations
heritage site for the practice of violin makers. Through listening tests in such a way that it becomes possible to build applications that
and a feature extraction we study the correlation between high-level reason over Web data. More recently, Semantic Web has been
descriptors and objective properties of sound. successfully applied to the area of music information management
[7, 8, 9]. One of the main contributions in this area is the OMRAS2
project1 , which aims at building a framework to share information
about music (performances, productions and so on) in the Semantic
1. I NTRODUCTION Web format. For this purpose several ontologies have been created.
The art of violin making is the result of five centuries of evolution, Some examples are the Music Ontology [8], the Audio Effect
which started in Cremona, Italy, with its patriarch Antonio Amati, Ontology [10] and the Audio Feature Ontology2 . For all these
followed by the renowned families of Stradivari and Guarnieri. projects, the use of Semantic Web turned out to be a better choice
Today Cremona is still the heart of this tradition, as confirmed by compared to other knowledge management methods [4].
UNESCO, which in 2012 made Cremona a World Heritage Site In order to investigate, collect, and conceptualize the traditional
for the art of lutherie. Cremona is currently home to over 150 and modern knowledge concerning violin instruments, in this study
violin makers, and thousands more have studied there, all following
techniques that have been passed forward from generations to we propose the Violin Ontology3 . This Ontology is designed to
generations for centuries. As the practice of violin making evolved capture the knowledge-related different aspect of these instruments,
and consolidated, violins have been a constant subject of scientific from the materials to the construction methods, to the description
investigations. Yet, the physical phenomena that are behind their of the sound proprieties. The Violin Ontology is part of the Bowed
timbral quality are still far from being fully understood. Because Instrument Ontology, which is our next goal.
of this inherent difficulty in capturing what physical phenomena The collection of information related to materials and to the con-
make such instruments sound the way they do, violin making has struction methods is a very complex and time-consuming process.
remained an art that that is solidly tied to tradition. In fact, although there exist some general techniques that violin
In the past few decades, however, there has been a renewed frenzy makers usually refer to, they tend to build instruments according
in research, aimed at pushing the boundaries of our physical under- to their own personal styles. Moreover, for historical instruments,
standing of the quality of violin tone. This recently prompted the information is often based on old and often very limited written
city of Cremona to start new research projects with the Politecnico descriptions. Consequently additional investigations based on
di Milano (for aspects of musical acoustics) and the University of advance material analysis (x-ray, micro- and UV imaging, spec-
Pavia (for aspects of material analysis), aimed at exploring new trography, and chemical analysis) are often in order, when it comes
directions in contemporary lutherie. Among the many goals of to tracing the construction history of such instruments. For these
such projects is that of understanding the links that exist between and other reasons, in this manuscript we only present a preliminary
objective and semantic descriptors related to such instruments. The version of this Section of the ontology.
former are geometric, vibro-acoustic, acoustic and timbral features; The characterization of the violin sound should consider timbral and
physical and chemical properties of materials, etc. The latter acoustic proprieties as well as the perceptual aspects of the sound,
are the terms of natural language that are customarily used for where perceptual aspects refer to how the sound is perceived and
describing qualities of the instrument. Identifying such relations
1 http://www.omras2.org/
would allow us to achieve multiple goals: improving the quality
2 http://motools.sourceforge.net/doc/audio
(breadth and span) of information gathering through interviews features.html
and questionnaires; improving the effectiveness of training-based 3 http://purl.org/net/bowedinsturmentsontology
Proceedings of the 9th Conference on Interdisciplinary Musicology – CIM14. Berlin, Germany 2014
4 http://www.w3.org/TR/owl2-syntax/
Proceedings of the 9th Conference on Interdisciplinary Musicology – CIM14. Berlin, Germany 2014
Brilliat
Bow: Paint
Dark
Figure 2: Ontology scheme for the Violin Making Ontology
section.
rdfs:subClassOf rdfs:subClassOf
rdfs:subClassOf
ety. As previously mentioned, the quality of sound is strictly related
Bow: Bow: to the intrinsic composition of the materials and to the characteris-
ItalianViolin Bow: FrenchViolin tics of the violin parts. For this reason, we link Bow: Sound De-
GermanViolin scriptors to the class Bow: Materials through the Bow:Correlation
propriety and to Bow: Instrument parts through the Bow:Model
propriety.
Figure 3: Ontology Scheme for the instrument concept. In order to represent the knowledge related to both Low- and High-
Level Features, Bow: Sound Descriptors class has the Audio: Low-
Level Features and Bow: High-Level Features subclasses. The
overall scheme of this section is depicted in figure 5.
and includes information on instrument parts and material. Finally, As far as HLFs are concerned, there is a common vocabulary that
the Sound Description Ontology Section conceptualize the timbral violin makers use to describe the sound proprieties of instruments.
and acoustic proprieties of the instrument sound. Terms in the vocabulary express different shades of sounds. Our
3.1. Instrument Making Ontology Section intent is to find the most used and relevant terms that are the terms
whose meaning (and self-confidence) reached a consensus among
The Instrument Making Ontology Section is composed of three makers. We populate the vocabulary of the semantic descriptors
classes (figure 1): Bow:Instruments, Bow:Instrument parts and through a series of interviews with 20 violin makers in Cremona and
Bow: Materials. Bow:Instruments class provides the character- Milano, Italy. Starting from a seminal vocabulary populated with
ization of the violins instrument (figure 3). Along the history, terms retrieved by other studies in the literature, in each interview
different making process procedures has been developed. It is we asked to propose further terms to add. After that, the subjects
possible to narrow three main schools: Italian, German and French. were asked to outline the meaning of each term, their usage, the
For this reason, the Bow:Instruments concept has three subclasses: relations between them in terms of similarity and their nuance
Bow:ItalianViolin, Bow:GermanViolin, Bow:FrenchViolin. (positive or negative, when possible).
The Bow:Instrument Maker class is linked through the propriety Trying to generalize the human description of sound is a very hard
Bow:Made by to the Bow:Instruments class, since a violin maker task. This is due to different reasons: different reactions to physical
produces and repair violins. Instruments are composed of numerous stimuli, different musical backgrounds, different tastes and different
components, each one with specific characteristics that has been way to describe the sounds. For this reason, terms which semantic
refined along the centuries. For this reason, the Bow:Instruments did not converge to an agreed definition, were discarded. The
class is linked to the Bow:Instrument parts class through the residuals compose the set of individuals of the Bow: High-Level
propriety Bow:Composed by. The Bow:Instrument parts class Features concept and the nuances (positive, negative, neutral) are
defines a conceptualization of the description of single component attributes.
that compose the instruments. Each part of the instruments is made
of specific materials, whose choice has been a process refined along The terms might be related to each others in terms of similarity or
the centuries. The Bow:Made of propriety describes the relation opposition through the two proprieties: Bow: Similarity and Bow:
between the Bow:Instrument parts class and the Bow: Materials. Opposition. This two proprieties have been declared symmetric,
so that if a term A is linked to the term B, then B will be linked
Bow:Materials (figure 2) represents the generic concept of material to A with the same property. The vocabulary is listed in Table 2.
and has three subclasses: Bow:Wood, Bow:Paint, Bow:Glue, which Terms in the same row and different columns have been annotated
are the predominant materials used in violin liuthery. The class as opposite. Whereas terms in same row and same column are
Bow:Wood, which individuals are the types of wood, such as maple annotated as similar.
and spruce, represents the description of the typically used type of
wood. Internal and external parts of the instruments are generally Figure 4 shows an example of the formalization of the term Bright
painted using a mixture of pigments, copals, white coat and other using the Violin Ontology. In the example, Dark and Bright are
essences. The class Bow:Paint conceptualize the paint mixtures. opposite, whereas Bright and Brilliant are similar.
Various components of the instruments are typically joint using Terms in the vocabulary tend to capture specific aspects of the sound
different types of glues. For this reason, we also added the class (timbre, propagation, instrument response, overall sensations). This
Bow:Glue. effect is formalized in the Ontology by introducing the class Bow:
SemanticContext and the propriety Bow: Belong. Each term can
3.2. Sound Description Ontology Section belong to one or more areas. Terms Timbre and Definition are two
In the Violin Ontology sound proprieties are described through semantic context (figure 4). The semantic contexts included in our
the Bow: Sound Descriptors concept, which is linked to the Ontology are:
Bow:Instruments class through the Bow:Sound description propri- • Timbre: this class includes terms that are mainly related to the
Proceedings of the 9th Conference on Interdisciplinary Musicology – CIM14. Berlin, Germany 2014
Bow: High-Level
Features
Bow:Similarity Bow:Opposition Figure 6: Overall procedure for the Low- and High-Level Features
correlation study.
Figure 7: Distance Correlation Index computed on Low-Level Features extracted from 11 violin recordings and semantic descriptors used
for the annotations.
L is the number of observations and dVar is the distance variance RreliefF ranking : dark/bright,brilliant
which is given by
0.25
dVar(Xi ) = dCov(Xi , Xi ). (3)
spectralKurtosis
spectralSpread
0.2
The Distance Correlation Index ranges from 0 to 1, where 0 means
spectralSkewness
no correlation (independence).
spectralCentroid
0.15
spectralIrregularity
mfcc13
harmonicRatio
attackTime
0.1
spectralFlux
attackSlope
the collection of the j − th HLF associated to each observation, the
rolloff
mfcc10
mfcc7
mfcc12
mfcc11
0.05
mfcc5
mfcc9
mfcc4
mfcc8
mfcc1
mfcc6
mfcc2
the Low-Level Features. The higher is the weight for Xi , the higher
rms
zcr
The limited space of the paper do not allow us to show all the
results of the study. For this reason, we present here only some −0.05
between material proprieties, violin parts proprieties and the sounds International Computer Music Conference (ICMC 1999).
proprieties. Beijing, China, 1999.
[19] M. Zanoni, D. Ciminieri, A. Sarti, and S. Tubaro: Searching
R EFERENCES for dominant high-level features for music information
[1] D. Beenham, P. Schmidt, , and G. Sylvester-Bradley: XML retrieval. In Proceedings of the 20th European Signal
based dictionaries for MXF/AAF applications. Technical re- Processing Conference (EUSIPCO). 2012.
port, Sony Broadcast and Professional Research Laboratories, [20] Y. E. Kim, E. M. Schmidt, R. Migneco, O. G. Morton,
UK, 2000. P. Richardson, J. Scott, J. A. Speck, and D. Turnbull: Emotion
[2] J. Smith and P. Schirling: Metadata standards roundup. In Recognition: a State of the Art Review. In In Proceedings
MultiMedia, IEEE, volume 13(2):84–88, 2006. of the 11th International Society for Music Information and
Retrieval Conference (ISMIR2010). 2010.
[3] M. Klein, D. Fensel, F. van Harmelen, and I. Horrocks:
The relation between ontologies and XML schemas. In [21] D. Turnbull, L. Barrington, D. Torres, and G. Lanckriet:
LINKÖPING ELECTRONIC ARTICLES IN COMPUTER Towards Musical Query-by-semantic-description Using the
AND INFORMATION SCIENCE, page 2001. 2001. CAL500 Data Set. In Proceedings of the 30th Annual
International ACM SIGIR Conference on Research and
[4] G. Fazekas and M. Sandler: Novel methods in information Development in Information Retrieval, SIGIR ’07, pages 439–
management for advanced audio workflows. In In proceedings 446. ACM, New York, NY, USA, 2007.
of 12th International Conference on Digital Audio Effects.
Como, Italy, 2009. [22] J. Štěpánek and Z. Otčenášek: Acoustical correlates of the
main features of violin timbre perception. In Actes du
[5] G. Fazekas, Y. Raimond, K. Jacobson, and M. Sandler: An Colloque interdisciplinaire de musicologie (CIM05), pages
Overview of Semantic Web Activities in the OMRAS2 Project. 10–12. Québec, Canada, 2005.
In Journal of New Music Research, volume 39(4):295–311,
2010. [23] E. Lukasik: Towards timbre-driven semantic retrieval of
violins. In Proceedings of the Fifth International Conference
[6] P. Borst, H. Akkermans, and J. Top: Engineering Ontolo- on Intelligent Systems Design and Applications (ISDA 2005).
gies. In International Journal of Human-Computer Studies, 2005.
volume 46(2-3):365–406, 1997.
[24] T. Berners-Lee, J. Hendler, and O. Lassila: The Semantic Web.
[7] G. Fazekas and M. Sandler: The Studio Ontology Framework. In Scientific American, 2001.
In Proceedings of the International Society for Music
Information Retrieval Conference (ISMIR2011). 2011. [25] G. Antoniou and F. van Harmelen: Web Ontology Language:
OWL. In S. Staab and R. Studer (eds.), Handbook on
[8] Y. Raimond, S. Abdallah, M. Sandler, and F. Giasson: Ontologies, International Handbooks on Information Systems,
The Music Ontology. In Proceedings of the International pages 67–92. Springer Berlin Heidelberg, 2004.
Conference on Music Information Retrieval (ISMIR 2007).
2007. [26] G. Székely, M. Rizzo, and N. Bakirov: Measuring and
testing independence by correlation of distances. In Annals
[9] K. Barkati, A. Bonardi, A. Vincent, and F. Rousseaux: of Statistics, 2007.
GAMELAN: A Knowledge Management Approach for Digital
Audio Production Workflows. In Proceedings of Artificial [27] M. Robnik-Ŝikonja and I. Kononeno: An adaptation of relief
Intelligence for Knowledge Management Workshop (A14KM) for attribute estimation in regression. In Proceedings of
of ECAI. 2012. the fourteenth International Conference on Machine Learning
(ICML1997). 1997.
[10] T. Wilmering, G. Fazekas, and M. B. Sandler: The Audio
Effects Ontology. In Proceedings of the 14th International
Society for Music Information Retrieval Conference. 2013.
[11] A. Zacharakis, K. Pastiadis, G. Papadelis, and J. D. Reiss:
An Investigation of Musical Timbre: Uncovering Salient
Semantic Descriptors and Perceptual Dimensions. In
Proceedings of the 12th International Society for Music
Information Retrieval Conference (ISMIR2011). 2011.
[12] J.M.Grey: Multidimensional perceptual scaling of musical
timbres. In Journal of the Acoustical Society of America,
1977.
[13] G. Bismarck: Timbre of steady tones: A factorial investigation
of its verbal attributes. In Acustica, 1974.
[14] A. C. Disley, D. M. Howard, , and A. D. Hunt: Timbral
description of musical instruments. In Proceedings of the 9th
International Conference of Music Perception and Cognition.
2006.
[15] J. Štěpánek: Musical Sound Timbre: Verbal Description and
Dimensions. In Proceedings of the 9th Int. Conference on
Digital Audio Effects (DAFx-06), Montreal, Canada. 2006.
[16] C. Fritz, A. F. Blackwell, I. Cross, B. C. J. Moore,
and J. Woodhouse: Investigating English Violin Timbre
Descriptors. In Proceedings of the 10th International
Conference on Music Perception & Cognition (ICMPC 10).
2008.
[17] C. Saitis, B. L. Giordano, C. Fritz, and G. P. Scavone:
Perceptual evaluation of violins: a quantitative analysis of
preference judgments by experienced players. In The Journal
of the Acoustical Society of America, volume 132(6):4002–12,
2012.
[18] P. Herrera and X. Serra: Audio descriptors and descriptor
schemes in the context of mpeg-7. In Proceedings of the