Topics related to information management taxonomies posted by the author of the book, The Accidental Taxonomist.
Monday, October 31, 2016
Taxonomy Boot Camp London Conference
Friday, September 30, 2016
Directories and Databases of Published Controlled Vocabularies
In some cases, an individual or organization has a project involving a set of content that would benefit from controlled vocabulary tagging to make it findable/retrievable/discoverable, but lacks the time or resources to build a taxonomy from scratch. Licensing an existing controlled vocabulary may seem like a preferable option. This can be a reasonable solution, depending on the content and scope of the controlled vocabulary in question. In many cases, what is desired is the use of an existing controlled vocabulary as a starting point that can then be edited and expanded to customize it for a specific use. Either case involves the licensing of a controlled vocabulary.
Taxonomists who build taxonomies from scratch or edit proprietary taxonomies like to consult available controlled vocabularies on the same subject to help determine the ideal wording of a term, the inclusion of additional synonyms, and the relationship of the term to others. The results may vary in different controlled vocabularies because they serve different purposes and audiences, but taxonomists know to take that into consideration. In these cases, licensing an entire controlled vocabulary is not needed. Simply viewing a controlled vocabulary and its term relationships is adequate.
If you are interested in licensing a complete controlled vocabulary, you will need to consider both commercial/proprietary controlled vocabularies that require a fee for a license, and public/open source controlled vocabularies that are available for free. Some collections comprise only open source vocabularies. While free is nice, the free license may carry a restriction of no commercial use and/or no modifications in use. So, for commercial or for modified reuse, make sure you consult a controlled vocabulary directory that includes proprietary controlled vocabularies.
If you are interested in merely looking up terms a controlled vocabulary, it is the public, not proprietary, controlled vocabularies that are fully accessible. Therefore, it’s more convenient to consult a database/directory of controlled vocabularies that includes only public vocabularies and preferably either hosts those vocabularies or directly links to the browsable/searchable vocabulary, rather than simply redirecting to the controlled vocabulary publisher’s website, where you may have to hunt around to find access to the controlled vocabulary, if it is even accessible at all.
Comprehensive database-directories of controlled vocabularies
Comprehensive directories are large, listing hundreds of controlled vocabularies, so they are managed as databases, with database records for each referenced controlled vocabulary and search filters, such as vocabulary name, publisher’s name, and subject. There are database record pages with more details for each named controlled vocabulary, including a link to the publisher’s website. The link may or may not be to a navigable controlled vocabulary. The most comprehensive such databases are the following two:
Basel Register of Thesauri, Ontologies & Classifications (BARTOC)
BARTOC, launched in 2013, is a comprehensive database/registry of controlled vocabularies (“knowledge organization systems”) created and managed by the Basel University Library (Switzerland). The database currently lists 1,948 vocabularies of all kinds, in all languages, in all subject areas, and in various publication formats. The database of vocabularies is hosted on Drupal, and advanced search filters comprise the top 10 Dewey Decimal Classification categories, 568 hierarchical Topics, Language, Location, and Type (categorization scheme, classification scheme, dictionary, gazetteer, glossary, list, name authority list, ontology, semantic network, subject heading scheme, synonym ring, taxonomy, terminology, and thesaurus). Links are to the publisher site and sometimes directly to a navigable thesaurus. Despite its comprehensiveness, BARTOC only has a few commercial, proprietary controlled vocabularies.
Taxonomy Warehouse
Taxonomy Warehouse, launched in 1999, is a comprehensive database of varied controlled vocabularies created and managed by the thesaurus management software vendor Synaptica LLC. The database currently lists 763 vocabularies of all kinds in all subject areas from 330 organizations in various publication formats. The database of vocabularies is hosted on the Synaptica software platform, and it can be searched or alphabetically browsed (one page per letter of the alphabet), or browsed by 225 hierarchical subject categories. Unlike BARTOC, vocabularies included are only in English or multilingual including English. Synaptica is much more comprehensive than BARTOC in its inclusion of entries for proprietary controlled vocabularies, such as those of Gale and WAND, which may be licensed for a fee from their publishers but then do not preclude modification or commercial reuse. While a number of links are dead, an overhaul update is planned in coming months.
Hosted vocabulary registries
A hosted “repository” of vocabularies can be useful, because all the vocabularies are navigable through the same user interface on the same site. You can even search for a vocabulary term across multiple controlled vocabularies at once. As publicly accessible vocabularies, many of these can also be downloaded from the site for noncommercial use. This type of database exists mostly for ontologies, because they conform to Semantic Web standards for exchange of information over the web and thus don’t require a lot of data conversion to be hosted, but Linked Data SKOS vocabulary collections are starting to appear. (Note that ontologies are structured and displayed slightly differently than taxonomies or thesauri, so they may not be as useful as reference sourced for editing taxonomies or thesauri.) Publicly accessible ontologies tend to be in the biomedical sciences, so the subject area is also more limited and the ontology databases are aimed at subject matter experts. Vocabulary repositories of this kind include the following two, among many others:
Research Vocabularies Australia
Research Vocabularies Australia is a controlled vocabulary "discovery service" of the Australian National Data Service (ANDS), launched in September 2015. It currently comprises 74 vocabularies, mostly in the sciences, and is intended to grow. About half of the vocabularies are hosted on the ANDS website, and their hierarchies can be browsed and terms can be searched upon in a common user interface. These are Linked Data SKOS vocabularies, not ontologies, and include taxonomies, thesauri, and simple term lists. Vocabulary publishers comprise 33 governmental nongovernmental organizations, Australian and other. The collection of vocabularies can be searched and can be filtered by Subject, Publisher, Language, and License. Although not as large as ontology-only repositories, Research Vocabularies Australia is a significantly large repository of easy-to-access controlled vocabularies all in one place, and thus is a good source for researching terms or for downloading noncommercial-use vocabularies.
Bioportal
Bioportal is a biomedical ontology repository service of the National Center for Biomedical Ontology (NCBO) comprising 516 ontologies, many of which can be downloaded directly from the site. The vocabularies can be searched or browsed, with search filters including controlled fields for Category, Group, and Format. Filters for sorting the list of ontologies are by Popular, Size, Projects, Notes, and Upload date. One can also search for a class (term) within multiple ontologies. A great deal of metadata and summary information is provided for each vocabulary, including history of uploads, a graph of downloads, and a table of metrics, which includes the number of classes, individuals, properties, maximum depth, children, etc.
Ontobee
Ontobee, hosted by the He Group (of Dr. Yongqun “Oliver” He) of the University of Michigan Medical School, provides a sortable tabular list of 181 biomedical ontologies, which can each be individually searched and browsed directly the Ontobee website. Furthermore, terms can be searched in the Ontobee linked data server across all 181 ontologies. The ontologies (with the OWL file extension) can be downloaded, and lists of terms (more useful references for taxonomists) can be downloaded as Excel or text files.
Vocabularies listed on educational or professional organization sites
Some organizations list a sampling of vocabularies in all subject areas to serve as educational examples of different kinds of vocabularies, aimed more at students and professionals in the area of library and information science than for subject matter experts. These vocabulary collections tend to include only vocabularies that can be accessed and navigated on a public website, so they are a good source when researching individual terms. Examples of vocabulary collections of this type include those on the following sites:
American Society for Indexing
“Online Thesauri and Authority Files” is a webpage alphabetical list of about 25 vocabularies, mostly thesauri, in varied subjects with links directly to the browsable vocabularies. While the number of vocabularies is not large, it is maintained, and it is a practical resource for looking up terms in varied thesauri. They are meant to be examples for professional indexers who are also interested in working in thesaurus construction.
Charles Sturt University - School of Information Studies
“Information Organisation Vocabularies” is a webpage under the section “Links and Resources for Students” on this Australian university site. It comprises an alphabetical, sortable table of 328 vocabularies, although there is no explanatory text. The list can be sorted by column headers: Name, Author, Year, Publisher, and Keywords (uncontrolled). There is also a filter-search feature which aids in finding a desired subset of vocabularies. The links to the vocabularies link to the navigable vocabulary on the publisher site or, in the case of a few older vocabularies, to a PDF print thesaurus. Although there are a number of dead links and nothing has been added since 2014, the number of correct links directly into navigable vocabularies is significantly large, so this is a useful resource.
Vocabularies listed on software vendor sites
Some thesaurus/ontology management software vendors provide a sampling of vocabularies in various subject areas created in their tools, aimed at users or potential users of the tool. These vocabularies tend to be directly browsable, but the qualities of the vocabularies may be inconsistent, so care should be taken in using them as an authoritative source. Vocabulary collections of this type include those created in the following software tools:
PoolParty (The Semantic Web Company)
Has an alphabetical list of about 30 web-browsable Linked Data vocabularies, most of which are in English and almost all of which are hosted by The Semantic Web company. Some are very small and were built by the Semantic Web company staff as examples, and some are public thesauri that were imported into PoolParty. In addition to being browsed, almost all of the thesauri can be downloaded, too.
TemaTres
Has a tabular list of "known cases" of over 400 vocabularies managed in TemaTres, some hosted on the TemTres site and some of which link to vocabularies on the owner's server. Table columns are for title, scope (either the number of terms or a description), language, and URL. The vocabularies are in all languages, with a slightly higher proportion in Spanish, due to the fact that TemaTres is developed in Argentina, and only a minority of which are in English. The search feature has limitations due to the inconsistent use of scope descriptions and the fact that titles and descriptions are in different languages.
MultiTes
Has a small sampling of 10 web-browsable thesauri in varied subject areas, of which 7 are in English. Some are hosted on the MultiTes site and some are hosted on the thesaurus publisher sites.
VocBench
Has links on its VocBench “community” page to about a dozen national and international organizations and two higher education institutions with VocBench-created vocabularies. In some cases the links are to the browsable thesauri, but in other cases the links are just to the organization websites, and the thesauri, if available, are not so easily found.
Protégé
Has a wiki page that lists and links to websites of ontology publishers in three categories: 80 OWL ontologies, 19 Frame-based ontologies (those ontologies that were developed using the Protégé-Frames editor), and 8 in other ontology formats. Some of the links are dead, some are to the websites of the ontology owners, and some are directly to the XML file. Since the links are not to the navigable ontology in a browser, this list of ontologies is not useful as a source for checking terms, but it is a good source for downloading ontologies, if you have the right software to read them.
Friday, August 26, 2016
Synonyms, Alternate Labels, and Nonpreferred Terms
Designations
"Synonyms" is the simple, nonexpert designation to the different names for the same term or concept in a taxonomy or other kind of controlled vocabulary. This is an over-simplification, for what may be involved is far more than just synonyms. Synonyms are words with the same meaning, but a taxonomy comprises terms that are typically phrases, often of two or three words, not just words. Furthermore, synonyms by definition have identical meaning, but in a taxonomy, we can have multiple names for a concept that are merely "close enough" in meaning to function as desired.
"Alternate labels" is a much better designation and is the nomenclature adopted by SKOS-compliant vocabularies. SKOS, which stands for Simply Knowledge Organization System, is a recommended standard of the World Wide Web Consortium for the application of the RDF (Resource Description Framework) interoperability format. Alternate labels refer to "concepts" which are known by their "preferred labels." You could certainly use the designation of "alternate labels" even if the controlled vocabulary or taxonomy is not SKOS compliant, and I have seen that sometimes.
"Nonpreferred terms" is the nomenclature of the thesaurus standard described in either ANSI/NISO Z39-19 Guidelines for the Construction, Format, and Management of Monolingual Controlled Vocabularies or ISO 25964 Thesauri and interoperability with other vocabularies, Part 1: Thesauri for Information Retrieval. Trained taxonomists, especially those with a library science background, are most familiar and comfortable with this designation, but its meaning is obviously not as intuitive to non-taxonomists.
Although the aforementioned three designations are the most common, there are others out there. I have run into the use of the following: Aliases, Alternate terms, Cross-references, Entry terms, Equivalent terms, Keywords, Nondescriptors, Non-postable terms, NPTs, See references, Use for terms, Use references, Used for terms, and Variants.
Taxonomy/thesaurus/ontology management software that supports the SKOS standard will typically use the SKOS designation of "alternate label," and software that supports the thesaurus standards will typically use the language of "nonpreferred term." As for software that supports both standards, which is becoming increasingly common, "alternate labels" or "alternate terms" is more common than "nonpreferred terms", and other designations might be used, such as "variants." So, for want of an unambiguous single-word designation, I will refer to these as "variants" for the remainder of this post.
Techniques for creating variants
Since synonyms are for single words, and most taxonomy terms are multi-word phrases, a common technique is to substitute a synonym for one word of a multi-word phrase. For example, Movie reviews and Film reviews.
Variants that are not exactly synonyms would also include technical and layperson language, such as Neoplasms and Cancer; older and newer designations, such as Near East and Middle East; and lexical variants, such as Hair loss and Baldness. Experts will tell you that in all of these cases these are not synonyms. They sufficiently equivalent, though, for most taxonomies.
This brings us to another important point. Variants should be roughly equivalent within the context of the taxonomy and the body of content it is used to index. What serves well as a variant in one taxonomy might not be suitable for the same term in another taxonomy.
The number of variants to create for each taxonomy term/concept depends on the search technology and on the display of the taxonomy in the user interface. While a taxonomy could be browsed, it is more common for a taxonomy to be searched. The user searches for terms within the taxonomy, matching search strings against any variant of a term, if not the preferred term itself. The search does not have to be an exact match and may match to taxonomy terms that have at least the same words (in any order) and grammatically stemmed versions of the words (such as education and educational). With this in mind, taxonomists do not need to create variants for every possible variation of a term, as the search technology will be able to take care of some of that.
As for sources for variants, other than the taxonomist's own knowledge of language, any term variations in sample source documents to be indexed should be considered. If content to be indexed with the taxonomy has already been published, and users have been searching for it on a website or content management system, the user-entered search strings found in the search logs can be an excellent source for variant terms. External reference sources and similar taxonomies can be consulted as a source, but not relied upon as the primary source for variants.
Saturday, July 30, 2016
Who Are Accidental Taxonomists?
Turning to the name of this blog, who are the accidental taxonomists? I sought an answer to this questions through some of the questions of a survey I conducted of taxonomists to gather information on the opening chapter of my book, and more recently I looked at the job titles of those who had registered for my online taxonomies course.
I conducted the survey twice, in late 2008 and May 2015 in order to gather information for my first and then second edition of book. The participants were solicited from various online discussion groups, such as Taxonomy Community of Practice and those of related subjects of content strategy, information architecture, digital asset management, knowledge management etc. So, perhaps there was a slight degree of predetermining the participants by choosing where to announce the survey, although it can be assumed that practicing taxonomists of any background could be members of Taxonomy Community of Practice.
The differences in responses to some of the same questions over that time period are presented in my blog of June 2015 “Taxonomist Trends.” Among other findings, trends in the backgrounds of those involved in taxonomy showed an increase in backgrounds of knowledge management, content management, content strategy and digital asset management; and a decrease in those with a background in Software/IT and database design, development, or administration. Other backgrounds did not change much.
Another source of information on the backgrounds and current jobs of accidental taxonomists, which I did not include in my book, comes from the job titles and introductions of students in the online continuing education workshop “Taxonomies & Controlled Vocabularies,” which I taught through Simmons College School of Library and Information Science for the past eight years (2008-2016) and now teach on my own. I estimate I have had a total of about 500 students take the workshop, which has been offered of average five times per year. It’s impressive what varied backgrounds these “students” of taxonomy have.
Some of the continuing education students were already employed as taxonomists, and they want to fill in the gaps of their knowledge, especially if they had never taken a course on the subject before. Some were librarians, particularly Simmons School of Library and Information Science alumni, since the continuing education program was marketed towards them. These librarians may not need to create taxonomies in their current position, but they are curious to learn about it and perhaps hope to get into taxonomy work later in their careers. A few participants were even current library science students.
However, the majority of the continuing education students are indeed accidental taxonomists. As they explain in their introductions, they have found that the need to learn about taxonomy creation and maintenance is important to their current jobs. As for what their current jobs are, many are involved with content management, digital asset management, or archives. Job titles, based on self-introductions, of those in the past 6 months have included: archivist, business analyst, cataloger, chief operating officer, consultant, data coordinator, digital asset administrator, digital asset cataloger, digital asset manager, director of content standards, information manager, linguist, photo editor product manager, program manager, senior product analyst, and senior records analyst.
In the first chapter of my book “Who are Taxonomists?” there are five pages of job titles, which were obtained from (1) 130 taxonomist survey respondents indicating their job titles, and (2) obtaining job titles from LinkedIn profiles of several hundred people who had “taxonomy” or “taxonomies” in their profile. I did not look at the job titles of my continuing workshop students for my research for that book chapter. There is a slight difference of who is included, because the survey for my book was specifically of those people already engaged in some degree of taxonomy work. Students of my online workshop, on the other hand, may not have done any taxonomy work yet, but are anticipating doing it. They are potentially accidental taxonomists. Their job titles are thus more varied.
Following is a list of job titles that students of the online workshop “Taxonomies & Controlled Vocabularies” put down on their registration form (although some left the job title field blank), over the years of 2009 - 2014. (After 2014, this information was not included in most of the class lists I received.)
Account Representative
Advance Technical Editor
Archives & Digital Collections Manager
Archivist
Assistant Professor
Business Analyst
Business Research Specialist
Career Resource Consultant
Cataloging Librarian
Classification Model Developer
Collection Development Librarian
Content Management Assistant
Content Strategist
Corporate Data Steward & Taxonomist
Digital Archivist
Digital Asset Coordinator
Digital Asset Librarian
Digital Content Specialist
Digital Content Strategist
Digital Resources & Metadata Coordinator
Director, Information Architecture
Director, Library & Archives
Electronic Services Supervisor
Engineering Records Specialist
E-Records Manager / Analyst
Graphic Arts Accessioner
Graphic Designer
Graphics Project Archivist
GTA/LIS Student
Head Librarian, Collections Management
Head of Public Services
Human Factors Engineer
Indexer
Information Analyst
Information Architect
Information Consultant
Information Manager
Information Resources Librarian
Information Scientist
Information Specialist
Information Technology Consultant
Instructional Design Analyst
Instructional Services Librarian
Internal Communications Officer
Knowledge & Information Manager
Knowledge & Learning Specialist
Knowledge Management Analyst
Knowledge Management Associate
Knowledge Management Officer
Knowledge Manager
Lead Library Technician
Legal Editor
Librarian
Library Director
Library & Research Specialist
Library Assistant
Manager, Knowledge Resource Center
Manager, Library Services
Managing Partner
Marketing Director
Media Content Analyst
Metadata Analyst
Metadata Librarian
Metadata Production Specialist
Metadata Specialist
Monographs Cataloger
Ontologist
Operations Specialist
Photographer
Program Records Manager
Project Analyst
Rare book cataloger
Recipe Processor
Records Manager
Reference & Electronic Resources Librarian
Reference Librarian
Relationship Manager
Research & Information Management Coordinator
Research Fellow
Research Librarian
Research Publications Manager
Research Specialist
Resource Center Customer & Product Specialist
Science Librarian
Search Specialist
Senior Associate Regulatory Affairs
Senior Business Analyst (Records Management)
Senior Business Systems Analyst
Senior Content Manager
Senior Content Strategist
Senior Data Curator
Senior Information Architect
Senior Information Security Analyst
Senior Knowledge Base Specialist
Senior Management Consultant
Senior Market Analyst
Senior Metator/XML Analyst
Senior Researcher
Senior Specialist, Technology & Metrics
SharePoint Lead Specialist
Social Sciences Liaison Librarian
Staff Writer
Supervising Librarian
Supervisor, Knowledge Management
Systems Librarian
Taxonomist
Teacher
Teacher Librarian
Team Lead Data & Quality
Technical Editor / Taxonomist
Technical Services Librarian
Technical Writer
User Services & Cataloging Librarian
UX Designer
UX Project Manager
Visual Resources Curator
Web Administrator
Web Services Librarian
Worldwide Metadata Coordinator
Finally, the industries in which the taxonomy students work included:
Broadcasting & media
Computer hardware & software
Consulting
Consumer electronics
Engineering technology
Federal government agencies
Financial services
Health insurance
Healthcare
Healthcare information technology
Information services/publishing
Information technology
International agencies
Law firms
Manufacturing
Medical devices
Military
Municipal government
Oil & gas
Publishing
Religious organizations
Research & development
State/provincial government
Simmons College School of Library and Information Science has put its Continuing Education Program on hiatus for evaluation and restructuring. I hope to be able to offer my online workshop again through Simmons in a future year. In the meantime, I am offering this workshop as an online course directly to individuals or groups. This and other taxonomy training offerings are listed on my website: Online Taxonomy Course.
