Tag, You're It - Keynote From Enterprise Search Summit

I am at the opening day Keynote for Enterprise Search Summit West in San Jose today, rushing down from Pacifica on this beautiful morning driving (ok speeding) down 280 to make this early morning session. Obviously if you have been following me for a while over on my blog you know i have a 'thing' for social tagging and recently published an eBook on Hybrid approaches to Folksonomies and Taxonomies in the Enterprise so i did not want to miss it.

The Keynote is titled 'Tag, You're It: Social Tagging Strategies for the Enterprise' and is being lead by Gene Smith, Principal, nForm Experience. Gene is the author of the book 'Tagging People Powered Metadata for the Social Web'

Why We're Here? (at the conference)
To figure out how to find *the good* Stuff

19th century explosion in paper records- flourishing of patten filings to store records and information. the one that emerged as the winner was vertical filing. folders and tabs where a key piece. Tabs in vertical filing are still seen in today's web User Interfaces.

Folders have been the dominant organizing principle - then links came into the scene.

Instead of Information explosion- think of it as a stream, immersion in the flow.
the challenge is keeping track and finding what we need later on - tags are
- fast
-good enough

A tag (word) can mean a lot of different things.

Looking at different tools and why they are interesting:

Zigtag - semantic social bookmarking
When you are about to tag something, you type and pick from the list and it includes definition.
They have million of concepts- they mine public data sources for user generated content and built a inference engine to provide the concepts

any person can make any two tags equivalent- but they can also remove it as well - "humor" and" "humour"- same word but different meaning in different cultures (america vs. UK) authors tagged to each are different.

Value chain of the LibraryThing features
>combine tags> tag mash search>tagsonomies (mapped to existing categories)

The big problem is getting people to use the tools you provide for them!

Cold-Start Problem-

  • creating incentives- reward a person by identifying that that were the first person to tag or create social proof 'feature linker'- (who doesn't like to see their name in lights?)
  • try to pre-populate the tag box- tags other people have used

Some other examples:
Wesabe - sticky tags- always applied to the item, but then allow 'not sticky' or one time tags. show you your spending habits by clustering your tags- giving benefits of the tags they used.

Dogear - built internally at IBM- architected it so it produces a RSS feed for every tag - what happened is that as people started using it- groups found interesting things to go with their RSS feeds like displaying the content into other environments- creating mashups- allowing innovation on the tags so that the value is created by the users needs.

Although this specific slide deck he used does not seem to be there yet- Gene shares his slides over at SlideShare and you can also follow Gene on Twitter @gsmith .

Thinking Outside Of The Synaptica Box

The Synaptica team likes to think outside the box- both with customers as well as with the use of our own tools, so I wanted to share with you some of the ways that we use Synaptica internally here at Dow Jones that might seem surprising if you think about taxonomy management tools as just that- a development and management tool for controlled vocabularies.

Beyond straightforward taxonomy and thesaurus management, which of course is the primary purpose for Synaptica, we have incorporated a number of other vocabularies and projects into to the tool and integrated them into our development and account management processes.

One way that we are using Synaptica is to manage accounts, contacts and even lists competitors. Given the ease with which one can set up uniquely designed vocabularies, it is no problem to create one dedicated to storing any of the above information and the appropriate details. Once the vocabulary has been created and populated, it is just as easy to begin to link companies and individuals to account information, notations about sales status, and even suggested projects for enhancing Synaptica.

In the same respect we utilize Synaptica to manage our ongoing projects and a general knowledge base for any issues that might be encountered by our user base. We can store a definition, the status and priority of the project, and link it to the company or individual that requested it. Using this method we can easily track every aspect of the work from start to finish. Each project assigned to a specific version release is marked using things like category labels and workflow flags to very closely monitor and track where we are with each proposed project for ongoing releases.

We are applying the tools and functionality of Synaptica in ways that may not seem immediately apparent, but given the flexibility of the application there are many ways that one can find to creatively employ the features and functionality of Synaptica. Contact us today to find out more about how you can use Synaptica to assist with your internal processes, even in ways you may not have thought possible!

Is the Semantic Web the Internet's Equivalent of the Green Building Movement?

My kids are still in their "Bob the Builder" years. At some point Bob went "green" - left Bobsville to build a sustainable community in Sunflower Valley, complete with grass-growing roofs, hand-pumped water and solar powered trailers. He even got a new catchphrase - "Can we fix it? Yes we can!" has been joined by "Reduce, Recycle, Reuse." While it's a little over the top, I can't complain. Every reminder helps. This last weekend though, when Bob chanted his new mantra, I heard a different voice echo in my head - one saying re-use, re-mix... it sounded eerily like Eric Miller at SemTech keynotes, in consulting presentations, in print. I guess I got the message!

Reduce - for our environment we want to encourage people to think carefully about what we actually need to consume. We need to think about that notion in regards to our data stores as well. Are they full of clutter? Are we afraid to get rid of data in case we might need it later? I don't think it should be about ownership - we "own" data about as much as we "own" the earth - we are stewards, not controllers. Yes, there is data we need to more carefully manage, as we would our home and property; government regulations help us define our responsibilities there. But how much time and effort do we want to spend managing all of that data? How many resources - human and infrastructure - does it take? Can we acquire some of the data we need from a trusted source - a trusted steward who will commit to maintaining its integrity? I'm not suggesting we create monopolies - we need diversity of thought, and may need to subscribe to more than one data provider. It could be simple or complex data you outsource - do you really need to maintain your own list of US States or Countries for your online form? Do you NEED to download a local copy of a paper, or do you simply want to make notes on a certain paragraph? The costs can range from free to exorbitant.

recycled plastic bag purseRecycle - find new ways of using data. If we can turn billboards, magazines and plastic shopping bags into purses, we can transform mere metrics into compelling visualizations and startling statistics. One compelling example is Gapminder. Using data from the United Nations, the team under Hans Rosling have developed interactive charts and maps detailing global trends that provide greater impact for consumers in a world of information overload. The same data we usually see in boring columns and rows, have new form: new impact.

Reuse - how many of us have taken a plastic container from the grocery store and used it later to store leftovers in the fridge? Or to carry our lunch to work where if it gets lost, no worries? We can do the same with our bits of data. Really, this notion of data reuse has taken off already - new mashups are being generated at an exponential rate! We can use this same creativity inside the firewall - let your geeks play with the data, give them sandboxes and free time to explore. At the very least, don't prevent them from trying new things when security restrictions have been met. Anthony Bradley of Gartner called this the MacGyver Principle at the Gartner Web Innovation Summit this past week in Los Angeles. MacGyver didn't go collect the right tools for the job - he used the resources already available. This is where serendipity occurs (and in MacGyver's case, survival!) - unanticipated uses by unanticipated users.

As to the technologies themselves - there are options, just as we have in the real world! Choose the tool right for your project. Wind, water, solar power - each option has a micro-climate for which it is best suited. Use the same consideration for your own information and technology projects. Will Microformats do the job? Do you need to use a W3C standard? Do you need a triple store, or can you start building on available databases? Think carefully, balancing the long term return on the investment.

One site I've recently come across is the new BBC Music (Beta) site. They're taking data from their own radio play system, Musicbrainz, Wikipedia and more to create comprehensive profiles of musicians. I can't do it justice - read about it for yourself.

I think Bob and the gang would be proud. Heck, so would Al Gore! ;) What are your favorite ways of making the internet "green?"

Flickr image by Kate Blackport, found thanks to Search by Creative Commons

What is the Hardest Content to Classify?

This week I saw that my first blog post on Synaptica Central had been published! After a few seconds of enjoyment, as a wave of pride washed over me, I realized that I now need to post pretty frequently to give our readers something interesting to read! So, without further ado…

The first topic that came to mind as I thought about topics to blog about is the whole area of classification of different types of content: text, sound, video and images.

I often speak to clients who have a range of item types stored in a number of repositories. They're often looking to classify new content, or to work on older content in order to improve its findability. They are always looking to get more value from their content.

In these circumstances a content audit is often called for, to answer the 'What do you have?' question. This then leads to a general discussion of the content types and the ways in which they can be classified, usually using a controlled vocabulary either applied by a machine, by a person, or by a mixture of the two.

One thing that often makes people ask me questions is my fairly frequent assertion that images are easily the hardest item types to deal with.

Why are Images the Hardest Content to Classify?

-Textual items contain text. Use of auto-categorising software, free text storage and access .etc .etc makes organising and finding textual items relatively easy.

-Sound can be digitised and turned into text.

-Video often has an audio track that can be turned into text too. Computers can be used to identify scenes. Breaking a video into scenes and linking a synched and indexed soundtrack together can provide pretty good access for many people - (though there's a whole blog post on the many access points to video that these process doesn't provide).

Images on the other hand have no text, no scenes, all you have are individual images, with the meaning and access points held in the visuals.

Some will say that this is really not a problem, all you need to do is use content based image retrieval software to identify colours, textures and shapes in your images, and you'll soon be searching for images without any manual indexing. However, whilst this technology is promising, it leaves a lot to be desired.

Today, the way to provide a wide and deep level of access to still images continues to be by using people to view images, write captions and assign keywords or tags to each image based on image 'depictions' and 'aboutness and attributes'. This manual process often requires the use of a controlled vocabulary to improve consistency and application.

However, how this indexing is done and what structures support it, will be the subject of further posts- I just wanted to get my thoughts out there !

So Stay tuned.

Why My Dog is Like a Search Engine Without a Taxonomy

A couple weeks back i asked my 130 pound dog Townes if he wanted a 'biscuit' and he ignored me- i had forgotten that he isn't the smartest dog in the world and that he can not make the automatic association that a 'biscuit' is a 'cookie' so as i spoke, he just stared into another room. (read: it really isn't that he is dumb just that he wasn't trained). Now he has become a bit of a taxonomy star and it might be getting to his head.

Today i ran into someone who had just read my personal blog for the first time recently and had seen my post titled "Why my dog is like a search engine without a taxonomy" and had loved the video i made. She told me that she used it in an internal discussion about taxonomies. She wasn't the first one who has said they loved the video so i figure i would repost it here.

So that morning when i asked him if he wanted a 'biscuit' instead of a 'cookie' and all i got was was a blank stare, i told him he was "like a search engine without a taxonomy" and then he looked even more confused. Then we made this video. He is a bit bored in this video because it is the second take so the intial reaction is not 100% but hopefully you get the idea!

The moral of the story? As humans we easily make associations between words- machine and dogs can't unless they are "trained".

He is a 4 year old Great Dane in case you are wondering- and yes he got lots of biscuits and cookies that morning! (like most days....)

Author Spotlight: Ian Davis Global Project Delivery Manager Taxonomy Delivery Team

My name is Ian Davis, and I'm a Global Project Delivery Manager working in the Client Solutions Taxonomy Delivery Team and based in our London office. I work to develop and deliver a range of content and information solutions for our global clients. Projects can include discovery assessments, taxonomy strategy and creation, taxonomy mapping, search support, information architecture and website development. I also assist in the marketing and deployment of Synaptica, a semantic management tool offered by Dow Jones, and the website www.taxonomywarehouse.com.

My particular areas of interest include: developing taxonomies, thesauri, and metadata schemas, manual and automated indexing of still and moving images, deploying and using Synaptica controlled vocabulary software, the challenges of managing teams of geographically dispersed information workers, website creation and development, and the localisation of content into multi-lingual environments"

I joined Dow Jones in February, 2006, after 13 years developing taxonomy and indexing solutions for still images libraries at both Corbis Corporation and Photonica (formerly part of Amana Japan and now part of Getty Images). At Corbis, I served as head of the UK division’s image cataloguing department. At Photonica, I worked to create and implement the e-commerce website www.iconica.com and was responsible for the development of www.photonica.com. I also developed, implemented and maintained all vocabularies underpinning the classification and retrieval of Photonica's extensive digital image content. One aspect of this included creating an extensive English language thesaurus and managing the localisation of that controlled vocabulary into five European languages. I managed a team of ten still image indexers and five thesaurus developers. After leaving Photonica, I worked as an independent consultant for BUPA in the area of metadata and taxonomy creation and development, and the implementation of an enterprise search solution.

Most of my time is currently spent working on the delivery of a major client engagement in Asia. I'm managing a team of geographically dispersed staff who are working on the customisation of a large topical thesaurus and the creation of various browsable taxonomies. We're also creating a multi-lingual thesaurus by translating the large English thesaurus into three other languages and tying the whole lot together. If that wasn't enough, we're also involved in the mapping of the vocabularies we're working on to both legacy internal client vocabularies and to third party ones. We're also starting to consider how to move these thesauri and taxonomies into the world of ontologies."

Audience Centric Taxonomies: Talk to Them Like You Know Who They Are

For many organisations, providing a single way to navigate information resources is unlikely to meet the increasingly complex needs of a diverse audience of users.

Forcing users to locate resources in a fixed manner is usually the main culprit in most failed taxonomy implementations. This problem is especially pronounced when users are migrating from their own information 'silos' to organisation-wide repositoies. To reduce resistance from users and to ease the transition into an environment that is more conducive to knowledge sharing and collaboration, multiple taxonomies reflecting the preferred discovery patterns and terminology of different user groups are highly recommended.

Those who have implemented taxonomies may immediately balk at this idea, since it could lead to a maintenance nightmare. However, we found that it is possible to both customize taxonomies for different user groups and to keep maintenance efforts to the minimum. Of course, this must be done with the proper planning, understanding of user needs and the right tools.

And this is where Synaptica fits in perfectly. A key differentiating feature of the Synaptica taxonomy management tool is its ability to provide 'audience-centric' views to diverse sets of users, yet maintaining a single 'master' taxonomy. This nifty feature builds upon the foundation of a master taxonomy by allowing alternative preferred terminology to be defined for multiple audience segments via audience 'extensions'. Terms that are not relevant to a particular audience can be suppressed and additional details or depth that are needed by another audience can be developed - depending on which 'extensions' are being deployed onto the navigation platform (Intranet, portal e.g.).

Synaptica automatically manages the relationships between the master taxonomy and its extensions, thereby enabling consistent searching using diverse taxonomic views. More importantly, it makes maintenance seamless as changes in any term will result in automatic updates across all 'audience-centric' views, eliminating the need to duplicate efforts across multiple taxonomies.

With the help of the Taxonomy Services team at Dow Jones Client Solutions, various organisations are using, or are planning to use this feature in Synaptica to enhance the information discovery process and experience. For example, in a typical corporate setting, users from different departments can continue to browse their contents using familiar terminology and views, even though they are really using a larger enterprise-wide taxonomy. Such functionalities help to lessen user resistance while fostering knowledge sharing at the same time.

In a wider context, such as that of a digital library designed for the Public, 'audience-centric' views can be designed to provide optimized browsing for varied audience segments. For example, the browsing needs on a topic such as Health and Medical Sciences would be very different between the general public and academic/researcher segments. These are just some of the taxonomy design and maintenance considerations that Synaptica addresses.

What this all means is that with the help of an experienced taxonomy design team and the right tools, knowledge managers can truly lay the foundation for improved information discovery and sharing without having to worry about details that can already be addressed by using existing tools and best practices.

To learn more about Audience Centric Approaches please see this paper:'Audience-Centric Taxonomy: Using Taxonomies to Support Heterogeneous User Communities'. This paper describes how the National Library Board in Singapore intends to utilize audience centric taxonomy to provide enhanced information access to its multilingual, multi-cultural user community.

This post was co-written by Tan Pei Jiun, a Dow Jones Senior Taxonomy Consultant based in Singapore.

ImageFlickr stephanieasher

Does Taxonomy Management within Microsoft SharePoint Always Need to be Painful?

It is a known pain point for companies who have adopted SharePoint that there is no ‘out of the box’ feature for classifying the ever growing content that they have across multiple sites. As more companies adopt SharePoint globally, the grunts of pain are becoming louder and louder and we certainly hear them and are working with our customers to ease that pain.

For an introduction to Dow Jones’ taxonomy services and a better understanding of the use and benefits of taxonomies within a SharePoint implementation, attend our upcoming Webinar on Thursday, September 11th. Entitled Taxonomy and SharePoint: A Powerful Combination. During this session you will learn some of the basic ways to manage controlled vocabularies using standard out of the box features that you can use immediately as well as learn about our upcoming Synaptica integration into SharePoint.

September 11, 2008 1112pm : Webinar: Taxonomy and SharePoint: A Powerful Combination
Webinar: Taxonomy and SharePoint: A Powerful Combination
Date: September 11, 2008
Time: 11:00 – 12:00 EST
Register Now.

SharePoint helps your organization connect people to business critical information and expertise in order to increase productivity and reduce information overload by providing your employees the ability to find relevant content in a wide range of repositories and formats. Understanding and using Taxonomies within a SharePoint implementation to help users find content, is an essential part of ensuring a successful SharePoint deployment. A Taxonomy can range from quite simple to very complex. In this session we will cover the basics of evaluating what you can do to create a simple taxonomy that will yield the most benefits for your SharePoint implementations. In this session you will learn a range of Best Practices, from the basics of building a taxonomy to the implementation of a taxonomy within a SharePoint site.

Recorded Webinar Available from this session on demand

Image|Flickr|By Vanessa Pike-Russell

We Hit the Airwaves with a ReadWriteTalk Podcast

In early June, I published a ebook about hybrid approaches to Folksonomies and Taxonomies in the Enterprise that has been very well received. Beautifully designed, it provides a high-level overview on why companies should be looking towards user tagging as a part of their content strategies.

So last month when i was approached by ReadWriteTalk about being interviewed for a podcast on the subject of the ebook I was pretty excited and of course a bit nervous at the same time. ReadWriteTalk podcasts are just one of the many podcasts that i listen to on a weekly basis so i certainly did not want to embarrassed myself! But beyond stumbling over some words, i think i did a decent job discussing the reasons I wrote the ebook and highlighting what the ebook covers. Although it is my face on the cover of the ebook (i share some of the behind the scenes as to how that happened), I also spend some time talking about the design of the book and the wonderful team I worked with to get it produced and made available for free download for everyone.

Sean Ammirati interviewed me and did a great job of not only prepping me for the interview but also making me very comfortable as we began discussing the questions he had. The podcast was also transcribed so if you prefer to read it versus hearing me go on and on and on about why it is important to look at some of the benefits of hybrid approaches...you can.

If 'Search' is the Answer, You May Not Be Asking the Right Question

Daniela's latest data visualization post and a conversation with one of the Dow Jones Factiva Project Managers earlier today got me thinking about a presentation I did a couple of years back for the Taxonomy Community of Practice. Seth Earley, TaxoCoP's founder and chief moderator, had once asked me to talk about my experiences with the Google Search Appliance, and part of my argument was to not simply dismiss it - given the cost, ease of implementation, and quality of results, it may (and does) suit the needs of many organizations.