Marketing Online Software

  • Subscribe to our RSS feed.
  • Twitter
  • StumbleUpon
  • Reddit
  • Facebook
  • Digg

Tuesday, 20 September 2011

Sentiment Indicator: Social Media KPI

Posted on 21:01 by Unknown
People talk, they say good things about a brand, they say bad things about a brand or they just talk. Social media has become a place for people to make sure whatever they are saying is heard loud and clear by their friend and followers on Facebook, twitter, blogs etc.

Going through all this social media chatter to understand and figure out what is going on about your brand is a very labor and time intensive work. Even though many Social Media Monitoring tools have done a great job in aggregating the data from various sources, but to understand the context of those conversation and provide that to marketers in a meaningful way still needs a lot of work. Currently it really needs a human to understand the full context of the conversations and understand the sentiments of consumers.

However there are some metrics that can provide you a measure of the sentiments (positive or negative) of these conversations and indicate which direction they are going.

Social Media Sentiment Metrics


Almost all of the social media monitoring (listening) tools provide following metrics to help you understand the sentiment of the conversations about your brand in social media.
  • Total number of conversation or mentions about a brand, product or topic
  • Number of positive conversations or mentions about a brand, product or topic e.g. a tweet saying: I love brand ABC
  • Number of negative conversations or mentions about a brand, product or topic e.g. a tweet saying I hate brand ABC
Many social media analysts use these raw number of positive and negative conversation to monitor the health of their brand, competitor or industry in social media (positive is good and negative is bad, unless that conversation is about your competitor).

However,these numbers are not KPIs. For example, if one day there are 100 negative conversation about your brand and the next day you have 50 negative conversations then what does it really mean? On the surface it looks like you have done something good to bring down the negative conversations by 50%. Is it really true though?

To fully understand those numbers we need a little more context. Looking at the total number of conversations about your brand might provide some context. Say, there were total 200 conversations about our brand on day1 and 100 on day two. If we take percentage or ratio of positive conversation to total conversations and ratio of negative conversation to total conversation we find that we did exactly the same on both the day.

On Day 1: Negative Conversations/Total Conversation Ratio = 100/200 = 50%

On Day 2: Negative Conversations/Total Conversation is 50/100 = 50%

As you can see these ratios or percentages provide much more information than the raw number did. Even though raw negative mentions were down, as a percentage your negative conversation were about the same on both the days. This is where many social media analysts and marketers stop and use the above 5 metrics as KPIs. Let’s relist the 5 KPIs discussed so far
  1. Total Conversation about a brand, product or topic
  2. Number of Positive Conversations about a brand, product or topic
  3. Number of Negative Conversations about a brand, product or topic
  4. Ratio or Percentage of Negative Conversations/Total Conversation
  5. Ratio or Percentage of Positive Conversations/Total Conversations

But something is still missing in these metrics. Those who have analyzed social media conversation know that majority of the conversations are classified as “Neutral”. Neutral means that there is no positive or negative sentiment in the sentence or the conversation in which that brand, product or topic is mentioned. In my experiences, over 90% of the conversations are neutral. So let’s take another example to show how that messes up the above KPIs.
  1. Day 1
    Total Conversations: 1000
    Negative Conversation: 5
    Positive Conversations: 10
    Negative/Total Conversation = 5/1000 = 0.5%
    Positive/Total Conversation = 10/1000 = 1%
  2. Day 2
    Total Conversations: 1500
    Negative Conversation: 5
    Positive Conversations: 10
    Negative/Total Conversation = 5/1500 = 0.33%
    Positive/Total Conversation = 10/1500 = 0.67%
In the example above, it looks like our positive and negative conversation both dropped on day 2. Though in reality, looking at the raw numbers there was no difference in the volume of positive or negative conversations. It just happened that “neutral” conversations went up on day 2 causing the percent of positive and negative conversations to go down.
So as you can see, in this case raw numbers are a better indicator than the percentages or ratios. So you can see how none of the above 5 KPIs provide an accurate view of sentiments of conversations in the social media. We need a better KPI.


Sentiment Indicator

I use another KPI, that I call "Sentiment Indicator" or "Sentiment Index", which in my opinion, is a better indicator of sentiment then other metrics that we discussed. Here is how I calculate “Sentiment Indicator”:

Sentiment Indicator = (Positive Conversations – Negative Conversations)/(Positive Conversations + Negative Conversations) 


(Note: Even though neutral comments are still good for analysis, I do not use them in my calculations of Sentiment Indicator.)

Using our example above Day 1, The Sentiment Index will be 10-5/(10+5) = 33%, which is exactly the same as that on the Day 2.

This metrics is more actionable than other metrics. If it goes in negative direction that means we are getting higher number of negatives as compared to positives and it is time to get into action. If it goes in the positive direction then we must be doing something good and time to find out what that is. Also, many times I will use the volume of conversation along with it to make sure that while we are maximizing the positive conversation we are also enabling the total conversation volume to go up.

Note: You should still dig deeper into those conversation, particularly the negative ones and see what is going on. Sometimes even one negative comment can quickly go viral and ruin your reputation.

Your turn now. How do you measure sentiment?

If you are not sure and need help, don't hesitate to email me at batraonline (at) gmail (dot) com or leave a comment on this blog post.

------------------------------------------------------------------------------------------------------
Web Analytics Jobs:

  • Senior database developer (Sr. SDE) Optizent Redmond, Washington
  • Associate Games Analyst Arkadium New York, New York
  • Director of Analytics Arkadium New York, New York
  • Web Analytics Engineer - Contract (POP) POP Seattle, Washington
  • Web Analytics Manager Gilt Groupe New York, New York
  • Website Analyst Simplexity Reston, Virginia
  • Principal Web Analyst AOL Virginia
  • Senior Web Analyst VML New York, New York
  • Director, Analytics VIMEO New York, New York
  • Web Marketing Analyst (International) j2 Global Communications Los Angeles, California
  • Senior Analyst, Web Reporting and Web Analytics TXU Energy Irving, Texas
  • Director, Digital Analytics Deluxe Corporation El Segundo, California
  • Digital Marketing Analyst Makeover Solutions Inc. New York, New York
  • Senior Web Analyst VML Kansas City, Missouri
To add open positions, visit Web Analytics Jobs Board



Email ThisBlogThis!Share to XShare to Facebook
Posted in KPIs, social media analytics | No comments
Newer Post Older Post Home

0 comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Popular Posts

  • NebuAd’s response to my blog post
    In response to my post on ISP based Behavioral Targeting , I got the following response from NebuAd: Below are a couple of quick points from...
  • 25 Twitter Hashtags Used By Digital Marketing and Analytics Community
    Hashtags (keywords that follow #) are a great way to jump to topic and join the conversation on twitter. Below I have complied a list of 25...
  • Web Analyst Interview: Julien Coquet
    Here is the first of my interviews that I promised in my last post Interview With Web Analysts What is your current position and the name of...
  • XChange, Web Analytics 3.0 and Behavioral Targeting
    I am back from from XChange , a conference organized by Semphoic in Napa last Thursday and Friday. The Conference consisted of many small d...
  • Engagement, is it a metric or an excuse?
    Avinsah Kaushik, posted a blog post stating that “Engagement is not a metrics, it is an excuse” . I beg to differ with Avinash on this one. ...
  • Email Personalization Not Working? Read This.
    I am a big believer in targeting and personalization and have written extensively about it in this blog. However, targeting and personali...
  • Unnecessary Outcry over Adobe CS3 and Omniture Tracking
    On Dec 26th a blog post on Uneasysilence.com showed that when a user launches CS3 suite adobe calls a server on Omniture. According to the a...
  • Web Analytics Jobs Trends – 2007
    Web Analytics is one of the hottest career fields these days. Organizations are realizing that web analytics can no longer be a part time wo...
  • Promotional Codes: Conversion Killers?
    Promotional Codes also know as Promo Codes, Discount Codes, Coupon Codes, Offer codes etc, are supposed to drive sales, right? However they...
  • 5 Reasons To Use Google Experiments
    Google Experiments is an A/B testing tool that is available within Google Analytics interface.  This post is not about what A/B testing is,...

Categories

  • A/B Testing
  • aaron lovelace
  • aberdeen group
  • actionable web analytics
  • adobe
  • Adwords
  • affiliate
  • ajax
  • akamai
  • ama
  • amazon
  • analytics
  • aol
  • ask
  • ask anil batra
  • b
  • bango
  • behavioral targeting
  • bing
  • blog measurement
  • blogs
  • BlueLithium
  • bounce rate
  • career in web analytics
  • cart abondonment
  • clicktracks
  • CMS Watch
  • Competitive Information
  • comscore
  • conference
  • conversion optimization
  • conversions
  • cookies
  • coremetrics
  • data
  • demystified
  • director
  • DMA
  • ebay
  • eCommerce
  • email marketing
  • eMetrics
  • Engagement
  • eric peterson
  • exit ratio
  • facebook
  • Flash
  • freelance
  • FTC
  • FTE
  • gary angel
  • google
  • google ad planner
  • google analytics
  • Google Analytics Filters
  • Google Analytics Tips
  • Google Trends
  • google web history
  • HBX
  • hits
  • homepage
  • IAB
  • IndexTools
  • India
  • interviews
  • iPad
  • iPhone
  • ISP
  • Jupiter Research
  • KPIs
  • landing pages
  • log files
  • marketing books
  • metrics
  • microsoft
  • mobile analytics
  • monthly recap
  • mulichannel
  • multichannel marketing
  • NebuAd
  • news
  • NYtimes
  • offsite analytics
  • OMMA
  • omniture
  • online advertising
  • online marketing
  • optimization
  • oracle
  • page views
  • personas
  • personlization
  • PPC
  • predictions
  • predictions 2007
  • predictions 2008
  • predictions 2009
  • privacy
  • quarterly recap
  • referrers
  • referring domains
  • retargeting
  • Reuters
  • revenue model
  • revenue science
  • search
  • search retargeting
  • SEM
  • seminar
  • SEO
  • shopping cart
  • single page visits
  • social advertising
  • social media
  • social media analytics
  • social networking
  • Speaking Engagement
  • spyware
  • subscription
  • survey
  • tacoda
  • time spent
  • toll free numbers
  • twitter
  • unica
  • unique users
  • url shortener
  • video
  • video analytics
  • visitors
  • visits
  • visual sciences
  • WAA
  • wal-mart
  • WAW Seattle
  • web analytics
  • web analytics education
  • web analytics jobs
  • webcast
  • webinar
  • webtrends
  • widgets
  • widmile
  • Yahoo
  • Yahoo Web Analytics
  • YouTube
  • ZeroDash1

Blog Archive

  • ►  2013 (12)
    • ►  November (2)
    • ►  October (1)
    • ►  August (1)
    • ►  July (1)
    • ►  June (2)
    • ►  May (3)
    • ►  March (1)
    • ►  January (1)
  • ►  2012 (12)
    • ►  October (1)
    • ►  July (1)
    • ►  March (2)
    • ►  February (4)
    • ►  January (4)
  • ▼  2011 (14)
    • ►  December (3)
    • ►  November (2)
    • ►  October (1)
    • ▼  September (1)
      • Sentiment Indicator: Social Media KPI
    • ►  March (3)
    • ►  February (3)
    • ►  January (1)
  • ►  2010 (34)
    • ►  December (3)
    • ►  August (5)
    • ►  July (5)
    • ►  June (3)
    • ►  May (2)
    • ►  April (4)
    • ►  March (5)
    • ►  February (4)
    • ►  January (3)
  • ►  2009 (40)
    • ►  December (1)
    • ►  October (4)
    • ►  September (3)
    • ►  August (4)
    • ►  July (5)
    • ►  June (4)
    • ►  May (1)
    • ►  April (6)
    • ►  March (5)
    • ►  February (4)
    • ►  January (3)
  • ►  2008 (89)
    • ►  December (7)
    • ►  November (7)
    • ►  October (6)
    • ►  September (4)
    • ►  August (5)
    • ►  July (5)
    • ►  June (9)
    • ►  May (7)
    • ►  April (6)
    • ►  March (10)
    • ►  February (10)
    • ►  January (13)
  • ►  2007 (112)
    • ►  December (7)
    • ►  November (5)
    • ►  October (8)
    • ►  September (9)
    • ►  August (7)
    • ►  July (11)
    • ►  June (8)
    • ►  May (13)
    • ►  April (18)
    • ►  March (13)
    • ►  February (10)
    • ►  January (3)
  • ►  2006 (12)
    • ►  December (3)
    • ►  November (3)
    • ►  October (1)
    • ►  September (2)
    • ►  August (3)
Powered by Blogger.

About Me

Unknown
View my complete profile