![]() |
![]() |
| ![]() |
![]() |
![]() |
![]() |
![]() |
Social Influence Measurement
I just read Will McInnes Blog concerning MeasurementCamp and my brief thoughts are as follows:
A superb idea indeed and more importantly the correct format IMHO, structure is needed, probably more so when overt hierarchy is missing (though it exists covertly).
Sadly I heard about this late, not sure how, I just did, so I couldn't attend. However, had I been there (and I do hope to come to the next one), or one of them, I'd have suggested a branch or "gravitating crowd" invest a significant amount of time in some thorough research of the psychological/sociological nature.
There exists decades of academic research into "social behaviours", numerous models for how "social influence processes" operate, and in my personally limited research these are widely varying models, suggesting that not ONE model is proven as "correct", I can think of at least four.
It just seems to me that until that "nut" of conceptualising "social influence" is understood, choosing ONE model, and the measurement of it, will always be aimed at a "moving target", if you will.
I'll attempt to disseminate my research on this as I go along because it does fascinate me how many people seem to dive head-first into it, as they want to believe it is true - influencing that it.
UPDATE 15.04.08: I asked a psychologist friend Jo Jordan what her thoughts were on this (she commented below). Jo also helped my thoughts greatly on this topic by drawing pictures of my thoughts, I have posted them below.

Figure 1.1 Pre Social Media

Figure 1.2 Adoption of social media by many advertising agencies

Figure 1.3 True representation of the complexity of social media processes. Note that the community nodes may start as being the same singular community though as they are organic and constantly changing they naturally morph into different communities (with different perceptions), with different processes with time.
Take some time to look at these diagrams, Figure 1.1 is the easiest to understand, most simple, and the method by which advertising has worked for a long time. Figure 1.2 is where I think a lot of agencies are currently operating, almost using social media as a "bolt-on" with no "feed-back" loop, and also the potential to derive a crude metric based on purchases, proving the source of influence is registered. Then Figure 1.3 clearly indicates a complex system of organic processes, each highly dynamic, and each two-way dynamic node contains multiple models of influential process, depending on ones school of thought (belief) for influence reception (there are many models as stated previously).
It is with these further thoughts we are heading towards a more "process" oriented metric which rather than looking at the outcome (as in traditional above the line metrics) we instead study (or measure) the relationships in the nodes.
This post is now a work in progress.
UPDATE 14.04.08: I'll be adding a resource list in this post as they are collated
Social Influence Measurement Resources
- Situating Social Influence - Winter A. Mason, Frederica R. Conrey and Eliot R. Smith, 2008
- Why I Love Bees: A Case Study in Collective Intelligence Gaming - Jane McGonigal, PhD
- Design Of Online Communities
Chris Hambly






Technorati Tags: 
Comments
"Social Influence" and other Constructs
An understanding of social influence strikes me as something that *MUST* be a moving target, different as time goes by and depending on the context in which it is applied. Coming from a science background, I finally got my head around (at least partly) the concept of a model or a lens or a framework for analysis that is useful, but not *THE TRUTH* or the final answer. This comes up all the time in educational research on, for instance, how we should teach or what needs to be done to improve education, or...substitute your favorite question or issue. The answers differ depending on what your assumptions are about the purpose of education and personal values. And even when people agree, there is simply not one right answer. "Getting" this actually helped me to understand that science also consists mainly of models with explanatory value that are useful until or unless a better model is constructed using new data or concepts. It made me less focused on pinning down social constructs with answers based on empirical research. Context is everything.
Context is everything
Yes, and wisely stated Liz.
Clearly marketers want to prove with numbers, the answer(S) will be in academia.
Intriguing
I suspect you heard about it from my Twitters, considering the valid nagging I got from you about not mentioning it earlier!!!
And I can definitely see how the social behaviours aspect should be included in some way. I suspect the reason that it didn't come up at the initial meet was due to the overwhelming concerns of most people there, that we're all experimenting and using social media, but have no ways to judge success within markets etc due to a lack of benchmarks and consistent measurements - and the need to justify investment/show returns as an agency or a client.
I believe the plan is to have monthly meetings - at least to begin with - so hopefully you'll be at the next one...
why and how
"but have no ways to judge success within markets etc due to a lack of benchmarks and consistent measurements"
Yes, the point is that we know people (marketers) really are seeking answers or proof, and a "yardstick", but I personally feel many multiple yardsticks will be required depending on which social influence process model you (as an agency) personally believe to work, which may, and probably, will differ from agency x, or should at least.
It's far too short-sighted to just accept that people "are" magically influenced, as in we are all equally influenced in the same manner, a measurement needs to address why and how we are influenced individually (because we are).
We can't employ above the line measurements (which we've grown up with) to below the line processes.
I'm all for multiple yardsticks
In fact, one of my suggestions at the first MeasurementCamp was to not only list the possible measures, but to start grouping those together which work for different strategies/aims, and which work at different stages of a user journey. To use an obvious example, you wouldn't rank Time on Site highly if you're doing something on Facebook to raise brand awareness.
But I do think we need some above the line measures. It would be impossible to go a huge number of CEOs etc at the moment, and propose a substantial financial investment into community/social media/buzz work, without being able to show some kind of reasoning for what goes on at the financial bottom line. And I don't know many CEOs or MDs who would be happy to stake six figure sums without some kind of simplified topline strategy.
So I think the measurements need to be a mixture. For those at the coalface, there needs to be as much insight into how behaviour works, how to interact etc, and there also needs to be ways and means to show the results it has.
Only by bringing those two things together cohesively can we prove community works in a more than anecdotal way, and be able to stand it up as more than a nice to have experiment. I'm lucky in that most people in my company are very, very enthusiastic about the opportunity it gives us, but I need to make sure there enthusiasm is backed up, or it'll always be seen as something intangible, and therefore not worth really concentrating on...
above the line measurement
What do you define, or how would you define "above the line measurement" ?
Just conceptually, not as in finding the answer, just as a concept.
Podcamp NYC/ Social/Psych metrics
Hi Chris! I am so glad you are coming to Podcamp NYC!! Based on your last post alone, I cannot wait to chat at Podcamp! I am having you lead off the Education track on Saturday (if that's okay), as I think this is a great way to open up the day.
Chris Brogan was posting about a new filter tool this morning, and he wanted to know about human factors. I responded that the the old days, a secretary did this work for you- a real person, creating a clip file- but that's not an internet free service!
The bottom line is that we can't factor people out of the online equation- everything cannot be automated and still have the feel we need it to without taking the sociological factors into account. Cognitive psychology, motivation theory and the like are just as important when looking at online communities, and how to make them durable over time.
Email me if you get a chance- would love to share coffee at the very least at Podcamp NYC
Whitney
psychological and sociological research
Hello Whitney.
Yes, let's have coffee and chats in NYC.
"Cognitive psychology, motivation theory and the like are just as important when looking at online communities, and how to make them durable over time"
What I am digging into here is the concept of "influencer". I do not personally believe we as humans are influenced equally, psychological and sociological research suggests this. I've not seen any account of this in the Blog scene at all (I'd like to find some), however, I've read lots of assumptions on Blogs that "influence" is one-dimensional. The danger is that mis-information becomes assumed as truth.
Ahh, the topic of influence
Hi Chris,
I think you are right in your assumption that not all humans are influenced in the same way or at the same rate. It is the old nature or nurture debate and my opinion... I think that the rate and depth of influence on an individual relies upon a mix of their cultural background, their gender, their social status, their family, their friends, and the amount of pressure being exerted by the influencer.
That said, a person's ability to question is also a large factor, and I am not sure if that is a seed that lies within us or if it is something that must be taught.
something that must be taught
Stephanie hello.
"seed that lies within us or if it is something that must be taught" - very good point, or perhaps not supressed, or more ironically "socially conditioned"?
Research and 'social influence'
Part of the problem with measurement is the notion of specifying precisely *what* it is that is being measured... Opinion leadership? Viral registrations? Product/brand awareness? Product/brand recall? Intention to purchase? Actual buyer/adopter behaviour?
Then you have the 'moving target' phenomenon of any of the above classifications, measured over time, and based on social, economic, political and technological changes in the marketplace.
For a long time, I've been interested in developing a suite of criteria for determining an appropriate measure of influence, rather than seeking a single system of measuring influence. This set of criteria would assist strategists in providing a launch pad for measurement rather than resorting to the collation of ad hoc statistics and data that can be meaningless or even deceptive. Back in February, a Chinwag gig in London considered the issue and the consensus was that it would be useful to have an open source-style conversation and collective research effort in developing the range of social media influence tools and measurement techniques - pretty much what was recommended at MeasurementCamp. But what we need to ensure is that the initiative doesn't get bogged down in the interests of *just* the technologists, or *just* the marketers and statisticians. The only way in which such a system would work is if all stakeholders can collaborate to produce at first, a range of measurement techniques, and then a series of criteria or a decision assistant focusing on which measurement techniques are appropriate at given times of a product/business lifecycle.
This is *not* an easy task. But it will be massively useful, for technologists and decision makers alike.
And what about the R&D process...
Not only the processes for the devloped product/idea have changed. Social interaction also influences R&D of the product/idea (your piece being a case in point). Often consumers are now involved at a much earlier stage of development than ever before influencing the actual outcome of the R&D stage.
Instead of closed, selected target groups that give their opinion on a concept during R&D the general public can now get involved. Whether that is good or bad remains to be seen.
open source
Absolutely, I was hoping the diagram was representing that in fact.
The first two boxes of design <> community would account for that, perhaps it needs to be visually clearer? Probably it does.
As an example of this in a real world scenario I'm part of a group of users, a "think tank", developing some podcasting software. We use a private forum and feedback regularly in each instance of update. Private in this case works well, though limited in numbers it does prevent things getting too noisy an is easy to steer and focus, with control.
Open Source is another more public and "open" example of this of course with less control.
This is not particularly new of concept though is it? I've been using OS software for literally years, and in a business space. It's only now that people attach the buzz of "Social Media" to the area right?
Stuck in a Diagram 1.2 world!
Great piece Chris and very thought provoking.
I have a lot of time for Will and what he is trying to do and know some of the folks that attended there (having had a few client meetings with them too!) - there is certainly the understanding and skills to make something extremely positive come out of this.
With regards to diagram 1.2, it is very representatve of a lot of client thinking (and to some extent, the way the agency feels obliged to think too). "Social Media" has, in most cases, a very woolly ROI to it and clients struggle to justify the open-endedness of activity within a network compared to a more measurable medium (banners or PPC).
As such, organisations look to either moneitse directly from the "social media" activity because it is the shortest, most direct route to a measurable result, or try and tie the actvity in with another medium they are already comfortable with measuring (SEO for example).
For this very reason we end up not moving any closer towards diagram 1.3.
I/we as a result, frequently end up having to present blogging/social media activity in with two "conventionally" accepted ways of measurement - 1) market research and 2) SEO - in order to get buy-in from new clients. Once on board, it becomes much easier to extoll the virtues of community building (diagram 1.3).
Number 1): Market Research
Organisations understand market research and as such, however new the aforementioned toolset is, it is still within the average Joe's ability to understand what we are looking to achieve. Online research of the type we use (understanding who the key influencers are, discovering what they are saying and finally, measuring the sentiment of their comments) however new, still provides results that the organisation understands.
Number 2):
Likewise, as Will will testify (is that poor English?!), using blogs to promote SEO benefits is a) a fact, and b) very powerful and bridges that gap between a new, uncomfortable medium and an already measured metric. As such, I feel that the opportunity to move towards diagram 1.3 lies here.
As PPC prices rocket, clients are actively looking for ways to do things more effectively, cheaper but importantly, as quick as PPC allows them to.
The blog (for example) is one such device and permits the client to control (and get a grip on) to some extent, the level of community management they may expect to entail if they did go full-tilt into a social environment such as that depicted in 1.3.
They then begin to see a path to full community management and a way to arrive much more favourably, at their end goal.
Just a few thoughts...would be interested to see where this all goes now!
in-bound-links and google keywords
Hello Paul
Appreciate the response and it's an honest "balanced" perspective of the current "grid-lock". Of course, selling "social media" in the twinned arena of SEO and market research is perfectly valid; why wouldn't a client want to garner opinion and in doing so obtain some more in-bound-links and Google keywords, makes perfect sense to me.
Maybe that IS the only plausible metric currently for ROI albeit "woolly", maybe Figure 1.3 is unattainable for most companies as a concept, never mind wrestling with a potential multi-layered (6 weave double hatched woolliness) metric.?
As I consider this more we could say that essentially Figure 1.3 depicts Open Source, such as the open source models for software development, most companies are not in a position, nor likely to be OS.
And if companies do desire to be OS (think Mercedes having the crowd design the engine) who pays for the R&D?
I'm also fast going-off the phrase "social media" and prefer "open communication", which is of course closer to what it is (in Figure 1.3), and we've had that for a long time on the Internet with some demographics (forums for example).
Thoughts?
Post new comment