Leonardo ENERGY’s Impact

Assessing the Impact of the Leonardo ENERGY Initiative

Entries Tagged as 'impact'

Macro indicators relevant to our campaigns now published on-line

July 23rd, 2008 · No Comments · evaluation, impact

A selection of European and World macro indicators relevant to our campaigns is now published on-line.

To assist the development of campaign impact assessment, the indicators have been posted here:

http://www.leonardo-energy.org/planning/?p=801

This is only a selection and other indicators exist. However, these are the key indicators most in use today.

I would be delighted to gather more for the team, on request.

[Read more →]

Tags:

Tonnage impact per trainee

July 9th, 2008 · No Comments · impact

Another approach for impact is to measure tonnage per person reached. Historically, we’ve not done this as it produced very high dollar/tonne campaigns, and hence needs very high replication factors for such programme to work.

However, with the recent advances in web-based communication, the subsequent factor X cost reduction in delivering messages, our mastering of these technologies and the traceability it offers, it may be time to rethink.

Hereby a message from Jonathan which I’d like to log here. It summarises our current knowledge on the subject.

[Read more ?]

[Read more →]

Tags: ·

4 type of communications – 4 campaign types

March 20th, 2008 · No Comments · impact, reception analysis, technical communication, tools

Communication can serve 4 purposes:

  1. inform – raise awareness
  2. interpret – raise understanding
  3. convince – support readers to develop an opinion or correct a misunderstanding
  4. behaviour change

Obviously, the ultimate goal is behaviour change, this is largely an outcome beyond our control. Most communication are inputs designed for #1-3, with the ultimate purpose of achieving number 4.

This list may be of interest to think about our marketing communications. In essence, it reiterates the point of an earlier post on measuring impact from a different perspective.

The key question is the level of resources we choose to deploy towards a given objective. This needs to be combined with a benchmarking approach on cost effectiveness and quality of the action. As an impact assessment methodology, I sense there is something fundamentally different, but cannot yet put my finger on it. To be continued.

Blogged with the Flock Browser

[Read more →]

If you know your return, it could have been more

March 3rd, 2008 · No Comments · impact

In physics the Heisenberg uncertainty principle rules. It states that it is impossible to measure the impulse of a particle if you know its exact place, and vice versa.
In marketing communication, there is also an uncertainty principle: the maximum return of your communication action is impossible to measure. Because once you make the return measurable, it loses value.

Perhaps this is not quite so much the case if your market enables a streamlined communication. If you’re selling diapers, you can measure your market share before and after your communication action, and this will allow you to make a fairly good estimate of your return.

But if a chaotic communication model is to be preferred (see my previous post), things aren’t that easy. The paradox is that the more you want to make the return measurable, the more you will have to streamline your communication and the less effective your communication will be.
[Read more ?]

[Read more →]

Surveying users

February 28th, 2008 · 5 Comments · evaluation, impact, reception analysis, tools

We need to decide whether we want to survey few users in-depth, on many user groups on a variety of issues in a shallow way.The latter appears more appropriate considering the rich content of LE. In this case, a simple attitudinal measurement instrument is needed. Ref [1] divides groups in 5 categories of receptivity: hostile, neutral, uninterested, uninformed and supportive. Each group requires a different approach:

  • hostile: find areas of agreement, use solid science, phrase proposals in value terms. The goal is to divert negative activism into neutrality.
  • neutral: spell out benefits, focus on the downside of not accepting a proposal, discuss alternatives. Keep it simple. The goal is the convert neutrals into supporters.
  • uninterested. these people are informed, but simply don’t care. Appeal to their self-interest.
  • uninformed: lack information. Establish credibility. Keep it simple. Find an emotional link (stories, anecdotes, case studies, …).
  • supportive: keep them on your side. Recharge them, remind them of the stakes, help them with arguments against opponents.

The criteria of a dream case is a positive answer to 5 questions. However, in the real world, such cases do not even need selling – they fly by themselves. So it’s a matter of approaching the ideal as much as possible:

  1. is the case logical, and consistent with facts and experience?
  2. does it favourably address the interests of people who have to decide?
  3. does it eliminate or neutralise competing alternatives?
  4. does it recognise and deal with politics?
  5. is it endorsed by objective, authoritative 3rd parties?

[1] Harvard Business Essentials, Power, Influence and Persuasion, HBS Publishing 2005

Blogged with Flock

[Read more →]

Evaluating programmes

February 26th, 2008 · 1 Comment · evaluation, impact

Bill’s 4-step method to evaluate technology may also be suitable for programmes:

  1. Establish that there is a copper potential to be influenced.
  2. Develop a conceptual model how the programme influences this potential.
  3. Collect evidence that the programme works as designed.
  4. Verify the return. Benchmark activities. Check quality.

A programme statement along above lines does not need to be long. In fact, shorter statements reveal crystallised thinking. For example:

  1. Technical solutions are emerging to assist the elderly and mobility-impaired to live comfortable and independently at home. These require a significant upgrade in the electrical installation.
  2. This market needs custom solutions for target groups sharing a pathology. The programme will work at 3 levels: (1) mapping user needs through market research, partnering with consumer organisations, (2) develop training packages on ‘smart installations’ for contractors in partnership with their federation and (3) develop cost-benefit analysis for governmental organisations to provide financial support with a net benefit on social security budgets.
  3. In the short run, this programme will be measured on its intelligence gathered, and outputs produced, e.g. user research reports, training courses published, training courses delivered, cost-benefit analysis case studies, … In the medium run, the emergence of solution package will be monitored, with their market share. Copper IoU of various systems will be assessed. A final output to be monitored is government funding and soft regulation promoting this sector.

Blogged with Flock

[Read more →]

Marketing impact

February 18th, 2008 · 1 Comment · impact

The impact of marketing activities can be subdivided according to the direct relation between the activity and its impact, and the time horizon of the impact.

These variables are obviously correlated. The more remote the impact, the longer its time horizon.

Moving from left to right on the impact scale, complexity of measurement increases. Impact of a sales campaign which results in orders in the short-term should be relatively straightforward to measure. But the impact of marketing activities where an organisation tries to position itself, building reputation through a white paper programme is already more difficult. The 3rd level, which is typically our universe, is where marketing moves beyond the individual organisation, to pursue a grand objective such as regulatory action (or avoiding of) and joint market development.

Measurement in the first column will be done through sales. A good tracking system needs to be in place to determine customer lifetime value.

Measurement in the second column is done through sales trends. Simplistically, one advertises cookies, and observes more sales. Or one advertises an instrument, and observes an increase in leads, closure rate or both.

For the 3rd column, one needs to measure at industry level, observing market trends. The dilemma is that either aggregate statistics are available, but they are at a too high level, and hence noisy since they include many impacts. Targeted statistics for the programme are mostly not available, or not available with the accuracy needed.

A final observation is that the return on marketing investment for direct sales will be modest, but tangible. For remote activities, it’ll be much higher, but largely based on corroborated evidence.

Blogged with Flock

[Read more →]

Marketing Measurement Webcast series

February 18th, 2008 · No Comments · evaluation, impact, tools

Better Management has an excellent series of 6 webcasts so far on Marketing Measurement:
Marketing Measurement Today – BetterManagement.com

[Read more →]

The opportunity to influence

February 8th, 2008 · No Comments · impact

Standards and regulations (defined broadly) are an increasing part of our programme. These are seldom influenced by single or few organisations. Especially for the complex power system, affecting many users, a wide variety of stakeholders is involved in almost any issue.

This begs the questions:

  • In which issues should we get involved?
  • If we do get involved, how do we assess our impact?

Criteria to get involved could be:

  • the copper potential – often difficult to assess for complex policy issues (e.g. EuP) or even ‘simple’ standards
  • our background knowledge in the subject matter
  • relation to other campaigns we are involved in
  • the opportunity to learn
  • the opportunity to position ourselves

Once we do get involved, our influence will always be indirect. But as with classical education campaigns, one thing is for sure: not providing input will result in no influence. For regulation, the same interim tools then apply: inputs, campaign metrics, reactions, conversions. The latter can be measured by the usual tools: interviews, case studies, surveys.

[Read more →]

Relative return on investment

February 5th, 2008 · 1 Comment · impact

This post is about showing relative ROI.

To show the success of the electrical programme, it may be useful to calculate the cost of reaching each person in the target audience.

We can measure how many people we reach by conducting a survey now and then another (creating two data points) in the future.

To rate the success of the programme, we can then compare it to the cost of using other channels to reach the same number.

[Read more →]