|||

Open questions in surveys are a great idea. But often, we don’t really have time to looking at them in detail.

Here’s a suggestion to make more use of data from your open questions.

Suppose you have just implemented a survey on attitudes to public transport, which includes groups of numerical questions on which the respondents rate the local transport system on convenience and value. And suppose you’d thoughtfully added an open question asking for more information on those answers.

Try making a chart with the total or mean scores on the two groups of numerical questions on the x- and y-axes, and add the answers to the open question as a third column to give the tooltips. It encourages the reader to look more closely at individuals who are extreme in one way or the other … who are the people who think the system is convenient but too expensive? And what about the typical” people in the middle?

Of course you can’t have tooltips on a printed document. I believe it’s really tricky in PDF. So it makes most sense to share your document on the internet. Here are some ways to do it, and one way using Excel.

Tableau public

The easiest way to do this is probably in in Tableau Public, as above. Full embed_code_version here.

Tableau Public is a free download - you install the program, work on your chart on your computer then press a button to share it to the Tableau website. You can also embed the chart as I did above (though I had to delete some whitespace in the embeddable code to make it work).

Google charts: HTML

With Google charts you just edit a piece of HTML and paste it into your webpage. It is not too difficult to edit the HTML, but it isn’t so easy to connect it to a database, e.g. a Google sheet. Still, the results are nice. Here I’ve included a third dimension (the sizes of the points — you can do that in Tableau too):

Google Charts in a Google Sheet

There is also a point-and-click version, when you embed a chart within a Google sheet, data connection is trivial but you can’t customise the tooltips so it doesn’t really answer the question I posed in this blog.

Google Fusion Tables

I also tried the same trick in Google Fusion Tables: here’s the template, you can copy it and adjust it to your needs.

However, it doesn’t seem to be maintained any more.

R

If you’re into R, you can do it with htmlwidgets. I found it a bit fiddly though to make the tooltips work.

Excel

You can do something similar in Excel, but you have to publish the workbook as an Excel macro-enabled file, which might scare some people.

Other uses

Rather than using the narrative data as a mere adjunct to the numerical data, you can also turn the method on its head. So you can focus mainly on the narrative answers - the numerical answers might be just e.g. age etc or some other variable which helps to put the narrative answers in context.

Sensemaker® uses some ideas like this too.

Up next A panel on visualising Theories of Change for EES 2018? I am thinking of getting together a panel presentation on this topic for The European Evaluation Society conference in Greece 1-5 October 2018: Realtime comments on a Theory of Change Wouldn’t it be great if, for an evaluation, you could map out the project’s theory of change and then pin the data (the answers to the evaluation
Latest posts causal-map Causal Map intro Causal Mapping - an earlier guide The walk to school in Sarajevo Glitches Draft blog post for AEA365 Theory Maker! Inventory & analysis of small conservation grants, C&W Africa - Powell & Mesbach! Lots of charts! Answering the “why” question: piecing together multiple pieces of causal information rbind.fill for 1-dimensional tables in r yED graph editor Examples of trivial graph format Using attr labels for ggplot An evaluation puzzle: “Talent show” An evaluation puzzle: “Mobile first” An evaluation puzzle: “Many hands” An evaluation puzzle: Loaves and fishes An evaluation puzzle: “Freak weather” An evaluation puzzle: “Billionaire” Publications Using Dropbox for syncing Shiny app data on Amazon EC2 Progress on the Causal Map app Articles and presentations related to Causal Maps and Theorymaker Better ways to present country-level data on a world map: equal-area cartograms A starter kit for reproducible research with R A reproducible workflow for evaluation reports Welcome to the Wiggle Room Realtime comments on a Theory of Change Responses to open questions shown as tooltips in a chart A panel on visualising Theories of Change for EES 2018? Peer mentoring for evaluators