Can There Be Device-Agnostic Research?

About six weeks ago, I attended the Mobile Research conference 2011 in London, where a variety of vendors and clients talked about their experiences with mobile as a research methodology. They shared a range of mobile research methodologies, like using text messages in emerging markets, mobile ethnographic studies, geolocation tracking, and mobile behavioral tracking data. You can find most of the presentations here, and if you want to see me in action as roving reporter, you can click here.

During the whole conference, there was a clear line between the benefits and challenges of online research versus mobile research, and how the two can strengthen each other. Then at the end of the second day, someone asked the following question to the audience: “Do you consider tablets a PC or mobile device?” The answer was almost unanimous: a mobile device.

This got me thinking about the whole concept of mobile research in more detail. In fact, I was wondering if something like a mobile research conference would still exist in a couple of years, because the rapid technological developments of smartphones and tablets will blur the line between mobile and online research. Can we, as researchers, continue to define the research methodology in the future, or are the respondents going to do that? This line of thinking led me to ask this question to our community members: Should research be device-agnostic?

The feedback I got was again unanimous: Yes, it should. But this response was immediately followed by a question: Can it be device-agnostic? What does that mean for response bias? How can we control the sample? How will results be comparable? These are all valid questions, but it is something we have to overcome and live with. One thing is clear: We can’t tell our respondents which device they should use to open up our surveys.

I believe the research industry has to strive for a parallel approach. The survey software vendors need to develop a way to recognize the device when people open up a survey invite and offer them a survey that is designed specifically for that device (short and sweet when it’s a smartphone, long and tedious when it’s a PC). This software should be able to handle not only the different devices but also the sampling and quota setting that go with it. On the other hand, researchers need to become much more creative. They need to build a research framework with different surveys for smartphones, tablets, and laptops — using the strengths of each of the devices for gathering insight.

What do you think? Is device-agnostic research the future?


Is device-agnostic research the future?

a very interesting post. thank you.

the question is not if its the future, as its available if one wants. the real question is when. when will we hit that tipping point.

in the last 2 year i have seen the mood go from voodoo science to hmmm interesting to yeah you have a point, will be nice. we are yet to get to the point that we have to do! waiting waiting waiting ....

most clients and mainly agencies are embedded in systems of one fits all. the whole research process often written in stone. hybrid and multi channel (device agnostic) solutions have no rules.

if mobile and device-agnostic research is to become a mainstay we need to change the rules. rewrite the processes. reskill the reseachers & operations.

my 2 bits :)