The short answer: No.
Mobile applications have been a hot topic for a long while within the visitor-serving industry. There are mobile applications for all kinds of museums, zoos, aquariums, historic sites, and performing arts entities. But are people using them? And do they increase meaningful performance metrics like visitor satisfaction?
A (rad) museum professional recently tagged me in a Facebook conversation, asking if I had data that I could share regarding cultural audiences and mobile applications. Why didn’t I think about that before? At first I was a bit flummoxed about how to approach this, as IMPACTS has done work with individual client organizations to dig into the real benefits (or lack thereof) deriving from investments in developing mobile applications, but that data is proprietary. Translation: Not for publishing on Know Your Own Bone.
Fear not, friends! The trusty National Awareness, Attitudes, and Usage Study (NAAU) includes information related to mobile applications – and it’s shareable and reveals compelling and important information for visitor-serving entities. As a reminder, the NAAU is an ongoing study of over 108,000 individuals and counting (“and counting” because IMPACTS is constantly in-market collecting data). This study is also the source of much of the data that I share on my website.
The spoiler (consistent with most individual client experiences as well) is simply that a mobile application is an answer to a visitor engagement question that very few people seem to be asking. What many cultural professionals likely know from their own experience (and that the data reaffirm) is this: Not many visitors use mobile applications either prior to their visits or while onsite, and the ones who do use an organization’s app do not experience a significant increase in visitor satisfaction.
This makes mobile applications sound like a potential waste of resources, but it’s worse than that. Other information channels are used more frequently before and during a visit, and they actually do result in higher visitor satisfaction. In addition to being a potential waste of funds, mobile applications may be an expensive distraction from areas wherein modest investments actually do improve reputation and satisfaction.
The chart above shows the percentage of respondents who had used each information source prior to a visit, with the sample taken from folks who had visited a cultural organization in the last year. We are talking about mobile applications here, and that number (5.5% usage) is not abysmal! But when we look at other avenues of engagement that likely already exist for an organization such as web, mobile web, and social media…that 5.5% looks awfully low in comparison. (Quick note: “Peer review web” refers to sites like Yelp or TripAdvisor, and “WOM” stands for “word of mouth.”)
I know the argument: “Not every organization has a mobile app, so of course people aren’t using them if they don’t exist!” True. People can’t use something that doesn’t exist. Along these same lines, not every organization prints brochures, or has a mobile optimized web experience, or publishes information in newspapers or magazines. That’s not the point. The point is that a number of information sources broadly exist (including mobile apps), and these data indicate the market’s relative usage of broadly available resources. Does every organization have a mobile app? No. But do enough organizations have a mobile app to make them a broadly available information source? Yes. Moreover, mobile apps are sufficiently relevant in our overall culture to suggest their broad viability as an information source. People absolutely use mobile apps in many aspects of their life – they simply don’t seem to generally apply this usage to planning or visiting a cultural organization.
Take a look at the chart and consider: Mobile applications require an investment of funds to create – and that amount can be significant!
Also consider that information regarding the existence of an organization’s mobile application is likely to come from another source that is already more successful in providing pre-visit information. It is fair to consider that those 5.5% of folks may have already received information from another channel, and that’s how they knew to look for the application in the first place. The point is that even for the 5.5% who consulted a mobile application prior to their visit, they may not be consulting the mobile application alone.
But, then again, not all applications aim to be used pre-visit! Many aim to be used onsite in order to, theoretically, better engage and provide information for visitors! On that note, let’s look at the channels that folks reported having used onsite while attending a visitor-serving organization (museum, zoo, aquarium, theater, symphony, etc.)
There are a lot of interesting and surprising things to note here. The first of which is this: A smaller percentage of people use mobile applications during their visit (4.1%) than they do prior to their visit (5.5%) – and many applications are designed to be used onsite! In order to use a mobile application onsite, folks need to have already been willing to download it, or to take time out of their visit to get WiFi (depending on the size of the application) and download it on the spot. No joke: There are organizations that have invested in mobile applications but don’t have WiFi easily available to download it onsite in the first place. It’s a thing, folks! (As a note: “Web” is folks who bring laptops and use the web. Tablet web use is included in the “mobile web” category.)
Here’s another important finding: More than half of visitors use social media onsite. That finding alone is worth calling out. Social media is extremely important for cultural organizations for many reasons and plays an important role in increasing visitation.
With 31.5% of folks using mobile web onsite (looking up something on the web while on a mobile device or tablet that is not social media or a peer review site), it’s clear that there’s more of an inclination to use the web rather than a mobile application to gather information or engage onsite. This may underscore the opportunity to invest in website experiences that are mobile optimized instead of investing in a mobile application.
This chart is the arguably the most telling and important. Here’s how to read it: The red bar shows the overall visitor satisfaction level of people who report using a particular information source onsite (e.g. a mobile app). The blue bar shows the overall visitor satisfaction level of people who report not using that same information source (e.g. people who did not use a mobile app during their visit.)
As a reminder: Having high onsite satisfaction levels is critical for the solvency of visitor-serving organizations. Higher overall satisfaction correlates with greater reputation, more financial support, and increased likelihood for positive endorsements. In sum, high satisfaction is a major goal.
People who use mobile applications onsite do not report significantly higher satisfaction rates than those who do not. So, what was the point of that mobile application again? If it was to better engage audiences, the data is in and mobile applications – on the whole – don’t do that in meaningful manner. That finding in itself is significant.
Look at this: People who use social media or mobile web while they visit a cultural organization have a more satisfying overall experience than people who don’t use social media or mobile web during their visit. How interesting is that?! If your organization scoffs at folks on their mobile devices and considers them to be distracted or disengaged, stop it. Social media and mobile web make visitor experiences better (by good measure), not worse.
Regular Know Your Own Bone readers won’t be surprised by the onsite communication source that increases visitor satisfaction most: Talking to other humans. The overlooked superpower of visitor-serving organizations is that we are hubs of human connection. Reliably, interacting with other people is more important than the content that folks visit an organization to see – and interacting with frontline staff can make or break a visitor experience.
“But our mobile application is unique! It can be used to do X and Y and Z!” That’s great! The thing is: The market isn’t generally using mobile applications onsite and when they do, apps aren’t contributing to a significantly more satisfying experience…so your organization is singlehandedly attempting to “re-train” the market. Mobile applications have been used by cultural organizations for years now, and your organization may be looking to try and convert somebody who used one for another organization in the past (or your own first version) and felt it was “eh.” That’s a different starting point than where most organizations believe that they are: Developing a cool, new thing that tons of people will want to use out of the gate! Turns out, that’s not reality. Developing a mobile app comes with some embedded perceptual challenges.
More often than not, organizations that develop mobile applications are carrying out “technology for technology’s sake” when they haven’t tested its viability with the market, evaluated the related investment compared to alternative tools, or considered their goals or expectations. Simply, cultural organizations do it because they think they should or it makes them sound cool – nevermind if nobody uses it or it only makes the organization seem cool to staff or others in the industry. (Note: Others in the industry are not our important audiences).
With mobile applications dramatically underperforming the opportunity compared to other sources of information or avenues of engagement, a responsible organization should ask itself: Is investment in a mobile application the best possible use of funds? If there’s money in the budget, perhaps it ought to go to areas that audiences actually use and that make their experiences better. This includes investments in social media and also in frontline staff. (In fact, modest investments in frontline staff have yielded higher satisfaction rates for some client organizations than new exhibits and building expansions!)
This isn’t to say that no mobile application can be successful. No doubt, a select few gain notable usage – but these are exceptions, not expectations. If your organization is considering an investment in a mobile application because “I think we need one,” then you should probably consider the opportunity from the market’s perspective. Of course, organizations with good ideas should pursue them! Market test new concepts! Thinking caps are the best kind of caps, if you ask me. “Perhaps the kind of mobile app that we need to engage audiences hasn’t made it big or doesn’t largely exist yet!” Maybe you’re right.
It’s important to go into any initiative with an awareness of what visitors to cultural organizations are actually doing in the market and how mobile applications currently affect the visitor experience. (In general, they don’t.) Only then can an organization make an informed decision. That decision probably isn’t “to create a mobile application because everyone has one,” as many organizations may think. Instead, the decision may be “to fight the existing market perceptions of mobile applications by doing something new.”
Are mobile applications working to best serve our audiences? Do organizations need them? Do data suggest that mobile applications are generally an effective use of funds? The data-informed answer – to all of these questions – is no.
Like this post? Don’t forget to check out my Fast Fact videos on my YouTube channel. Here are a few related posts from Know Your Own Bone that you might also enjoy:
- The Visitor Engagement Cycle For Cultural Organizations (DATA)
- Hubs For Human Connection: The Social Role of Visitor-Serving Organizations (DATA)
- How Social Media Drives Visitation to Cultural Organizations (DATA)
- Data Reveals The Worst Thing About Visiting Cultural Organizations (DATA)
- Data Reveals The Best Thing About Visiting Cultural Organizations (DATA)
Interested in getting blog posts, tips, and some silly social media geekery periodically delivered in your Facebook newsfeed? Like my Facebook page. Or for more regular sharing of nonprofit marketing information, follow me on Twitter.
