Forrester continues to see ever-increasing levels of interest in and adoption of business intelligence (BI) platforms, applications, and processes. But while BI maturity in enterprises continues to grow, and BI tools have become more function-rich and robust, the promise of efficient and effective BI solutions remains challenging at best and elusive at worst. Why? Two main reasons: First, BI is all about best practices and lessons learned, which only come with years of experience; and second, earlier-generation BI approaches cannot easily keep up with ever-changing business and regulatory requirements. In the attached research document, Forrester reviews the top best practices for BI and predicts what the next-generation BI technologies will be. We summarize all of this in a single über-trend and best practice: agility. IT and business pros should adopt Agile BI processes, technologies, and architectures to improve their chances of delivering successful BI initiatives.
Business intelligence (BI) software has emerged as a hot topic in the past few years; in 2011, most companies will again focus their software investment plans on BI. More than 49% of the companies that responded to our most recent Forrsights Software Survey have concrete plans to implement or expand their use of BI software within the next 24 months. But being interested in BI software and spending money to adopt BI tools and processes do not necessarily translate into successful implementations: Forrester’s most recent BI maturity survey indicated that enterprise BI maturity levels are still below average (2.75 on a scale of 5, a modest 6% increase over 2009). Why are BI maturity levels so low, given the amount of money firms spend on it? Three factors contribute to this rift and can lead to less-than-successful BI initiatives:
Implementing BI requires using best practices and building upon lessons learned.
Why, oh, why is it that every time I hear about a BI project from an IT person, or from a business stakeholder describing how IT delivered it, with few exceptions, these are the stories plagued with multiple challenges? And why is it that when I hear a BI story about an application that was installed, built, and used by a business user, with little or no support from IT, it’s almost always a success story?
I think we all know the answer to that question. It’s all about IT/business misalignment. A business user wants flexibility, while an IT person is charged with keeping order and controlling data, applications, scope, and projects. A business user wants to react to ever-changing requirements, but an IT person needs to have a formal planning process. A businessperson wants to have a tool best-suited for the business requirements, and an IT person wants to leverage enterprise standard platforms.
Who’s right and who’s wrong? Both. The only real answer is somewhere in the middle. There’s also a new emerging alternative, especially when applied to specific domains, like customer analytics. As I have repeatedly written in multiple research documents, front-office processes are especially poorly-suited for traditional analytics. Front office processes like sales and marketing need to be infinitely more agile and reactive, as their back office cousins from finance and HR for obvious reasons.
In another token that the movement toward converged infrastructures and vertically integrated solutions is becoming ever more mainstream, HP and Microsoft recently announced a line of specialized appliances that combine integrated hardware, software and pre-packaged software targeting Exchange email, business analytics with Microsoft SharePoint and PowerPivot, and data warehousing with SQL Server. The offerings include:
HP E5000 Messaging System – Microsoft Exchange mailboxes in standard sizes of 500 – 3000 mailboxes. This product incorporates a pair of servers derived from HP's blade family in a new 3U rack enclosure plus storage and Microsoft Exchange software. The product is installed as a turnkey system from HP.
HP Business Decision Appliance – Integrated servers and SQL Server PowerPivot software targeting analytics in midmarket and enterprise groups, tuned for 80 concurrent users. This offering is based on standard HP rack servers and integrated Microsoft software.
HP Enterprise Data Warehouse Appliance – Intended to compete with Oracle Exadata, at least for data warehouse applications, this is targeted at enterprise data warehouses in the 100s of Terabyte range. Like Exadata, it is a massive stack of integrated servers and software, including 13 HP rack servers, 10 of their MSA storage units and integrated Ethernet, Infiniband and FC networking, along with Microsoft SQL Server 2008 R2 Parallel Data Warehouse software.
First of all, congratulations, SAS AR team, for one of the most efficiently and effectively run events.
SAS needs to make up its mind whether it wants to be in the BI game or not. Despite what SAS’s senior executives have been heard saying occasionally, that “BI is dead,” SAS is not quite done with BI. After all, BI makes up 11% of SAS’s very impressive $2.4 billion annual revenue (with uninterrupted 35-year growth!). Additionally BI contributed 22% to SAS 2010 growth, just below analytics at 26%.
Even though some organizations are looking at and implementing advanced analytics such as statistical analysis, predictive modeling, and — most important — model-based decisions, there are only a handful of them. As our BI maturity survey shows year after year, BI — even basic BI — maturity is still below average in most enterprises. Add these numbers to the abysmal enterprise BI applications penetration levels in most large organizations, and you get continued, huge, and ever-expanding opportunity that no vendor in its right mind, especially a vendor with leading BI tools, should miss.
Mobile devices and mobile Internet are everywhere. Over the past few years, Forrester has tracked continuously increasing levels of adoption and maturity for mobile business applications, but not so for mobile business intelligence (BI) applications. The adoption and maturity of mobile BI fall behind other mobile enterprise applications for multiple reasons, mainly the lack of specific business use cases and tangible ROI, as well as inadequate smartphone screen and keyboard form factors. However, larger form factor devices such as tablets and innovative approaches to online/offline BI technical architecture will boost mobile BI adoption and maturity in the near future. BP professionals must start evaluating and prototyping mobile BI platforms and applications to make sure that all key business processes and relevant information are available to knowledge workers wherever they are.
But mobile BI adoption levels are still low. Why? We see three major reasons.
Smartphones still lack the form factor appropriate for BI
The business case for mobile BI remains tough to build
Mobile device security is still a concern
Now, mobile tablet devices are a different story. Just like Baby Bear's porridge in the "Goldilocks And The Three Bears" fairy tale, tablet PCs are "just right" for mobile BI end users. So what can you do with mobile BI? Plenty!
Improve customer and partner engagement
Deliver BI in the right place, at the right time
Introduce BI for the workers without access to traditional BI applications
Improve BI efficiency via query relevance
Improve "elevator pitch" effectiveness
Give away mobile devices as an incentive to cross-sell and upsell analytic applications
I get tons of questions about "how much it costs to develop an analytical application." Alas, as most of us unfortunately know, the only real answer to that question is “it depends.” It depends on the scope, requirements, technology used, corporate culture and at least a few dozen of more dimensions. However, at the risk of a huge oversimplification, in many cases we can often apply the good old 80/20 rule as follows:
~20% for software, hardware, and other data center and communications infrastructure
SAP Has Managed A Turnaround After Léo Apotheker’s Departure
In February 2010, after Léo Apotheker resigned as CEO of SAP, I wrote a blog post with 10 predictions for the company for the remaining year. Although the new leadership mentioned again and again that this step would not have any influence on the company’s strategy, it was clear that further changes would follow, as it doesn’t make any sense to simply replace the CEO and leave everything else as is when problems were obviously growing bigger for the company.
I predicted that the SAP leadership change was just the starting point, the visible tip of an iceberg, with further changes to come. Today, one year later, I want to review these predictions and shed some light on 2010, which has become the “Turnaround Year For SAP.”
The 10 SAP Predictions For 2010 And Their Results (7 proved true / 3 proved wrong)
I get many inquiries on the differences and pros and cons of MOLAP versus ROLAP architectures for analytics and BI. In the old days, the differences between MOLAP, DOLAP, HOLAP, and ROLAP were pretty clear. Today, given the modern scalability requirements, DOLAP has all but disappeared, and the lines between MOLAP, ROLAP, and HOLAP are getting murkier and murkier. Here are some of the reasons:
Some RDBMSes (Oracle, DB2, Microsoft) offer built-in OLAP engines, often eliminating a need to have a separate OLAP engine in BI tools.
Some of the DW-optimized DBMSes like Teradata, SybaseIQ, and Netezza partially eliminate the need for an OLAP engine with aggregate indexes, columnar architecture, or brute force table scans.
MOLAP engines like Microsoft SSAS and Oracle Essbase can do drill-throughs to detailed transactions.
Semantic layers like SAP BusinessObjects Universe have some OLAP-like functionality.
I get lots of questions from clients on whether they should consider (or continue to rely on) SAP BW for their data warehousing (DW) and business intelligence (BI) platform, tools, and applications. It’s a multidimensional (forgive the pun) decision. Jim Kobielus and I authored our original point of view on the subject soon after the SAP/BusinessObjects merger, so this is an updated view. In addition to what I’ll describe here, please also refer to all of the DW research by my colleague, Jim Kobielus.
First of all, split the evaluation and the decision into two parts: front end (BI) and back end (DW).
Back end – DW
Best for SAP-centric environments.
Agile tool that lets you control multiple layers (typically handled by different tools) such as ETL, DDL, metadata, SQL/MDX from a single administrative interface.
Organizations that use BI show increased (+5.7% from 2009) levels of maturity. However, most of the respondents still rate themselves below average on Forrester's BI maturity scale: 2.75 (on a scale of 1-5) for overall maturity, with the following details:
. . . most aspects of BI such as processes, architectures, and measurements of BI efficiency and effectiveness lag behind.
And (drum roll, please) the most interesting, and, I am sure, controversial finding is that Forrester’s predicted trend that Agile BI and BI self-service will trump centralization and consolidation has been confirmed. Here's the proof:
In 2010, 59% of the respondents said that they do not have a centralized BI competency solutions center, versus . . .