Crafting a truly comprehensive analytics environment is a bit like staring deeply into the night sky. When you try to absorb the billions of celestial objects out there—all of them at different ages and stages in their respective life cycles--you risk driving yourself insane. Your complex field of view contains the deep past, present, and future in one glorious, glowing glimpse.
Increasingly, the complex event processing (CEP) market, as a segment of the analytics arena, suffers from this “all too much” problem. This is not a slap against the technology itself, which is mature, or the growing list of CEP vendors, who offer many sophisticated solutions. Indeed, many CEP vendors now offer tools for viewing the deep present, consisting of myriad streams of real-time events, and the deep past, in the form of access to historical information pulled from many data warehouses, marts, and other repositories. And some—most notably, IBM with its InfoSphere Streams technology--now support visualization of the deep future, through its ability to apply predictive models to real-time event streams.
The core problem with today’s CEP offerings is that many of them are power tools, not solutions suitable for the mass business market. This same problem confronts established vendors of predictive analytics and data mining (PA/DM) tools, whose core user base consists of statisticians, mathematicians, and other highly educated analytics professionals. No one denies that traditional CEP and PA/DM tools are the analytical bedrock of mission-critical applications in diverse industries. But I challenge you to point to a single case study where they are used directly by the CEO, senior executives, or any other casual user, rather than indirectly through being embedded in some custom application.
Read more