BigStreamer™ – Big Data, Streaming Analytics

Digital Transformation constitutes a new, challenging reality in multiple verticals like Telecommunications, Financial Services and Utilities. Intracom Telecom introduces BigStreamer™ a powerful analytics suite built on the latest Big Data technologies. It can process and aggregate huge amounts of raw data in real-time, identify apparent or latent correlations, calculate real-time KPIs and compare them against thresholds representing business objectives, send alerts, trigger actions, generate forecasts and provide the User Interfaces to access raw or processed data.

a brochure image

BigStreamer™ leverages data retrieved from a variety of sources and any other structured or unstructured data source available in an enterprise's ecosystem:

a brochure image

It employs an extensive set of data mining and machine learning libraries enabling knowledge extraction from the accumulated data collections. Supported analytics range from simple metrics' calculation and KPI quantification to descriptive/predictive modeling, optimization modeling, real time analysis, sentiment analysis etc. Additionally, it facilitates the tuning of any algorithm or procedure by means of a semi-supervised closed feedback loop mechanism. All information is available via APIs to 3rd party applications for further processing or visualization. Finally, Big Streamer's visualization provides advanced visualization & reporting capabilities.

Intracom Telecom offering consists of a full set of Big Data Services:

  • Big Data-powered real-time ingestion, processing & management of massive, unstructured data sets – totally securely & cost-efficiently
  • Automated triggering of actions & alerts upon KPI’s threshold (AML, campaigns, system actions, etc.)
  • Powerful, interactive & fully customizable dashboards, for both Business & Technical teams
  • Professional Services from experienced Data Scientists, Data Engineers & DevOps, Admins, Data Analysts, Developers & industry domain experts

BigStreamer™ is addressing more than one Industries:

  • BigStreamer™ for Telco: As the digital revolution gains pace, Communication Service Providers (CSPs) get flooded with big data, constantly generated from numerous internal and external sources (Data Warehouses, OSS, BSS, Network elements, Internet). Intracom Telecom has embarked on the big data revolution by introducing BigStreamer™, a Big Data Analytics and Complex Event Processing platform developed specifically for the telecommunications industry
  • BigStreamer™ for Financial Services: FS Sector institutions, like Banks & Insurance Companies need to invest in Big Data technologies but also, reconsider their traditional business model in the context of the new digital era. Some of the key drivers for this change include strict regulatory & compliance frameworks, dynamically changing payment directives, ever-increasing fraudulent incidents and cyber-attacks, fintech companies’ bloom, significant mobile banking penetration, as well as, sophisticated customer needs & multiple interaction channels. As traditional Data Warehouse infrastructures offer important, yet limited, data integration/manipulation options, Intracom Telecom has introduced its BigStreamer™ platform for Financial Services Sector, aiming at real-time data integration, management & analysis and legacy systems’ modernization.
  • BigStreamer™ for Utilities: Digitization is the driving force of change in almost all fields of economic life and the Utilities market is no exception. Smart metering, smart grids and associated data management solutions essentially reflect this trend. The success in this new era relies on industry's ability to adopt Big Data Analytics technologies. Based on its BigStreamer™ platform, Intracom Telecom is offering a unique portfolio of solutions that facilitate Utilities harness the merits stemming from data generated by smart meters, smart grids, customer interactions as well as any other internal or external source.

For more details, please refer to ‘ Applications

BigStreamer™ Platform combines best of breed tools such as Hadoop, Elasticsearch and Kibana, adapted & enhanced for any organization's environment. An industry-oriented Data Model, accompanied with industry-specific Metrics has been developed to enable data collected from various sources to match each organization's business. Both, data model and metrics, are driven by TM Forum's standards. BigStreamer™ components architecture supporting the above functionality is depicted in the Figure:

BigStreamer Architecture

BigStreamer™ makes use of the computational & storage power of any Hadoop distribution (e.g. Apache, Cloudera, etc.) installed by the organization or Intracom Telecom. Hadoop-enabled Adapters Repository ensures that BigStreamer™ can seamlessly interconnect with and capture data from any Data Source applicable per industry Prediction Model Repository contains KPIs and predictive analytics algorithms used by data scientists to formulate, store and utilize powerful predictive data models that give answers to pressing business challenges that each organization faces. Such big data use cases may be different per industry and business concerned.

Event Stream Processor module captures streaming data, correlates occurring events and automatically generates triggers or alerts for subsequent actions by other systems. Triggers are determined by applying the appropriate algorithm(s) from the prediction models repository. Industry-oriented domain specific language makes writing complex rules easy. Complex Event Processing functionality is based on Apache Storm, a distributed processing engine, and powered by Drools, a carrier-grade inference engine.

Finally, BigStreamer™ enables the users from various organization’s functions to enhance their decisions by conducting ad hoc analytics and visualization due to partnership with key technology vendors in BI software, which provide rich and highly-interactive interfaces with web-based reports, dashboards and analytics.

BigStreamer™ is addressing more than one Industries:

  • BigStreamer™ for Telco: empowers Communication Service Providers (CSPs) to gain competitive advantage by interpreting the big data they are surrounded with, and acting upon it, in real time. Data retrieved are telco-Industry oriented, such as: Digital Exchanges, Soft Switches & IMS, Fixed Broadband Access & IPTV, OSS/BSS, LTE, 3G & CDMA, SDH & Metro Ethernet for Network Discovery and many more. Big data use cases may include Self-Healing Networks and Real-Time Customer Care Empowerment.
  • BigStreamer™ for Financial Services: For FS, BigStreamer™ leverages data retrieved from a variety of sources such as Core Banking System, Loans Management System, Payments Hub, Cards Management System, CRM, Enterprise Data Warehouses, middleware, social media and any other structured or unstructured data source available in an enterprise's ecosystem. As traditional Data Warehouse infrastructures offer important, yet limited, data integration/manipulation options (e.g. batch data streams, storage issues along with relevant high costs, structured-only data format, etc.), Intracom Telecom introduced BigStreamer™ for Financial Services, aiming at:
    • Real-time data integration, management and analysis, via the latest open-source technologies
    • Legacy systems’ modernization through APIs
    • Real-time business insights
  • BigStreamer™ for Utilities: Utilities market also relies on industry's ability to adopt Big Data Analytics technologies; it is essential that Utilities, as key actors and stakeholders in the delivery of benefits to the community, take full ownership to enable this digital transition. Based on its BigStreamer™ platform, Intracom Telecom is offering a unique portfolio of solutions that facilitate Utilities harness the merits stemming from data generated by smart meters, intelligent grids, customer interactions as well as any other internal or external source. Additionally BigStreamer™ operates as a Data Hub, since it enables 3rd party systems to query the platform or integrate with it. BigStreamer™ can be easily integrated with company’s favorite BI tool, existing DWH infrastructure or Meter Data Management solution.

Intracom Telecom believes that any organization's success depends on its ability to achieve a satisfying customer experience by managing simultaneously key strategic elements like; its infrastructure, its customers themselves, its ‘internal’ customers (the employees) and the services offered to its customers. This approach has been followed and adopted per industry-specific needs, as follows:

BigStreamer™ for Telco

A CSP should provide enhanced customer experience along with efficient management of the Network infrastructure, the Services offered, the Customers themselves and the telco Business. BigStreamer™ embraces all four strategic elements of a CSP's business, as shown in the Telco-specific Big Data Use Cases Table:

Network Service Customer Business
  • Optimization of network utilization
  • Network capacity planning
  • Anomaly detection & troubleshooting
  • Network monitoring & protection
  • Self healing networks
  • Partner routing
  • Product development & tariff optimization
  • New product rollout visibility
  • Yield management
  • Service personalization
  • Customer loyalty management
  • Handset/device analysis
  • Contact center alerts
  • Billing accuracy & revenue assurance
  • SLA management
  • Interconnect billing analysis
  • Real Time reports
BigStreamer™ for Financial Services

For this Sector, Intracom Telecom has designed and implemented a series of caching system projects powered by Redis. Redis is an open source Software (OSS), considered to be number one NoSQL database (as compared to all other popular databases, e.g. Couchbase, Cassandra, Datastax), in terms of performance, simplicity and extensibility.

BigStreamer for Financial Services

Redis supports the highest data throughput at the lowest latency for a considerably high volume of application requests/sec and in parallel, it requires the least amount of IT infrastructure, making it a cost-efficient solution.

Intracom Telecom offers Caching Solution Architecture Analysis & Integration for channel interactions’ management that could provide:

  • Efficient Application Performance (Internet Banking, Mobile Banking, PFM, etc.)
  • Higher Transactions Response Rate
  • Higher Transactions Volume to handle (data throughput)
  • Reduced Load in current Data Resources (SQL Servers, HOST, other sources)
  • Lower IT Cost

Addressing typical challenges, such as:

  • Costly Network Calls to Core Systems
  • Traditional Databases need to scale out as request rates increase (too costly)
  • As the call volume increases, performance can significantly slow down
  • Many requests use the same downstream resource or query results and one could distinguish data that are more & less frequently used

Relevant Use Cases where Caching drives value are:

  • Frequently Asked Information (e.g. for Cards Transactions, Account Transactions, etc.)
  • Lookup / Reference Tables that are frequently accessed
  • Applications & Services Optimization (e.g. required user data for payment processing, PSD2 data for KYC procedure, etc.)
  • Real-Time AI Models (e.g. transactional fraud detection & prevention, PFM modules efficiency when the model has to be re-trained instantly after every transaction, etc.)
BigStreamer Layer
BigStreamer™ for Utilities

BigStreamer™ as being a powerful analytics suite it can process and aggregate huge amounts of raw data in real-time, identify correlations, calculate real-time KPIs and compare them against thresholds, representing company’s business objectives, send alerts, trigger actions, generate forecasts and provide the User Interface to access raw or processed data.

BigStreamer™ for Utilities leverages data retrieved from a variety of sources available in the Utility Company’s ecosystem offering some key use cases like the following:

  • Customer 360o view: Access customer related information like historic usage patterns, tariff plans, billing information in real time
  • Real-time calculation of predefined KPIs, live dashboards, geospatial visualizations and historic reports. Evaluation of KPIs in real time and automatic triggering of alerts or remedy actions
  • Ad hoc analytics for both technical and non-technical users, enabling the creation of custom reports & dashboards