The Decision Maker's Guide To CSP Billing Modernization

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

OCTOBER 2021

The Decision Maker’s


Guide to CSP Billing
Modernization
Go from legacy to leader with modern
architecture and data management approaches.
Introduction
Billing is an increasingly complex and vital part of the underlying business of
communication service providers (CSPs). From operational workloads to customer
insights, billing is simultaneously a core business process and a central tenet of the
end-customer experience.
Both business and customer experience functions In addition, consolidation in the market has
share a common trait: They rely on a complete resulted in many mergers and acquisitions, with
and accurate accounting of the underlying each business bringing its own systems and
customer base. customers to be integrated.

Collating this customer information, which is This has driven many large CSPs to begin
crucial for smooth operation and making informed modernizing and rationalizing their billing functions
business decisions, is far from trivial. This is to embrace modern architectures and data
largely due to the unique internal systems and management approaches. When done successfully,
data architectures that span across the tens or this can yield significant improvements in customer
sometimes hundreds of internal business units at a experience while at the same time reducing
given CSP. CSPs also have many different product costs — critical in an increasingly competitive
offerings, often under completely different marketplace with compressed margins and rising
divisions, with each using a different system. customer expectations.

Payment Processing Customer Loyalty


Handle incoming payments Handle customer
in different forms and retention, cross-
Customer
update customer records. sell/up-sell, loyalty
Core Data
programs, etc.

Bill Generation Service Provisioning


Process customer data and Support the customer
usage data to determine onboarding process for new
the amount owed and products and services.
notify the customer. Service Usage
Collect, process,
and expose usage
data in real time.

Figure 1: Customer Centricity in Billing

2
Modernization Drivers for CSP Billing
Siloed application stacks, broken out by product payments. Added to this, CSPs have traditionally
area (e.g., VoIP, mobile, cable, etc.), are common identified customers through their phone numbers
among large CSPs. These siloed stacks are most rather than through the multiple products that
prevalent in systems that are used to generate their customers use.
bills for customers and process their associated

MOBILE DOMAIN CABLE DOMAIN LANDLINE DOMAIN

Customer Data Customer Data Customer Data

Billing Billing Billing

Figure 2: Siloed Domains

This siloed approach leads to multiple 3. Managing multiple parallel billing


inefficiencies and complexities. implementations and their associated data
synchronization infrastructure can lead to
For example: significant increases in cost and architectural
complexity. This hampers an organization’s
1. Customers use products that exist in multiple
ability to explore new commercial opportunities
silos (i.e., they have a fixed line and a
in a timely manner.
mobile phone, and they potentially access
entertainment services, all through the same In order to address these challenges, many CSPs
CSP). Any changes to customer data, therefore, are embarking on projects to rebuild their billing
need to be propagated to multiple systems. systems to have a single view of the customer and
2. CSPs that lack a single, consolidated view of their billing-related data.
their customer base find it challenging to use
At the heart of any modernization project is the
data to cross-sell and up-sell. This is especially
move to a new data platform.
true for CSPs that have grown via mergers and
acquisitions.

3
From Silo to Single View
There are two key requirements that a data platform • Populating each of the data domains with data
needs in order to facilitate the single customer view from both operations support systems (OSS) and
required for a centralized billing function: business support systems (BSS) with a robust
strategy to deal with data conflicts.
1. It must be flexible enough to ingest, process,
• Modernizing of billing systems to allow
and search diverse data sets, since customers in
single-view data consumption and
each domain will likely be represented differently.
dataconsistency resolution.
2. It must be possible to scale infrastructure to • Establishing a single, highly scalable billing
handle the data ingestion requirements of a engine that will use the single view data
unified billing solution. This ingestion requirement platform as its single source of truth.
is often significant when considering usage data • Initiating a program to retire legacy billing
in the form of CDR/IPDR records. components, aligned to the decommissioning
of functionality as it is ported to the new unified
In addition, the right data platform will be integral
billing system.
for success in the following strategic areas:

CustomerData
Customer Data CDR/IPDRData
CDR/IPDR Data PaymentData
Payment Data

SINGLE VIEW

Customer Domain Usage Domain Payments Domain

Billing Engine

Figure 3: Centralizing the Billing Function

4
The legacy challenge
Legacy systems and relational databases hold unstructured data, which by some estimates makes
CSPs back from realizing the benefits of a single up 80% to 90% of today’s overall data.
view of their customer base. By design, these legacy
systems engender a more rigid approach to data, This is a significant challenge for CSPs that are
which requires a predefined schema that is difficult eager to embrace the opportunity afforded by
to alter once established. They are also less able to using all types of customer and operational data
scale cost-effectively or distribute across servers — including unstructured — to improve billing
and regions, and they cannot easily accommodate functions and the end-customer experience.

Standard Modernization Approaches


The starting position with legacy systems is be some lift and shift of data workloads in the
frequently characterized by siloed data knowledge cloud, but the strong interdependencies reflect a
across multiple specialized teams. There might burdensome cost of change.

Data Layer Data Platform


Data Accessibility Democratize Data Access

TARGET STATE
Prioritize Data Accessibility
Data-driven design

Legacy Service Layer

Explore Iteratively Prioritize App Simplification


Application-driven design

Architectural Simplification Create Product-Oriented Developement Teams

Figure 4: Modernization Strategies

As outlined in figure 4, there are two main and allow the segregation of read workloads
approaches taken by organizations looking to from write workloads. Doing so can gain in-
modernize legacy infrastructures: channel efficiencies and allow for a low-risk
transitory stage within a larger modernization
• Some organizations start incrementally by program. However, this method can present
taking a data-centric “data layer” approach additional complexity and cost in terms of
and invest in building single views (or operational managing coexistence with legacy systems.
data stores) that sit in front of systems of record

5
• Other organizations start incrementally by approaches as blockers or dependencies require.
taking a platform-centric “break the monolith” Each organization’s path will be unique based on
approach. This involves self-organized cross- their market situation, competitive environment,
functional teams that work on a single loosely and initial conditions.
coupled business domain with microservices.
This can also yield strong results, but care must MongoDB allows CSPs to embrace numerous data-
be taken in considering the wider organizational management pathways in an effort to move away
data management implications. from legacy systems. With MongoDB, customers
are supported through all of the aforementioned
It’s not unusual for organizations to simultaneously transformation pathways, allowing them to
leverage different pathways in different parts experience accelerated growth and limited risk.
of the organization, or to alternate between

Data-driven modernization
The first step in a data-driven transformation of service) and use cases (such as single view, real-
legacy systems is the creation of an operational time analytics, and mainframe offload).
data layer (ODL). An ODL can become a system
of innovation, allowing CSPs to take a rapid, An ODL deployed in front of legacy systems can
iterative approach to digital transformation of enable new business initiatives and meet new
legacy infrastructure. As an architectural pattern, requirements that the existing architecture can’t
an operational data layer centrally integrates handle without the difficulty and risk of a full
and organizes siloed enterprise data, making rebuild of legacy systems. An ODL can additionally
it available to consuming applications. An reduce workloads on source systems, improve
intermediary between existing data sources and availability, reduce end-user response times,
consumers that need to access that data, an ODL combine data from multiple systems into a single
enables a range of board-level strategic initiatives repository, and serve as a foundation for rebuilding
(such as legacy modernization and data-as-a- aging applications into modern architectures.
Business Benefits

System of Record

System of Transaction

Parallel Write

Enriched ODL

Basic ODL

Scope

Figure 5: The five stages of data-driven modernization

6
Offloading Reads Legacy Decommissioning
The first step in the creation of an ODL is to stand Once new applications and services have
up data infrastructure in order to model and store successfully moved their read operations to the
a unified copy of the data being mastered in the ODL, attention can be turned to migrating write
legacy system(s). The existing systems will remain operations. Old applications should continue to use
the single source of truth, with new applications the old infrastructure, but new applications and
and services being able to take immediate services should ensure that their writes are mirrored
advantage of the consolidated data set. Existing in both systems. This can be done by having
applications can continue to operate without applications perform dual (or parallel) writes, but
interruption. careful consideration must be given to cross-system
consistency in the presence of failure modes.
When populating an ODL, consideration should
be given to the velocity of the different data A more robust, alternative option is for writes to be
facets being loaded and the appropriate load performed against the ODL directly and then have
mechanisms used. For data that is updated external components detect and mirror the write
infrequently, such as some customer data to the old system. At this stage, the ODL can be
subsets, loading data via a regular batch/ETL considered the primary system of transaction.
process might be appropriate, whereas for rapidly
changing data sets such as CDR records, real-time Lastly, in order to fully decommission legacy
population using change data capture tools would applications, the functionality of legacy
be appropriate. components must be replicated to new
applications and services.

7
Application-Driven Modernization
Application-driven modernization strategies take such as microservices, with each microservice
an approach whereby existing, often monolithic, being a full vertical slice of functionality,
applications are systematically broken down including data and application components.
into self-contained units of functionality. These As the application is refactored and ported,
can be iteratively refactored to use modern the legacy application naturally becomes a
infrastructure and application design patterns candidate for decommissioning.

Legacy Application Internal Refactoring Microservices

Monolithic App

Common API
Common API

Module A Module B
Service Service Service
A B C

Database Module C

Data Data Data


for A for B for C

Database

Figure 6: From monolith to microservices

Modernizing a monolithic application to use the various modules. Clear delineation should
a modern architecture is often a multistep be made in terms of ownership of the various
process that starts with the application. Due data items. In order to expedite the final move
to a combination of design and evolution, the to microservices, the refactoring of the existing
existing codebase may not be organized into schema should be considered, as should the
defined modules. The first (transitory) step, mechanisms by which one module gains access
therefore, is to enumerate the services offered by to data owned by another (which should be via
the application and to refactor and reorganize defined service interfaces rather than via direct
the code into modules that will later form the database access).
basis of microservices.
Following the successful modularization of
Similarly, the existing database will likely contain the codebase, each module can be iteratively
interdependencies between the data used by replatformed and made into a defined service.

8
While an application is being refactored, some data to function in a business-as-usual context. Service
will likely need to be kept in sync between the old layers will often manage this in order to abstract
and new systems so old applications can continue the details away from frontend applications.

Application to CSP Billing Systems


In the real world, it is rare to modernize with either • Ease: MongoDB’s document model makes it
an exclusively application-driven or data-driven simple to model — or remodel — data in a way
approach. Commonly, a combination of both is that fits the needs of applications. Documents
used simultaneously because of the complexity can be closely aligned to the structure of
of billing implementations, including the need to objects in an application. As a result, it’s simpler
manage billing for mobile, fixed line, cable, and and faster for developers to model how data
more. While taking a purely application-centric in the CRM and billing engines will map to
approach might be preferred, the associated customer data stored in the database. This
complexity means that such projects will likely way, data conflicts relating to a customer in
require a very high level of cost/effort and this will two different source systems with (for example)
delay the realization of benefits. different addresses can be easily modeled,
identified, and resolved. Additionally, MongoDB
The more pragmatic approach is to create an ODL guarantees the multirecord ACID transactional
using data-driven modernization techniques. This semantics that developers are familiar with.
allows immediate value to be unlocked via the
• Data Reconciliation and Search: One of the
centralization of billing and the creation of a single
toughest challenges in single view projects is
source of truth with respect to customers. Following
data reconciliation — the process of unifying
this, application modernization of existing systems
the identity of a customer ingested from
can be undertaken to create a single set of unified
multiple source systems. Fuzzy search and
services. The redundant functionality can then
autocomplete are incredibly powerful for
be retired, reducing the complexity and cost of
reconciling these disparate identities into a
managing multiple systems. A flexible database to
single customer record for the application’s user.
accommodate the diverse data sets contained in
These capabilities are available as part of Atlas
the source systems, from multiple domains or even
Search, which combines the power of Apache
regional branches, is essential for success.
Lucene — the same technology underpinning the
MongoDB is an application data platform, world’s most popular search engines — with the
designed to empower developers with one developer productivity, scale, and resilience of
interface, for any application, running anywhere. the MongoDB Atlas database.
MongoDB provides a mature and proven • Flexibility: Mongo DB’s document data model
alternative to relational databases for enterprise makes it easy for developers to store and
applications and is by far the best technology for combine the diverse data required by modern
the development of single-view projects. CSP billing systems, including customer data in
the BSS and usage data across multiple product
With MongoDB, the need for niche databases and domains within the OSS, without neglecting
the associated costs of deploying and maintaining sophisticated validation and consistency
a complicated sprawl of data technologies is rules to govern data quality. This allows for
reduced. As a result, development teams no longer the modernization of the billing engine(s) while
need to learn multiple ways of querying or working avoiding subtle customer data inconsistencies
with data to address different data requirements. across various domains. MongoDB documents
are typically modeled to localize all data for a
MongoDB fulfills all requirements for a successful
given entity, such as a customer, into a single
single view for billing and customer relationship
document. This enables, for example, address
management (CRM) systems:

9
changes for a customer with both a landline and development languages. When coupled
cable to be made in one single document, rather with MongoDB’s rich query and aggregation
than spreading it across multiple relational capabilities, applications can access data
tables and domains. securely and naturally. Additionally, applications
• Versatility: Building upon the ease and flexibility can “register” to be notified of changes to data
of the document model, MongoDB enables stored within the cluster. This is especially useful
developers to satisfy a range of application when propagating changes automatically, in
requirements, both in the way data is modeled real time, to other systems. Many organizations
and how it is queried. The embedding of arrays opt to produce common data access APIs to
and subdocuments makes the document facilitate data access. This is natively supported
model very powerful for modeling complex for both REST and GraphQL endpoints.
relationships and hierarchical data, allowing • Intelligent insights, delivered in real time: With
developers to manipulate deeply nested data all relevant data consolidated into a single view,
without rewriting the entire document. it is possible to run sophisticated analytics.
For example, customer call behavior can be
With MongoDB’s expressive query language and analyzed to better cross-sell and up-sell or to
secondary indexing capabilities, documents identify the risk of customer churn. Automated
relating to customer data can be queried in many data archival with federated query enables
ways, from simple lookups and range queries these analytical workloads to be run over “hot”
to sophisticated processing pipelines for data data as well as data that has been archived.
analytics and transformations, faceted search, Complex queries are executed natively in
JOINs, geospatial processing, and graph traversals. the database on dedicated nodes so as not
to interfere with operational workloads. This
Not having to manage multiple parallel billing
enables real-time analytical capabilities without
implementations — and their associated data
having to use additional analytics frameworks or
synchronization infrastructure — reduces cost
tools. It avoids the latency and complexity that
and architectural complexity significantly. It also
can come from ETL processes that move data
adds versatility, which is crucial for a single view
between operational and analytical systems.
of customers. As it evolves over time, the single
view typically incorporates new source systems, • Business intelligence: The MongoDB Connector
absorbing data model implications that weren’t for Business Intelligence allows analysts to
foreseen at the outset. connect their existing business intelligence and
visualization tools to the single view in MongoDB
• Scalability: MongoDB provides automatic to more easily derive insights. Alternatively,
horizontal scale-out for single view databases MongoDB Charts can connect directly to the
on low-cost, commodity hardware or cloud single source of truth for native visualizations.
infrastructure. This allows the billing data • Global multi-cloud coverage with no lock-
platform to grow as additional data sources are in: MongoDB comes with the benefits of a
added — without incurring unnecessary up-front multi-cloud strategy. MongoDB Atlas supports
costs. MongoDB automatically distributes the 70+ regions on all major cloud providers
data in the cluster as the data set grows or the (Google Cloud, Microsoft Azure, and AWS),
size of the cluster increases or decreases. and clusters can be deployed on all of them
• Availability: MongoDB maintains multiple replicas simultaneously. This allows for an elastic,
of the data to maintain database availability fully managed service without being locked
and, by extension, customer service availability. into a single cloud provider. Global cluster
Replica failures are self-healing, so single-view support enables the simplified deployment
applications remain unaffected by underlying and management of a single geographically
system outages or planned maintenance. distributed operational data layer.
• Data access and APIs: MongoDB provides
idiomatic drivers for all modern application

10
Conclusion
Bringing together disparate data from multiple connect to multiple customer systems and handle
isolated silos into a single view as a part of conflicts that arise. By having all data in a single,
a modernization program is a challenging accessible location, CSPs can use the data to
undertaking. Whether your modernization program cross-sell and up-sell, as well as avoid managing
is application-driven or data-driven, MongoDB’s multiple parallel billing implementations and their
document model, flexibility, and versatility allow associated costs and architectural complexities.
for a single source of truth to be established
without the complexities often incurred by using Modernization and building a single view requires
traditional relational technologies. technical skills, the right tools, and coordination
among many different parts of the business.
This enables a unified billing engine to consume MongoDB offers access to the right technology,
validated customer data, avoiding the need to people, and processes for success.

Resources
For more information, please visit mongodb.com.

MongoDB Atlas database


Case Studies
as a service for MongoDB
Presentation
MongoDB Enterprise
Download
Free Online Training
MongoDB Realm
Webinars and Events
MongoDB Architecture
Documentation
Guide

About the Authors


Steve Dalby Vanda Friedrichs
Principal, Enterprise Modernization at Enterprise Modernization, Industry Consultant
MongoDB, London Office at MongoDB, Dublin Office
steve@mongodb.com vanda.friedrichs@mongodb.com

© October 2021 MongoDB, Inc. All rights reserved. 11

You might also like