Prior to the big data transformation, the digital NBFC was constrained by foundational data limitations:

‍

• Strategic Growth Barriers: The inability to process complex data efficiently delayed the launch of a new consumer-centric product designed to provide limited credit facilities.  

• Payment Gateway Friction: The organization urgently needed to minimize payment transaction drops to improve the overall success rate of their payment platform.  

• Core Architectural Gaps: The data teams faced severe, ongoing challenges related to Data Storage, Data Velocity, Data Availability, and Data Modelling.  

• Governance and Access Risks: A lack of structured Data Governance and poor Ease of Access prevented the institutionalization of data-driven marketing activities.

‍

We designed and deployed a highly scalable Big Data Data Warehouse (DWH) and Operational Data Store (ODS) ecosystem capable of dual-speed ingestion.  

‍

Key capabilities include:

• Cloudera CDH-5.13 Foundation: Implemented the Cloudera CDH-5.13 platform to unify the creation of a Data Lake and an ODS on the exact same infrastructure.  

• Omni-Format Processing: Built a Big Data Platform that seamlessly ingests structured, semi-structured, and unstructured data.  

• Optimized Data Conversion: Executed automated data conversion routines to transform raw inputs into a common structured format with enabled compression for storage efficiency.  

• Real-Time & Batch Custom ETL: Engineered custom ETL and CDH components to capture data from LOS applications, web portals, social media, and third-party APIs in both batch and real time.  

• Proactive Workflow Management: Enabled continuous workflow monitoring backed by real-time status alerts to guarantee pipeline stability.  

‍

Deploying the Cloudera Big Data platform yielded transformative operational and commercial outcomes for the NBFC:

‍

• Secure API Integration: Successfully exposed downstream application data using highly secure REST APIs, feeding downstream applications reliably.  

• Targeted Analytics Generation: Created dedicated data marts customized for various Lines of Business (LOB), data analysts, and data scientists to accelerate reporting.  

• Enhanced Merchant Advisory: Leveraged the new platform to provide significantly better BI advisory services to merchants utilizing their payment gateway.  

• Enterprise-Grade Security: Enabled CDH inbuilt components to enforce strict data governance and data security protocols across all credit data.  

• Marketing & Operational Excellence: Successfully institutionalized data-driven marketing activities while minimizing payment transaction drops to improve checkout success rates.  

‍

Looking Ahead

‍

With the Cloudera CDH-5.13 ecosystem serving as its centralized intelligence hub, the digital NBFC is perfectly positioned to scale its lending operations. As they expand their new consumer credit facilities, the dual-speed ingestion architecture—powered by Kafka and Spark Streaming—will allow for the future integration of real-time credit scoring models, predictive fraud detection algorithms, and hyper-personalized merchant advisory dashboards.

‍