Solon Das

About

Hello! I’m a data engineering professional with 6+ years of experience in building scalable, high-performance data solutions that drive business impact. I specialize in architecting robust data pipelines, optimizing infrastructure for AI-driven analytics, and enhancing data quality frameworks. Key Contributions: Spearheaded data strategy and quality frameworks for AI-driven architectures, enabling cross-functional use cases. Designed and built scalable data pipelines for large-scale regulatory reporting, integrating insights into interactive dashboards for seamless decision-making. Developed an in-house credit-scoring model, reducing loan approval time by 90%, leveraging demographic factors & alternative credit data. Conducted NLP & ML research on fraudulent job postings, reflecting my passion for AI-driven problem-solving. Core Expertise: Data Engineering & Cloud Solutions: Azure (MS SQL Server, CosmosDB, DataBricks, Logic Apps, Automation) Big Data & Performance Optimization: PySpark, SQL, Azure Data Strategy & Governance for AI & Analytics Indexing, Query Optimization & Cost Efficiency Real-time & Batch Data Processing My academic background reflects my deep interest in data science and AI. I graduated with distinction from Liverpool John Moores University, where I worked on research focused on detecting fraudulent job postings using NLP and ML methodologies. I further strengthened my expertise by completing a post-graduate degree in Data Science from IIIT-Bengaluru with a GPA of 3.62. I believe in continuous learning, creative problem-solving, and impactful storytelling through data. Whether it’s optimizing cloud infrastructure, building AI-ready data pipelines, or driving cost-efficient solutions, I’m always excited about leveraging data for business transformation. Beyond Data: A music and photography enthusiast, I find inspiration in creativity and exploration. Let’s connect and discuss how data can shape the future!

Experience

• AVP - Data Engineering : Palantir Foundry · Swiss Re03-01-2025
• Tech Blogger - TheDatumTheory · Medium01-01-2024

  Passionate about demystifying data engineering, cloud technologies, and database optimization through engaging, in-depth articles on Medium. I write about real-world challenges in Apache Spark, SQL performance tuning, and Azure services, breaking down complex concepts into actionable insights. Committed to empowering the data community with practical knowledge and best practices.

• Senior Data Engineer - Generative AI · AB InBev09-01-2022 – 03-01-2025

  1. Spear-headed the development of robust data pipelines aimed at facilitating the seamless delivery of trusted data for our revolutionary new product launch, Insights Copilot which solves generative AI use-cases focused for our organization's day-to-day operation. This cutting-edge platform empowers our business users to effortlessly pose cross-functional inquiries, uncover trends, and access insightful facts pertaining to our organization's operations. 2. Established a Data Quality framework for FMCG data across various functional areas, resulting in proactive resolution of data issues and enabling the ingestion of clean data for Gen AI applications. 3. Oversaw the Data strategy and solution design of Gen AI NL/Text to SQL across various cross-functional use cases including Watchtower, Marketing, Finance, Human Resource, Social Media, Logistics, Strategy & Insights, and Procurement for Global Headquarters, as well as other zones such as APAC, NAZ, SAZ, MAZ, etc. 4. Led the development of Data Models and extensive metadata for LLM context to run GEN-AI models across 5 multi-domain use cases. 5. Engineered Data Delivery Pipelines on Azure DataBricks from scratch to deliver trusted data for DTC business in South American Markets, tailored to the specific needs of the DTC-MROI business segment with a focus on key markets like Brazil, Mexico, Colombia, and Argentina, resulting in a projected gain of 5% incremental sales and $1.7M net revenue at $50M Budget.

• Big Data Engineer - Senior Consultant · Ernst & Young05-01-2021 – 09-01-2022

  • Built an end-to-end Event-Driven Data Ingestion Pipeline on Azure DataBricks using Apache Spark for Azure Cosmos DB and Kafka topics. • Engineered a Data Tracing Feature to track Data Loads and statuses, ingesting data into SQL server and Azure Event Hub. • Developed real-time streaming feature for Kafka topics, enabling quick identification and re-running of lost messages.

• Data Engineer · Accenture07-01-2018 – 11-01-2020

  • Developed an Object Management Tool for Environment Deployment, optimizing deployment processes and enhancing efficiency. • Created an Automatic JIL File Generator Utility using Python, reducing manual effort by 98% in job scheduling. • Led a Pyspark Data Transformation Project for client-specific data transformations in the non-prescription drug category. • Developed an Object Management Tool for Environment Deployment, optimizing deployment processes and enhancing efficiency. • Created an Automatic JIL File Generator Utility using Python, reducing manual effort by 98% in job scheduling. • Led a Pyspark Data Transformation Project for client-specific data transformations in the non-prescription drug category. Skills: Python · SQL · Data Classification · PySpark · Databases · Amazon Redshift

Education

• International Institute of Information Technology BangalorePost Graduate Diploma, Data Science
• Liverpool John Moores UniversityMaster of Science - MS, Data Science
• Veer Surendra Sai University Of Technology (Formerly UCE), BurlaBachelor of Technology - BTech, Information Technology

Similar talent on Pangea

Diwakar V.Data Engineer (Azure + Databricks) | 4+ Years Building Scalable Data PlatformsGurugram, HaryanaAbhishek K.Expert Data Engineer & Analyst Specializing in AI-driven Solutions and Business IntelligenceBengaluru, KarnatakaXisco B.Azure Solutions Architect | Data EngineerCastellón de la Plana, CastellónAAkash R.Data Engineer | Data Analytics & Infrastructure | Healthcare, SaaS, and Life Sciences | Data Pipeline & Dashboard SpecialistMcKinney, TX