Hi, I'm
Sourav Halder
System Metrics & Operations
Telemetric ledger showing automated sync operations, pipeline efficiencies, and service level metrics.
0+
ETL Pipelines
Active production pipelines extracting SAP ERP, SQL Server, and REST API endpoints into a unified Redshift warehouse.
0.0%
Operational SLA
Availability verified via automated event-driven checks, retry logic, and event alert routing.
0.00%
Traffic Reduction
Migrating from legacy batch databases to a delta-load layer using Apache Iceberg, avoiding SAP database bottlenecks.
-0%
MTTR Improvement
Automated integration linking pipeline alerts to ServiceNow API, replacing manual triaging and routing.
Expertise & Services
Bridging the gap between raw data systems, machine learning models, and secure cloud orchestration.
Agentic AI & GenAI Systems
Architecting autonomous multi-agent workflows, tool-calling agents, and AWS Bedrock Knowledge Bases. Specializing in LangChain, LangGraph state machines, n8n automations, Portkey AI gateway, and Confident AI evaluations.
- Multi-Agent Orchestration
- AWS Bedrock Knowledge Bases
- n8n Workflow Automation
- Portkey Gateway & Evals
AI/ML & Data Science
Training predictive models, deep neural networks, and anomaly detection pipelines. Transforming telemetry into actionable machine intelligence.
- Predictive Machine Learning
- Anomaly Detection Systems
- Neural Network Modeling
- Feature Engineering & MLflow
AWS Cloud Architecture
Designing enterprise-grade, cost-optimized cloud architectures on AWS and modern Lakehouses. 4x AWS Certified & 3x Databricks Certified.
- AWS Serverless & Containers
- Medallion Lakehouse (Delta / Iceberg)
- Multi-AZ Cloud Resiliency
- Managed RDS, DynamoDB & Redshift
Professional Experience
Detailed operational domains and systems implemented during my consulting career.
Senior Associate Consultant
Infosys LimitedServing as a Senior Associate Consultant at Infosys Limited, specializing in enterprise data engineering pipeline architecture, serverless cloud orchestration, data lakehouse migrations, and automated systems telemetry.
Key Contributions & Achievements
- Engineered and maintained 50+ production ETL pipelines using Python, SQL, and AWS Glue, orchestrating data extraction from multi-source SAP ERP, SQL Server, and REST APIs into Redshift data warehouse supporting 14 data marts, ensuring timely data availability for business dashboards and analytics teams.
- Implemented robust pipeline orchestration with event-driven and schedule-based triggers (Lambda, EventBridge, S3), incorporating programmatic retry logic and data validation checks that eliminated synchronization failures by 85%, resolved data mismatches, and achieved 99.5% pipeline reliability.
- Optimized data delivery cycles to support monthly Sales & Operations Planning (S&OP) processes for leadership and regional sales heads, cutting data delays by 60% and ensuring accurate, timely insights for strategic sales planning and forecasting.
- Re-architected data extraction pipeline by migrating from direct SQL database to Apache Iceberg-based live layer with incremental delta loads, achieving 93.75% reduction in data extraction and eliminating performance bottlenecks caused by high-volume ERP replication traffic.
- Streamlined incident management by integrating ServiceNow API for pipeline monitoring, enabling automatic ticket creation and intelligent team assignment for job failures; decreased mean time to resolution (MTTR) by 40% and eliminated manual triaging overhead.
- Architected a Generative AI PaaS integrating Portkey AI LLM Gateway (routing, rate limiting, serving, usage tracking) and AWS Bedrock for centralized RAG capabilities; secured multi-tenant access via Active Directory (AD) and SailPoint to allow teams to securely ingest and query proprietary data.
- Implemented custom n8n workflows, engineering a Jira ticketing agent that queries Bedrock Knowledge Bases to auto-suggest resolutions; designed LLM-generated stakeholder reports and a sync workflow from SharePoint to Confluence/Web.
Education Records
Academic qualifications, specialized engineering domains, and formal credentials.
Technical Skills
Organized the way I think about engineering and automation — directly inside a simulated code editor.
Featured Projects
Architecture-first implementations focused on cloud automation, data pipelines, and machine learning structures.
Network Security System & Threat Detection
XGBoost + Optuna + MLflow + AWS Docker
Architected an end-to-end network threat detection pipeline using XGBoost, Random Forest, and Stacking Classifiers with SMOTE balancing and Optuna hyperparameter optimization.
Kidney Disease Classification & MLOps Pipeline
EfficientNetV2 + TensorFlow + DVC + MLflow + AWS EC2
Developed an EfficientNetV2-B0 classifier for kidney tumors on 7.3K+ CT scans using TensorFlow, with reproducible DVC and MLflow/DagsHub MLOps pipelines deployed on AWS EC2.
Autonomous Multi-Agent Orchestrator & LLM Gateway
LangGraph + LangChain + n8n + AWS Bedrock RAG
Architected an autonomous multi-agent system with supervisor task routing, AWS Bedrock managed knowledge base retrieval, Portkey AI semantic caching, and automated n8n webhook action execution.
Delta Lakehouse Pipeline
SAP ERP → Glue → Iceberg → Redshift
Optimized a mission-critical financial ledger ETL pipeline by introducing partition-aware incremental delta-load extraction, slashing data processing workloads dramatically.
ML-Powered Anomaly Detection
Real-time anomaly pipeline on streaming telemetry
Designed and deployed a streaming telemetry ingest engine that processes high-frequency IoT readings to detect operational anomalies in real-time.
Cloud Infrastructure Automation
Multi-AZ ECS + CI/CD + Cloud Architecture
Standardized cloud operations across production clusters using resilient cloud architecture patterns and secure automated deployment gates.
AWS Three-Tier Web Architecture
Auto Scaled Load Balanced Infrastructure
Utilized a public Application Load Balancer to route client traffic to auto-scaling Nginx web servers, communicating with internal application servers and RDS databases.
Spotify Big Data Analytics Pipeline
Serverless Ingest & Aggregation ETL
Built a serverless data pipeline to extract, transform, and load Spotify top songs data into a visual analysis dashboard using AWS serverless analytics services.
DynamoDB Real-Time Audit Table
NoSQL Database Mutation Capturing
Designed an automated audit trail system for DynamoDB databases, tracking data mutations in real-time for compliance and operational analytics.
WildRydes Serverless App
Complete Serverless App Ingestion
Built an end-to-end serverless ride-sharing web application leveraging AWS serverless services to manage user authentication, ride requests, and backend processing.
Medallion Data Warehouse Schema
Layered Relational Database Design
A comprehensive data warehousing solution, cataloging and exploring relational datasets using SQL scripts to structure Bronze, Silver, and Gold layers.
Achievements & Certifications
Professional certifications and recognition earned throughout my career. Click any badge to view credentials.
