K Amit Kumar Achary
Biography
K. Amit Kumar Achary is a Senior Data Architect at OPRT Development Center (Oportun Inc.), specializing in Big Data Analytics, Databricks, Spark, Hadoop, and Artificial Intelligence. With over 10 years of experience in IT and 9+ years in advanced data engineering, he has played a key role in developing scalable data platforms and analytics solutions across global organizations such as Globant, Cognizant, Accenture, Birlasoft, and Mphasis.
He holds a B.Tech in Computer Science & Engineering and an MBA in General Management, and is currently pursuing a Doctorate in Business Administration from the European Institute of Applied Science and Management (EIASM), Prague.
Amit is certified in Databricks, Google Cloud, and Terraform, and has extensive experience in DataOps, AWS cloud infrastructure, and AI-driven data pipelines. His international exposure includes client engagements in Amsterdam, Netherlands, and he has been recognized with multiple performance and excellence awards for his contributions to enterprise data modernization.
Research Interest
Big Data Analytics and Scalable Data Architecture, Databricks and PySpark Optimization, Blockchain Integration in Data Security, Predictive Analytics and Business Intelligence
Abstract
Empowering Scalable Data Analytics through Unifi ed Lakehouse Architecture and Generative AI:
In today?s rapidly evolving digital ecosystem, enterprises are grappling with massive, diverse, and fast-moving data. This session explores how modern data-driven organizations can leverage unifi ed lakehouse architectures powered by Databricks, Apache Spark, and advanced automation to achieve scalable analytics, faster insights, and smarter decision-making. Drawing from over nine years of hands-on experience in Big Data platforms and DataOps engineering across domains such as fi ntech, healthcare, and supply chain, this talk delves into practical strategies for building end-to-end data pipelines that are cloud-agnostic, resilient, and optimized for real-time analytics.
The presentation highlights the integration of Databricks with AWS-based services including Glue, S3, Lambda, and Redshift, alongside the orchestration of infrastructure using Terraform and DevOps automation frameworks. It emphasizes the journey of transforming traditional ETL workloads into contemporary ELT and AI-driven architectures. Through real enterprise implementations - such as Oportun?s Analytics Data Platform and Thermo Fisher?s marketing data pipelines - the talk sheds light on how organizations can execute intelligent data operations, improve governance with Alation, and enhance cross-functional collaboration using data as a strategic asset.
Additionally, the session discusses emerging applications of Generative AI in data engineering workfl ows, including metadata automation, ETL code generation, and AI-assisted data quality management. The overarching objective is to demonstrate how blending human expertise with modern AI and cloud-native frameworks can accelerate data innovation and operational effi ciency.
