About
Passionate and ambitious software engineer proficient in C, C++, Java, Kotlin, GoLang, and more.
I have a knack for solving problems and am consistently prepared to take on new challenges. Also been a problem setter across multiple platforms.
A tech stack independent developer ready to take on new stacks.
I am a fast learner and I regularly keep on upskilling myself. I keep on exploring various technologies/tools from the web (Backend & Frontend) and Android/mobile development.
I have designed, implemented and productionized many scalable software architectures that optimize performance and drive efficiency.
I am a team player and have led many teams across my current/previous firms and college.
Work
Arcesium
|Software Engineer
Highlights
Designed and implemented a fine-grained access control system using Open Policy Agent(OPA), achieving <10ms latency in a multi-tenant production environment using Gitlab CI/CD. Exposed metrics using Prometheus and monitored using Datadog.
Built a multi-tenant Resource Manager to enable self-service cluster configuration and improve client transparency by supporting cluster updates and lookups. Implemented CI/CD, integrated with AWS S3(common database between Argo and resource manager), Apache Zookeeper(for distributed locking) and internal authentication systems, established secure JWT based communication, and developed RESTful APIs for seamless interaction with Argo Workflows.
Built a dynamic job scheduling service in Go for Argo Workflows to support auto-scaling scenarios and implemented automated tests to enhance stability and minimize deployment risks.
Evaluated third-party vendors and implemented and deployed custom JDBC and ODBC driver server for simplified distribution and maintenance using Docker on AWS EKS, ECR.
Built and productionized an OData service over DeltaLake/Postgres to enable efficient data import and viewing, reducing query latency by 78% through distributed caching and multithreading.
Investigated and optimized S3 streaming and processing, achieving a 60% reduction in memory usage under heavy load and lowering OOM incidents by 30%. Evaluated AWS Common Runtime(CRT) async client, benchmarked performance, analyzed concurrent request thresholds, and added metrics to monitor S3 latency and processing efficiency.
Automated tenant onboarding using an event-driven architecture with AWS SNS and SQS, significantly reducing manual effort and improving operational efficiency.
Designed and implemented end-to-end data lineage for Looker data using DataHub's metadata ingestion and actions framework.
Automated entity generation and migration through scripting; optimized DeltaLake merge strategies (e.g., BiTemporal, FactCheck with snapshots).
Arcesium
|Software Engineering Intern
Highlights
Developed an archival service to migrate data from PostgreSQL to DeltaLake cold storage
Implemented a low-latency CSV downloader for quarantined AVRO data in Amazon S3.
Built a service to import/export data from file(CSV) to reduce user intervention using Kotlin and Spring Boot.
Built a complete ETL(extract, transform, load) pipeline to read data from a raw CSV file, apply some transformations on top of the data, and push it into a delta table performing merge/append/overwrite operations using Spark supporting load upto 10 million records.
Optimized spark pipelines and reduced the latency of the data pipeline by 65%.
Arcesium
|Software Engineering Intern
Highlights
Built an extensible schema for the validation of components in the PDF editor and improved error resolution method that reduced the workload of users using React and mobx
Education
Indian Institute Of Information Technology, Allahabad
B.Tech.
Information Technology
Grade: 8.45/10
Courses
Operating systems
Computer Networks
Database Management Systems
Object Oriented Programming
Data Structures and Algorithms
Distributed Systems
Network Security
Awards
Runners Up in Arcesium's Season Of Code(hackathon) 2024
Skills
Languages
C++, Java, Kotlin, Go, Python, Shell, JavaScript, HTML, CSS.
Tools & Technologies
SQL, Git, Gradle, Poetry, Firebase, Delta Lake, OData, Hazelcast, Open Policy Agent (OPA), Zookeeper, JWT.
Frameworks & Libraries
Spring Boot, ReactJS, Flutter, Apache Spark, Apache Olingo.
DevOps & Automation
GitLab CI/CD, Docker, Kustomize, Argo Workflows, Monitoring & Alerting (Prometheus, Datadog).
Cloud & Infrastructure
AWS (S3, DynamoDB, SQS, SNS, EKS, MSK, EC2), Kubernetes, VPA, HPA, Kafka.
Soft Skills
Problem Solving, Quick Learner, Team Collaboration, Leadership, Communication, Accountability, Attention to Detail.
Interests
Achievements
1500+ questions solved across various platforms.