About me

Data Engineer with 3.5+ years of experience designing and implementing scalable data solutions on AWS and Azure. Expertise in ETL/ELT workflows, big data processing, and data governance. Skilled in optimizing cloud-based pipelines for performance, security, and efficiency in large-scale systems.

What i'm doing

  • design icon

    Masters Student

    Studying Masters in Computer Science at California State University Fullerton.

  • Azure

    Azure

    I am currently working on Azure Certifications (AZ-900, AZ-104, ......).

Additional Skills

  • Daniel lewis

    Bug Detection

    Bug Detections in websites like ecommerence, general apps, etc.

  • Daniel lewis

    Technology Exploration

    Reviewing Beta apps, Suggesting better features and updating to technology.

  • Daniel lewis

    cinephile

    Watching movies extensively contributes to boosting my self-confidence.

  • Daniel lewis

    Financial Knowledge

    Financial knowledge involves understanding various aspects of managing money, investments, and financial instruments such as stocks, mutual funds, bonds, and other assets. It encompasses learning about budgeting, saving, investing, and managing risks.

Resume

Education

  1. Master's in Computer Science at California State University Fulletrton(CSUF), USA

    GPA: 3.9/4.0 Jan 2023 — Dec 2024
  2. BTech in Information Technology at SRKR Engineering College, India

    GPA: 3.44/4.0 August 2016 — Sept 2020

Relevant Coursework

  1. Cloud Computing, Azure Data Factory, Data Structures and Algorithms, Artificial Intelligence, Software Design and Development, Data Science, Advanced Database Management, Advanced Computer Networks, Web backend engineering, Data, Network Management.

Experience

  1. Cerebras Fellow - Cerebras

    Nov 2024 — Present Remote, USA

    • Designed and implemented an AI-driven healthcare chatbot using LLMs like ChatGPT for real-time medical consultations. • Migrated from GPT-3.5-Turbo to Cerebras Inference, benchmarking speed improvements for medical AI. • Utilized Hugging Face Transformers for embedding generation and Pinecone for efficient vector-based data retrieval. • Integrated metadata based filtering within Pinecone to enhance personalized healthcare recommendations based on patient history. • Integrated custom machine learning models using Azure ML and MLflow to improve chatbot accuracy and personalize medical recommendations.

  2. AI Risk Analyst - Extern

    Sep 2024 — Oct 2024 Remote, USA

    • Conducted comprehensive research on global leaders' AI integration strategies for enhancing decision-making and innovation. • Analyzed AI-driven tools that enable real-time cross-departmental insights and fostered collaboration. • Developed case studies on ethical AI implementation, focusing on maintaining trust and transparency in business operations.

  3. System Engineer - Infosys

    May 2021 — Nov 2022 Hyderabad, India

    • Managed and resolved issues in Release-Pipelines and Azure Data Factory (ADF), optimizing ETL workflows to enhance data processing speed and reliability. • Created pipelines in Azure using ADF to get the data from different source systems and transform the data by using activities. • Developed and implemented Azure Active Directory (AAD)-based authentication for records for secure and efficient data access. • Integrated data from multiple sources using scope scripts, enabling consolidated data outputs that improved transaction analysis and consistency. • Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster. • Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data for business needs.

  4. System Engineer Trainee - Infosys

    Jan 2021 — April 2021 Hyderabad, India

    • Acquired in-depth training in Object-Oriented Programming (OOP) concepts and Java, with a focus on implementing databases using Microsoft SQL Server.
    • Completed comprehensive training in both Basic and Advanced C# concepts, gaining proficiency in technologies such as Entity Framework Core, ASP.NET Core Web API, and developing solutions for Microsoft Azure as part of the Stream Training Program.
    • Successfully completed specialized courses in ASP.NET Core Web API - Adaptive Edition and gained a comprehensive understanding of Digital Process Automation (DPA), Agile, and DevOps methodologies.

  5. Student member of The Computer Society of India (CSI)

    July 2017 — May 2020 AP, India

    • Management Skills: Participated in conducting fests, enhancing organizational abilities.
    • Networking: Connected with diverse individuals, improving communication skills.
    • Confidence: Engaged in presentations and discussions, building self-assurance.
    • Technical Knowledge: Exposed to emerging technologies, enriching understanding.

Technical Skills

  1. Programming

    Python, Java, C++, C#, SQL, R, Scala

  2. Database and Cloud

    Microsoft Azure (Azure Data Factory (ADF), Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure ML, MLflow, Azure Synapse Analytics), AWS (S3, EC2, ELB, Lambda, Glue, Athena, Redshift), ETL Processes, Apache Airflow, DBT, Power BI, Snowflake, Apache Spark, Hadoop

  3. Machine Learning & AI

    Transformers, Hugging Face, Large Language Models (LLMs), LangChain, Pinecone, RAG.

  4. Data Visualization & Streaming

    SSRS, BI Tools (Tableau, Power BI), Apache Kafka, MongoDB, Cassandra, Redis, Streamlit.

  5. Tools

    Git, Jira, Agile, CI/CD Pipelines, Microsoft Entra ID (formerly Azure Active Directory)

  6. Soft Skills

    Leadership, Teamwork, Agile Methodology, Administrative, Decision making.

  7. Microsoft Office

    Excel, Word, PowerPoint

Certifications

  1. Microsoft Azure: AZ 900, DP 203

  1. micro1 Data Engineering

  1. Databricks Certified Data Engineer Associate

  1. Azure Data Factory For Data Engineers

  1. Angular for .NET Developers

  1. Django A-Z: Learn Django 2 by building and deploying project

  1. The Web Developer Bootcamp (HTML, CSS, JS)

  1. The Complete Node.js Developer Course (3rd Edition)

Portfolio

Contact

Contact Form