Prerna Verma
EXPERTISE
BIO
With over 4 years of experience in software development and data engineering, coupled with certifications in Azure Data Engineering (DP-203) and Data bricks, I bring a strong foundation in building scalable, efficient, and secure data solutions. In my previous role as a Software Engineer at Tech Mahindra, I have designed and implemented end-to-end data pipelines using Azure Data Factory, Synapse Analytics, and Data bricks. By leveraging PySpark, I converted semi-structured JSON data into SQL-compatible formats, built robust logging mechanisms, and implemented data masking to safeguard sensitive information. My efforts in creating modern data warehouses have supported critical decision-making processes and ensured compliance with data security standards
WORK EXPERIENCE
Software Engineer
Tech Mahindra
March 2022 - November 2024
With over 4 years of experience as a Software Engineer, At Tech Mahindra in Leeds, I designed and developed end-to-end ETL pipelines using Azure Data Factory, Azure Synapse Analytics, and PySpark to ingest and transform semi-structured JSON data into structured formats for Azure SQL databases. For instance, I transformed 10TB of complex datasets into a modern data warehouse using Databricks, improving report generation speed by 30%. My proficiency in Python and SQL, coupled with my experience in cloud-based ETL tools Azure data factory and AWS Glue At Tech Mahindra, I implemented data masking logic to protect sensitive customer information, ensuring compliance with GDPR and other privacy standards. By developing scripts in PySpark to anonymise fields like names and account numbers before loading data into Azure SQL databases, I reduced the risk of data breaches while maintaining accessibility for analytics teams. At Tech Mahindra, I collaborated with teams to develop data models for a modern data warehouse, mapping semi-structured data to structured schemas that supported business reporting requirements. I optimised these models for performance in Azure Synapse Analytics, considering scalability and query efficiency.
EDUCATION
Postgraduate Diploma
International Institute of Information Technology, Bangalore, India, Present
Artificial Intelligence & Machine Learning
Bachelor of Technology
Bhai Gurdas Institute of Engineering and Technology, Punjab, India, Present
Computer Science & Engineering
CERTIFICATIONS
Azure Data Engineer
Issued: 1/1/1970
Credential ID: 99BFF1A121B300C2
Data bricks Data Engineer
Issued: 1/1/1970
Credential ID: 107098105
Databricks Generative AI Fundamentals
Issued: 1/1/1970
Credential ID: 101861046
Verified Data Engineer
3-5 years of experience
Preferred commitment: Full Time
Languages
Skills
Impressed by Prerna Verma's profile?
Take the next step and bring this top talent to your team
Hire Prerna for your team