Parth Patel
Data Engineer | Solutions IT Designer
1 yrs experience · Kitchener, ON · <10 hrs/week
About
With a Bachelor of Engineering in Information Technology from Gujarat Technological University and a Post Graduate degree in Information Technology Business Analysis from Conestoga College, I bring a strong educational foundation to my career. As a Solutions IT Designer at TD, I lead core data engineering functions, demonstrating expertise in SQL, MSSQL, PostgreSQL, Oracle, and advanced Databricks knowledge. My experience also includes working as a Software Engineer and Data Engineer at Next Pathway Inc., where I played a crucial role in cloud migration automation and technology development. I am proficient in Python, Java, OpenAPI, YAML, XML, and have worked with business analytics tools like Tableau and PowerBI. My skills include data modeling, architecture, ETL processes, and implementing scalable data solutions using Azure Cloud. I am dedicated to staying updated on industry trends and emerging technologies in data engineering.
Skills
Experience
- Solutions IT Designer · TD01-01-2023
Lead core data engineering functions, covering data modeling, architecture, and ETL processes. Demonstrate expertise in SQL, MSSQL, PostgreSQL, Oracle, and handle diverse ingestion methods (DB, API, Parquet, delimited, text, mainframe). Utilize advanced Databricks knowledge, designing scalable data processing workflows and ensuring optimal performance. Showcase proficiency in Delta Lake for robust data versioning and transactional capabilities. Apply Azure Cloud knowledge to design, implement, and manage scalable data solutions. Utilize Datadog for monitoring, analyzing, and optimizing data infrastructure performance. Champion data quality and governance, implementing standards and quality checks. Conduct troubleshooting and provide technical support, collaborating with cross-functional teams. Stay updated on industry trends and emerging technologies in data engineering. Maintain comprehensive documentation for data engineering processes and solutions. Collaborate effectively with data scientists, analysts, and IT teams to meet diverse data requirements. Implement streaming data ingestion, utilizing technologies like Kafka for real-time data processing.
- Software Engineer: SHIFT / Data Engineer · Next Pathway Inc.07-01-2021 – 01-01-2022
Perform a role in Solutioning and Developing Technologies for Cloud Migration Automation per SHIFT Product Roadmap. Implement Code Generated by SHIFT on Client Projects. Continuously learn and research new technologies related to the SHIFT Roadmap. Investigate performance-related issues on the conversion projects, make recommendations and implement solutions. Closely working with Python and Java to create automation scripts and creating API. (Knowlege of OpenApi, Yaml, XML,connexion). Working on different business analytics tools (Tableau and PowerBI). Identify and Document Syntax Difference Between Different SQL Dialects. Convert or Rewrite ETL/ELT to a Different Target Technologies, i.e. Datastage to PySpark (Both Manual and Through Different Tools Available). Performance, Unit and Functional Tests of ETL/ETL Pipelines. Perform tasks assigned by Project Team leads on the assigned projects. Brainstorm and contribute to the advancement of Next Pathway cloud migration technologies. To Provide other Duties Related to ETL and SQL Development. Initiative to take on and own tasks. Client Communication, Project Planning, Time-Tracking, etc. Following Agile Methodologies. Working with Atlassian Tools. To Provide other Assistance as Required.
Education
- Conestoga CollegePost Graduate, Information Technology Business Analysis
- Gujarat Technological University (GTU)Bachelor of Engineering (BE), Information Technology
Similar talent on Pangea
Hire Parth through Pangea
Describe your project to the Pangea agent — see if Parth is a fit, with transparent pricing and interviews booked straight onto your calendar. No contact details change hands until you hire.
See if Parth is a fit