Job Description

Job Description:

• Purpose Design build and implement robust data quality and lineage solutions to ensure the integrity traceability and trustworthiness of data across the Snowflake data platform.
• This engineering role is critical for maturing data governance enhancing domain maturity and providing the foundational technical capabilities for data discovery understanding and reliable consumption

Key Responsibilities

• Snowflake data engineering experience MUST
• Engineer and implement scalable solutions for data cataloging data dictionary and data taxonomy ensuring comprehensive and accurate metadata management
• Extract develop automate and maintain endtoend data lineage pipelines and processes using Alation for the Snowflake data platform This includes technically mapping sourcetotarget transformations across complex ETLs business logic and API integrations
• Apply deep data engineering expertise to parse and interpret intricate ETL processes transformation logic and API definitions to accurately establish and validate data flow and dependencies
• Design and build quantitative metrics scoring mechanisms and reporting frameworks to assess the quality and coverage of data lineage coverage by domain and subdomain driving accountability among data stewards and owners
• Architect and implement advanced data quality solutions moving beyond basic IT monitoring completeness timeliness consistency to incorporate sophisticated accuracy and validity checks Translate complex business rules into executable data quality logic within Snowflakes internal processes
• Leverage and implement Snowflakes native capabilities eg Data Metric Functions Streamlit stored procedures Streams Tasks Dynamic Tables to embed and enforce robust data quality rules directly within the platform from data ingestion to downstream consumption
• Develop and maintain the underlying data models and data pipelines that feed interactive dashboards and scorecards built with tools like Power BI and Tableau to visualize data maturity data usage data health lineage completeness and metadata coverage
• Collaborate closely with data domain teams data engineers and data scientists to identify data quality issues resolve lineage gaps and improve data trust scores
• Utilize Alation Compose SQL to develop customize and automate reports specifically for catalog lineage coverage and data quality insights integrating the data quality metrics from native Snowflake functions to drive trust flags in Alation
• Contribute to the documentation and visualization of trends in data adoption metadata completeness and AI readiness across the organization from an engineering perspective

Qualifications

• 7 years of handson engineering experience in data quality data governance data lineage or a related data engineering role
• Expertlevel proficiency in SQL Python and experience with scriptingautomation
• Proven experience in designing building and implementing data quality and metadata management solutions
• Demonstrable handson experience in driving and implementing data lineage initiatives specifically with Alation in conjunction with the Snowflake data platform and Quality platforms ie Montecarlo data quality Attacama Soda Octopai Gableai etc
• Strong technical understanding and practical experience with data engineering concepts including ETLELT pipeline development API integrations data modeling and complex data transformation logic
• Deep expertise in Snowflakes native data quality features and a track record of implementing them for robust data integrity
• Handson experience with data governance and cataloging tools such as Alation including practical experience with Alation Compose SQL or similar platforms
• Experience with data visualization tools like Power BI andor Tableau for building data quality and lineage dashboards
• Ability to translate business requirements into technical specifications and implement robust scalable data solutions
• Strong problemsolving skills and attention to detail with a passion for data accuracy and reliability

Job Tags

Similar Jobs