Data Architecture Lead
- New York City, NY
- Permanent
- Full-time
Our hybrid work style (50% at least working from the office) gives us the face-to-face time to have creative conversations, meaningful meetings, make quick decisions and build relationships. And it’s flexible enough to give you the space to do your best work.We are seeking a highly specialized Data Architecture Lead to oversee and strategically advance our multi-petabyte data architecture, specifically for our subscription-based cybersecurity platform. This is a key leadership role responsible for managing a large team of 30+ engineers, architecting complex data migration projects, and implementing sophisticated analytics capabilities to drive business decisions in a high-volume, security-focused environment.Essential Qualifications (All Required)Bachelor's degree in Computer Science, Data Engineering, or related technical field (Master's degree preferred)Minimum 15 years of hands-on engineering experience specifically in large-scale data environmentsMinimum 7 years of experience directly managing teams of data and software engineers, with proven track record of team growth and developmentExtensive experience managing Snowflake platforms with
$1M /year annual spend.Demonstrated experience successfully completing multiple enterprise-level migrations to Snowflake, including at least one documented migration specifically from Google BigQueryExpert-level proficiency in SQL query optimization for multi-petabyte datasetsAdvanced Python programming experience, specifically for data pipeline development and managementDemonstrated ability to build Kimball Warehouse architectures.Verifiable experience building and scaling multiple engineering teams from the ground upExtensive experience with AWS cloud infrastructure for large-scale data operationsDocumented experience implementing and managing data solutions for subscription-based business modelsProven track record implementing cohort analysis frameworks, LTV calculations, marketing attribution frameworks and complex feature usage analytics systemsHands-on experience with multi-petabyte data architectures, including partitioning strategies and performance optimizationDemonstrated expertise in CI/CD pipelines specifically for data engineering workflowsProficiency in GitFflow and Trunk based development methodologies as applied to data engineering teamsAdvanced implementation experience with either DBT or SQLMesh for data transformation workflowsDocumented experience ensuring compliance with GDPR, PCI-DSS, HIPAA and other privacy/security requirements in data systemsSpecialized Experience RequirementsMust have direct industry experience in cybersecurity ,ad-tech or another sector with demonstrable high-volume data processing [Billions per day]Demonstrated success implementing data architectures supporting real-time analyticsExperience designing and implementing data models specifically for subscription-based businesses, including churn prediction, retention analysis, and lifetime value calculationsMust have built end-to-end data platforms supporting in-app engagement metrics and feature utilization analysisExperience developing executive-level dashboards and analytics systems that directly inform product and business strategyPrevious success implementing data governance frameworks in regulated environmentsKey ResponsibilitiesDirect and strategically lead a team of data engineers, data analysts, and data scientistsOwn the architectural vision and implementation of our enterprise data platformLead multiple complex Snowflake migration initiatives, including strategy development, implementation planning, and executionDesign and implement sophisticated data pipelines supporting security analytics, customer behavior analysis, and financial reportingArchitect and oversee the implementation of advanced cohort analysis frameworks and feature usage tracking systemsImplement robust data governance and security controls, ensuring compliance with GDPR, PCI-DSS, and industry security standardsDevelop and maintain a scalable data architecture capable of processing and analyzing multi-petabyte datasetsCollaborate with executive leadership to align data strategy with overall business objectivesEstablish and enforce best practices for data engineering, including code reviews, documentation, and technical standardsOversee the implementation and ongoing refinement of CI/CD pipelines for data workflowsManage complex data transformations using enterprise tools like DBT or SQLMeshLead initiatives for data quality improvement and monitoringRequired Technical SkillsAdvanced SQL optimization techniques for complex analytical queriesPython (including pandas, numpy, and data processing libraries)Snowflake architecture and administration (advanced level)AWS cloud services, particularly those related to data storage and processingData modeling for subscription-based business analyticsCI/CD implementation for data pipelinesVersion control systems and gitflow workflowsData transformation frameworks (dbt or SQLMesh)Data security and privacy implementation techniquesSalary range: $200,000.00 - $270,000.00
The pay range depicts a base salary range for all positions except commission-based roles. The pay range for commission-based roles represents On Target Earnings (annual base salary + target annual commission). Additional compensation elements may be offered including an opportunity for bonus incentives and also competitive benefits package. Actual compensation offered will be determined by factors such as the external/internal market demand, location, level, job-related knowledge, skills, and experience.This position requires a unique combination of technical depth, leadership experience, and specialized domain knowledge. Due to the advanced nature of our data infrastructure and security requirements, candidates must meet all specified qualifications to be considered.Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability, medical condition, marital status, sexual orientation, gender identity or expression, military or veteran status, or other unlawful factors. Gen prohibits discrimination based on these protected characteristics and recruits talented candidates from diverse backgrounds.We consider individuals with arrest and conviction records and do not discriminate against employees for discussing their own pay or that of other employees or applicants. .To conform to U.S. export control regulations, applicant should be eligible for any required authorizations from the U.S. Government.