Job Opening - Lead Data Engineer
Kanshe Infotech
- USA
- Permanent
- Full-time
Location: Dallas, Atlanta, New Jersey, Chicago, West Virginia, Nashville
Contract Length: 6 MonthsPosition OverviewWe are seeking a Lead Data Engineer to join a high-priority project with KPMG. The ideal candidate will have a strong background in Azure data engineering, GenAI/LLM models, and cloud solutioning. This role requires both hands-on technical expertise and the ability to drive delivery across multiple program tracks.Key ResponsibilitiesLead the design and development of document intelligence systems leveraging GenAI, RAG, API integrations, and vector databases.Work with LLM models such as OpenAI, LlamaCloud, or Claude to deliver specific use cases.Act as an SME in the Azure stack (ADF, ADB, Key Vault) and guide engineers on best practices.Design, build, and optimize data pipelines using Azure Databricks, Python, Spark, and SQL.Implement CI/CD pipelines, REST APIs, and enforce cloud networking/security principles.Collaborate with leadership and cross-functional teams to ensure project delivery.Manage multiple workstreams simultaneously at the program level.Conduct POCs and pilots to evaluate and adopt new technologies/tools.Must-Have SkillsAzure Data Engineering (Databricks, ADF, Key Vault) 6+ yearsCloud Solutioning & Delivery 10+ yearsStrong coding skills in Python & SQLExpertise with Spark for data engineering workflowsExperience in CICD pipelines, REST API integration, and cloud securityProven experience in document intelligence systems, RAG, and GenAIHands-on with POCs/pilots for emerging tools and technologiesPreferred SkillsExperience with Big 4 Consulting, MAANG companies, or top financial institutions (JPMC, Bank of America, etc.)Background in AI/ML platforms and projects