Databricks Developer

Global Soft Systems

  • Houston, TX
  • Permanent
  • Full-time
  • 2 days ago
  • Apply easily
Role: Databricks DeveloperLocation: Houston, TXVisa: Without sponsorship candidatesOverview: Client is building a team to conduct a full-scale Databricks implementation with Priority Power. 3 MDC resources alongside US Solutions Architect: 1 Business/Data Analyst; 2 Data Engineers. Solutions Architect will be responsible for setting up the Databricks environment, starting with the AWS infra/hosting, Databricks workspace (alongside DBX SA), and data migration solution. Engineers will be responsible for building all of the "plumbing" and data ingestion, ETL, modeling.
  • We are looking for a Senior Engineer with strong Databricks experience and hands-on skills in Python, PySpark, and SQL.
  • They will be responsible for building data ingestion processes/ETL pipelines to ingest data from various sources into Databricks (bronze layer)
  • They should have experience in data modeling, transformations and curation of data through medallion architecture.
  • Needs cloud experience, AWS preferred, to migrate workflows from AWS to Databricks
  • The Engineers will be more-so responsible for getting the data into Databricks, data curation and transformation within Databricks models; MDC team will bring in Data Engineers with some Power BI experience to mock up a couple reports.
  • Subsequent phases will be more deeply engaged in the BI aspect and can assess additional resourcing needs at that time.
Must Have:
  • Databricks
  • Python
  • SQL
  • Spark/PySpark
  • Data warehousing, ETL, modeling fundamentals
  • Cloud experience (AWS preferred)
Nice to Have: DLT, Power BI

Global Soft Systems