Data Engineer

Overview

As a Data Engineer, you will work closely with business and technical teams to adapt and transform business requirements into effective data management solutions. You will leverage cutting-edge technologies such as Databricks, AWS EMR, Spark, Snowflake, and DBSQL to design, optimize, and implement data models and solutions that drive business value.

Key Responsibilities:

• Database Management & Design: Establish and maintain database management systems, define standards and quality assurance processes for deliverables (conceptual design, logical database, capacity planning, etc.).
• Data Modeling & Solution Design: Develop and implement data models, working closely with business analysts and systems engineers to define table attributes, relationships, and field specifications for relational models.
• System Installation & Configuration: Evaluate and install database management systems to ensure optimum performance, scalability, and security.
• Programming & Development: Code complex programs, develop logical processes on technical platforms, and build windows, screens, and reports.
• User Interface & Application Prototypes: Assist in the design and development of user interfaces and business application prototypes.
• Quality Assurance: Participate in quality assurance activities, develop test application code, and ensure compliance with data governance policies.
• Data Optimization: Help design solutions for data storage, workload optimization, and data transformation using Databricks, AWS EMR, and other technologies.
• Cross-functional Collaboration: Work with cross-functional teams, including business analysts, data scientists, and engineers, to ensure the integrity, security, and scalability of data solutions.
• Mentoring & Leadership: Lead and mentor a team of data engineers, fostering a collaborative and high-performance work environment.

Required Qualifications:

• Education: Bachelor’s degree in Computer Science, Engineering, or a related field. (Alternative qualifications such as a Master’s degree or equivalent experience may be considered.)
• Experience: A minimum of 10 years of directly relevant experience, including comprehensive experience as a business/process leader or industry expert.
• Technical Expertise: Extensive experience with Databricks, AWS EMR, Spark, Snowflake, DBSQL, data modeling, and solution design.
• Data Architecture & Optimization: Strong knowledge in data storage, relational models, table relationships, and data optimization strategies.
• Experience in Data Engineering: Proven experience in building and optimizing large-scale data infrastructure and systems.
• Leadership & Communication: Demonstrated experience leading teams and collaborating effectively with both technical and non-technical stakeholders.

Additional Desired Skills:

• Workload Optimization: Expertise in designing and implementing optimized data workflows and pipelines.
• AtScale: Experience with AtScale (a plus, but not required).
• Technical Documentation: Strong ability to document and communicate technical specifications and design decisions.

The target hiring compensation range for this role is $65 to $72. Compensation is based on several factors including, but not limited to education, relevant work experience, relevant certifications, and location.