Databricks AWS Lead Software Engineer
Aumni
We are seeking a highly skilled Lead Data Engineer with proven experience in Databricks and AWS to join our data engineering team.
As a Lead Software Engineer at JPMorganChase within the Corporate Technology Finance team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
- Architect, develop, and optimize large-scale data pipelines and analytics platforms, leveraging Databricks (Spark, Delta Lake) and AWS cloud services
- Lead a team of data engineers, collaborate with data scientists and business stakeholders, and ensure best practices in data engineering, security, and cloud architecture
- Design, build, and maintain scalable ETL/ELT data pipelines using Databricks (Spark, Delta Lake) on AWS
- Architect and implement data lake and data warehouse solutions leveraging AWS services (S3, Glue, Redshift, Lambda, EMR, etc.)
- Lead and mentor a team of data engineers, providing technical guidance and code reviews
- Optimize data workflows for performance, reliability, and cost efficiency
- Collaborate with data scientists, analysts, and business teams to deliver high-quality data products
- Ensure data quality, security, and compliance with organizational and regulatory standards
- Drive adoption of best practices in data modeling, version control, CI/CD, and infrastructure-as-code (e.g., Terraform, CloudFormation)
- Troubleshoot and resolve issues in production data pipelines and analytics platforms
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience
- 10+ years of experience in data engineering
- Deep hands-on experience with Databricks (Spark, Delta Lake, notebooks, job orchestration)
- Strong expertise in AWS data ecosystem (S3, Glue, Lambda, IAM, etc.)
- Proficient in Python and/or Scala for data engineering
- Experience with SQL, data modeling, and performance tuning
- Familiarity with CI/CD, DevOps, and infrastructure-as-code in cloud environments
- Excellent communication and leadership skills
- Proven leadership experience in leading and mentoring varying levels of software engineers
- Experience with data governance, security, and compliance frameworks
- Experience with Immuta and Data quality control systems
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.
Carry out critical tech solutions across multiple technical areas as an integral part of an agile team