Senior Data Engineer - Databricks

Job Title: Senior AWS Data Engineer<\/b><\/span>
<\/p>

Location: Indianapolis, IN <\/b>

Role Overview<\/b><\/span><\/p>

We are seeking a highly skilled <\/span>AWS Data Engineer<\/b> to support a strategic <\/span>STRADA Modernization initiative<\/b>. This role focuses on building and supporting a modern <\/span>AWS + Databricks Lakehouse platform<\/b> to enable advanced <\/span>healthcare analytics (RWD/HEOR)<\/b>. The ideal candidate will have strong hands\-on experience with <\/span>AWS, Databricks, and data pipeline development<\/b>, along with the ability to work closely with both technical and business stakeholders.
<\/div>

<\/div>
Key Responsibilities<\/b>
<\/div>
  • Design, develop, and maintain data ingestion pipelines for real\-world data (RWD) sources
    <\/div><\/li>
  • Build and optimize data models within a Databricks Lakehouse architecture
    <\/div><\/li>
  • Ensure data governance, quality, and compliance standards are met
    <\/div><\/li>
  • Optimize cost, performance, and resource utilization across AWS and Databricks
    <\/div><\/li>
  • Collaborate with business and technical stakeholders to translate requirements into scalable solutions
    <\/div><\/li>
  • Provide technical guidance, coding standards, and best practices
    <\/div><\/li>
  • Support knowledge sharing through documentation and training sessions
    <\/div><\/li>
  • Deliver status updates and progress reports to senior leadership
    <\/div><\/li><\/ul>

    <\/div><\/span>

    Requirements<\/h3>

    Required Qualifications<\/b><\/span>
    <\/p>

    • Strong hands\-on experience with AWS services (S3, Glue, Lambda, Redshift, etc.)
      <\/div><\/li>
    • Proven experience with Databricks (Delta Lake, notebooks, workflows)
      <\/div><\/li>
    • Expertise in SQL and Python
      <\/div><\/li>
    • Experience building end\-to\-end ETL/ELT data pipelines
      <\/div><\/li>
    • Strong understanding of data modeling techniques
      <\/div><\/li>
    • Experience with data governance, quality, and compliance frameworks
      <\/div><\/li>
    • Ability to work independently and in a collaborative team environment
      <\/div><\/li>
    • Databricks Certification
      <\/div><\/li>
    • Experience building and managing CI/CD pipelines
      <\/div><\/li>
    • Experience with workflow orchestration tools
      <\/div><\/li>
    • Exposure to data observability and lineage tools
      <\/div><\/li>
    • Experience with monitoring, logging, and observability frameworks
      <\/div><\/li><\/ul>

      <\/div>

      Highly Preferred Skills<\/b><\/span>
      <\/p>

      • Experience in Healthcare / Pharma domain
        <\/div><\/li>
      • Exposure to RWD (Real World Data) or HEOR analytics
        <\/div><\/li>
      • Familiarity with Lakehouse architecture / Medallion (Bronze\-Silver\-Gold) models
        <\/div><\/li>
      • Experience optimizing cost and performance in cloud environments
        <\/div><\/li>
      • Strong communication and stakeholder management skills
        <\/div><\/li><\/ul>

        <\/div><\/span>