Shield

Hi, We're Shield!

Find us:
San Diego, California
Private
1001-5000
Defense and Space Manufacturing

Founded in 2015, Shield is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind mission autonomy, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield’s technology actively supports operations worldwide.

Mission and Vision

Our Values

Leadership Principles
No items found.

Meet Our Team

No items found.

Perks and Benefits

Professional Developments
Parental Leave and Caretaking
Health and Medical
Commitment to DEI
Retirement Benefits
How We Work
How We Pay
Our Culture
Other Perks and Benefits

Our Tech Stack

No items found.

Careers at 

Shield

Filters
Filters
Clear all
Functions
Remote Work Policy
Seniority
Locations
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Accounting/Auditing
Accounting/Auditing
Administration
Administration
Administrative
Administrative
Advertising
Advertising
Analyst
Analyst
Business Development
Business Development
Consulting
Consulting
Content Creation
Content Creation
Customer Success
Customer Success
Data Science + Analytics
Data Science + Analytics
Design
Design
Distribution
Distribution
Education
Education
Engineering
Engineering
Finance
Finance
Function1
Function1
Function2
Function2
Function Not Available
Function Not Available
Function Not Found
Function Not Found
Future Roles
Future Roles
General Business
General Business
Health Care Provider
Health Care Provider
HR/People Ops
HR/People Ops
Human Resources
Human Resources
Information Technology
Information Technology
IT
IT
Legal
Legal
Management
Management
Manufacturing
Manufacturing
Marketing
Marketing
OLD - use Customer Success
OLD - use Customer Success
OLD - use Design
OLD - use Design
Operations
Operations
Other
Other
Product
Product
Production
Production
Product Management
Product Management
Project Management
Project Management
Public Relations
Public Relations
Purchasing
Purchasing
Quality Assurance
Quality Assurance
Research
Research
Sales
Sales
Sales/Biz Dev
Sales/Biz Dev
Science
Science
Strategy/Planning
Strategy/Planning
Supply Chain
Supply Chain
Talent/Recruiting
Talent/Recruiting
Training
Training
UX/UI
UX/UI
Writing/Editing
Writing/Editing
Sunnyvale
Sunnyvale
Switzerland
Switzerland
Sydney
Sydney
Tampa
Tampa
Tel Aviv-Yafo
Tel Aviv-Yafo
Tempe
Tempe
Tewksbury
Tewksbury
Thackerville
Thackerville
The Woodlands
The Woodlands
Topeka
Topeka
Toronto
Toronto
Troy
Troy
Tulsa
Tulsa
United Kingdom
United Kingdom
United States
United States
US
US
USA
USA
Vancouver
Vancouver
Villa Park
Villa Park
Vilnius
Vilnius
Virginia
Virginia
Waltham
Waltham
Warren
Warren
Warsaw
Warsaw
Washington
Washington
Washington DC
Washington DC
Westchester
Westchester
Wilmington
Wilmington
Wilsonville
Wilsonville
Yuba City
Yuba City
Hybrid
Hybrid
OLD - use In-Person
OLD - use In-Person
In-Person
In-Person
OLD - use Remote
OLD - use Remote
Remote
Remote
OLD - use Mid-Senior ICs (Senior level)
OLD - use Mid-Senior ICs (Senior level)
Mid-Level
Mid-Level
Freelancer
Freelancer
OLD - use VP+
OLD - use VP+
Internship
Internship
OLD - use Associate
OLD - use Associate
Associate
Associate
OLD - use Mid-Senior ICs
OLD - use Mid-Senior ICs
Entry-level, Junior, or Associate
Entry-level, Junior, or Associate
VP+
VP+
Director
Director
Manager
Manager
Mid-Senior ICs
Mid-Senior ICs
Tag
Showing all of 20

Senior Staff Data Engineer, Databricks (R6508)

 • 
Shield
Featured
A featured role. The employer reviews Tech Ladies applicants first.
San Diego
Private
1001-5000

Founded in 2015, Shield is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind mission autonomy, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield’s technology actively supports operations worldwide.

H01X
3C1I
WOfE
p1w8

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube.

​

Role Summary

​

The Senior Staff Data Engineer will help build and operate the enterprise lakehouse on Databricks, creating the governed data foundation that supports multiple business domains and downstream analytics. This is a hands-on role, responsible for scalable ingestion, reliable data processing, and strong technical controls across the Bronze and Silver layers of the medallion architecture.

​

This role is not limited to moving data from point A to point B. The Data Engineer is expected to understand the meaning, sensitivity, classification, and intended use of the data flowing through the pipelines they build, and to apply that understanding when designing controls, access patterns, data quality checks, and segregation boundaries appropriate for a highly regulated environment.

​

What You'll Do

​

  • Design and build ingestion pipelines, batch and streaming where appropriate, from enterprise source systems into the Databricks lakehouse using Delta Lake.
  • Own Bronze-layer ingestion, including raw landing patterns, metadata capture, load traceability, and recoverable ingestion design.
  • Build Silver-layer pipelines for cleansing, standardization, deduplication, conformance, and quality enforcement without embedding unauthorized or undocumented KPI logic.
  • Define and evolve reusable ingestion and transformation patterns, templates, and engineering standards that other domains can adopt as they onboard to the platform.
  • Implement and maintain Databricks platform constructs needed for secure delivery, including catalogs, schemas, service principals, job orchestration, and environment-aware deployment patterns.
  • Build and maintain CI/CD pipelines for data platform assets, including ingestion code, transformation logic, workflow definitions, tests, and environment promotion across dev, test, and prod.
  • Apply data classification, segregation, and handling requirements within the pipeline design, ensuring sensitive and regulated data is processed in accordance with enterprise controls and access policies.
  • Build data quality controls that do more than detect technical failures, including checks that reflect actual business meaning, record integrity, completeness, and expected domain behavior.
  • Quarantine, flag, and route problematic records or datasets according to defined quality and compliance rules rather than silently dropping or obscuring issues.
  • Maintain documentation for source objects, ingestion logic, applied transformations, data quality rules, and known limitations so downstream teams can trust and use the data correctly.
  • Partner with the Analytics Engineer and domain teams to ensure Silver-layer data is reliable, well-governed, and suitable for trusted Gold-layer modeling.
  • Collaborate with domain engineering teams to align on ownership boundaries, onboarding patterns, data contracts, and support expectations as new domains are enabled onto the platform.

​

Preferred Qualifications

​

  • Databricks certification such as Data Engineer Associate or Professional.
  • Experience standing up or maturing Unity Catalog structures and access models in an enterprise setting.
  • Experience with CI/CD, infrastructure-as-code, and deployment automation for data platforms.
  • Experience in defense, aerospace, financial services, healthcare, or another highly regulated environment.
  • Experience enabling multiple business domains on a shared data platform while maintaining strong governance and ownership boundaries.

​

Required Qualifications

​

  • 12+ years of data engineering experience, including hands-on ownership of production data pipelines.
  • Strong Databricks experience, including Delta Lake, Databricks Workflows or Jobs, and Spark with PySpark and/or Spark SQL.
  • Working knowledge of Unity Catalog, including catalogs, schemas, tables, lineage, and access control concepts.
  • Experience with batch, CDC, and/or streaming ingestion patterns and the operational trade-offs associated with each.
  • Experience with CI/CD and deployment automation for data pipelines and platform assets, including version control, testing, and controlled promotion across environments.
  • Strong SQL skills and solid grounding in data modeling fundamentals, even if dimensional modeling is not the primary responsibility of this role.
  • Demonstrated ability to understand the business and regulatory context of the data being processed, not just the mechanics of pipeline development.
  • Experience applying data classification, segregation, security, retention, or compliance requirements in data engineering workflows within a regulated or security-sensitive environment.
  • Ability to design pipelines with awareness of the actual data domains involved, including sensitivity, ownership, permitted use, and downstream impact.
  • Comfort operating in a fast-moving platform build where patterns are still being established and engineers are expected to shape standards, not just follow them.

​

#LE

​

Full-time Regular Employee Offer Package

​

Pay within range listed + Bonus + Benefits + Equity

​

Temporary Employee Offer Package

​

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

​

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

​

​

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

​

Compensation Range: $149,040 - $223,560

2026-11-17

Apply NowApply Now

https://www.hiretechladies.com/jobs/senior-staff-data-engineer-databricks-r6508-shield-uu?utm_source=hiretechladies.com&ref=hiretechladies.com&utm_source=hiretechladies.com&utm_medium=job_board

No results found.
Reset filter
North Ridgeville
North Ridgeville
North Ryde
North Ryde
North Symonston
North Symonston
Northville
Northville
Norwalk
Norwalk
Norwich
Norwich
Novi
Novi
NY
NY
Oak Brook
Oak Brook
Oakbrook Terrace
Oakbrook Terrace
Oakland
Oakland
Ogden
Ogden
Ohio
Ohio
Ohrid
Ohrid
Oklahoma
Oklahoma
Oklahoma City
Oklahoma City
Olathe
Olathe
Omaha
Omaha
Ontario
Ontario
Orange
Orange
Orange County
Orange County
or country. Please provide a specific location for extraction.
or country. Please provide a specific location for extraction.
Oregon
Oregon
Orem
Orem
Orland Hills
Orland Hills
Orlando
Orlando
Oshkosh
Oshkosh
Ottawa
Ottawa
Overland Park
Overland Park
Oxnard
Oxnard
Palmdale
Palmdale
Palo Alto
Palo Alto
Paramus
Paramus
Parsippany
Parsippany
Pasadena
Pasadena
Pasay City
Pasay City
Peachtree City
Peachtree City
Pennington
Pennington
Pennsylvania
Pennsylvania
Pensacola
Pensacola
Peoria
Peoria
Philadelphia
Philadelphia
Philippines
Philippines
Phoenix
Phoenix
Piscataway
Piscataway
Pittsburgh
Pittsburgh
Plainview
Plainview
Plano
Plano
Pleasanton
Pleasanton
Pleasant Prairie
Pleasant Prairie
Plymouth
Plymouth
Poland
Poland
Portland
Portland
Port Melbourne
Port Melbourne
Portsmouth
Portsmouth
Praha
Praha
Princeton
Princeton
Provo
Provo
Pueblo
Pueblo
Qatar
Qatar
Quincy
Quincy
Quincy, MA
Quincy, MA
Raleigh
Raleigh
Rancho Cordova
Rancho Cordova
Rancho Santa Margarita
Rancho Santa Margarita
Raritan
Raritan
Reading
Reading
Redlands
Redlands
Redmond
Redmond
Redwood City
Redwood City
Remote
Remote
Remote (US)
Remote (US)
Reno
Reno
Renton
Renton
Reston
Reston
Rhode Island
Rhode Island
Richardson
Richardson
Richfield
Richfield
Richmond
Richmond
Richmond Heights
Richmond Heights
Rio Rancho
Rio Rancho
Riverside
Riverside
Riverton
Riverton
Riverwoods
Riverwoods
Rochester
Rochester
Rockville
Rockville
Rocky River
Rocky River
Roseland
Roseland
Rosemont
Rosemont
Roseville
Roseville
Roswell
Roswell
Royal Oak
Royal Oak
Rutherford
Rutherford
Sacramento
Sacramento
Salem
Salem
Salisbury
Salisbury
Salisbury, NC
Salisbury, NC
Salt Lake City
Salt Lake City
San Antonio
San Antonio
San Bernardino
San Bernardino

Join Tech Ladies for full-access to the job board, member-only events, and more!

If you're already a member, we haven't forgotten you. We promise. It's a new system. If you fill out the form once, it'll remember you going forward. Apologies for the inconvenience.