Senior Software Engineer, Data Engineering at Expanse
San Francisco, CA, US

Company Overview

Expanse, formerly Qadium, a San Francisco-based company, provides IT and security teams with complete visibility of the assets and risks on their global Internet Edge. This enables our customers, Fortune 1000 companies and the US government, to quickly and efficiently eliminate these risks. Through technology and service expertise, we surface and help remediate Internet Edge risks to prevent large breaches and successful attacks.

Expanse has raised over $65 million of funding from Founders Fund, NEA, IVP, and TPG. We were founded in 2012, after the founders met at DARPA.

Position Summary

As a Data Engineer, you will be responsible for building high performance, scalable data pipelines that power Expanse's global internet intelligence platform.  You will use the latest frameworks and technologies to solve complex problems.  You will be challenged to scale and design systems to accommodate ten times as much data, or to produce their outputs in 1/10th the time.  Your expertise will help define and secure the perimeters of the world's most important organizations.

What You’ll Do

  • Design, build, and scale data pipelines that consume data from and produce information into a number of backend storage technologies, including Kafka, Bigtable, Elasticsearch, BigQuery, Postgres, and Google Cloud Storage (GCS)
  • Implement systems using the latest batch and stream processing frameworks, including Apache Beam and Storm
  • Compute insights from streams that produce terabytes daily 
  • Bring the best technologies to bear against the most pressing issue facing the modern internet - cybersecurity
  • Take ownership of projects and drive them to completion

About You

  • 5+ years of experience as a professional software engineer
  • Experience with stream and/or batch processing technologies, such as Kafka, Storm, Spark, Hadoop, and their equivalents
  • Familiarity with distributed datastores, such as HBase, Elasticsearch, and S3, and their application for storing and indexing massive datasets
  • Experience optimizing data pipelines for latency, throughput, and/or economical use of cloud resources
  • Proficiency in Java
  • Comfortable supporting your work in production
  • Willing and able to work in San Francisco, CA


  • 100% coverage of employee healthcare benefits (Medical, Dental, Vision)
  • 50% coverage for dependent healthcare benefits
  • 20 vacation days with 10 company holidays
  • Parental Leave
  • 401k Plan
  • Pre-tax commuter & FSA benefits
  • Monthly contribution to phone bill
  • Relocation assistance available
  • Stocked kitchen + catered lunch and dinner
  • New hire office productivity budget - $300
  • Quarterly discretionary team building stipend
  • On-site activities such as Lunch and Learns, Speaker Series, Game Night, and Trivia Night
  • Company-wide events including team building, holiday party, and offsites