Lead Software Engineer - Data Platform at Discord
San Francisco, CA, US

Discord is one of few places that combine who you play games with and how you play those games. We use this data to make Discord the best place to play games with your friends.

Lead our Data Platform team to build a scalable data platform that powers features and informs teams. Help us build scalable distributed systems like you'd construct additional pylons in your base. You build those in your sleep, amirite?

Discord is a small group of passionate gamers whose mission is to bring people together around games. Diversity and inclusiveness are a critical part of how we get there. We believe that with diversity comes a better product, better decisions, and a better work environment. Everyone here is committed to making Discord representative of the world we want to live and play in.

What you'll be doing

Lead multiple squads that comprise our data infrastructure group. You'll get to work with a really high-powered team that owns a large set of infrastructure systems:

Logging & Data Ingestion

Streaming & Batch processing

Machine Learning infrastructure

Data Tools & Interfaces

Build the platform that empowers our Data Science, Machine Learning & Analytics teams, as well as powers product features used by millions of users every day.

Own and operate our entire data stack using modern technologies such as Apache Beam, Kafka, Pub/Sub and Airflow.

Build efficient scalable solutions on top of GCP and AWS using Python, Scala and Go.

What you should have

Minimum of 4 years experience building scalable backend systems. 

Experience leading diverse engineering teams and delivering on high-impact projects.

Experience working on, and deploying, large-scale systems in Python or Go, Scala/Java, or other similar languages. 

Experience working with and operating production data systems such as Kafka, Storm or Spark. 

Love to work with high volume heterogenous data and distributed systems.

Self-motivation and the ability to take a high-level goal and deliver shippable code. 

Bonus Points

Proven track record of working with petabyte-scale data infrastructure. Discord has plenty of it.

Experience working with varied data applications and databases, such as Hadoop, BigQuery, Spark or Redshift.

Expert knowledge of SQL, MapReduce and/or statistics scripting tools (i.e. R).

BS/MS/PhD in Computer Science, Applied Mathematics or a related field.

Godlike pylon construction skills.