Position Available in either NYC or San Francisco

We create tools used by over a million students every day. Engagement at this scale creates over 1TB of data daily, streamed into a real-time pipeline. This data is consumed by teams of data scientists, analysts, and engineers to optimize the experience for our users. Your role will be to manage & enhance this pipeline, collaborate with other teams to make additional metrics available, and push the leading edge of what’s possible for real-time personalization of our products.

You will be part of a recognized and passionate team that is focused at the intersection of UX, product, and monetization optimization. We build software to help students compile research, create bibliographies, and ensure all sources are correctly cited in completed papers. We offer these tools for free through ad-supported accounts as well as through paid monthly subscriptions.

Data is already at the heart of both our ads & subscription businesses and you will be core to our ongoing growth.

Our Stack

Desired Skills and Experience

  • Custom, high-performance client-side javascript streams data from each users’ browsers into our systems
  • It is collected/enriched by OpenResty/Nginx
  • Streamed into fluentd
  • Streamed to Kinesis & Elasticsearch
  • Events pushed to Google Analytics, exported to BigQuery
  • Websocket communication with Elixir (Phoenix framework) to do realtime predictions with Vowpal Wabbit.
  • 3+ years software engineering experience, specifically with:

Streaming systems (ideally Fluentd and/or Logstash) ElasticSearch & Kibana Spark, Vowpal Wabbit, Mahout AWS, Docker (ideally docker-compose/convox/ECS) Ruby, OpenResty/Lua, Elixir/Erlang, R and/or Python

  • Streaming systems (ideally Fluentd and/or Logstash)
  • ElasticSearch & Kibana
  • Spark, Vowpal Wabbit, Mahout
  • AWS, Docker (ideally docker-compose/convox/ECS)
  • Ruby, OpenResty/Lua, Elixir/Erlang, R and/or Python
  • Strong blend of technical and creative skills
  • Experience working closely with engineering teams, researchers and business leaders
  • Strong communication, and demonstrated ability to contribute to multiple projects, team goals and deadlines
  • Experience working with distributed development teams and over communicating about progress and challenges to hit business goals
  • An insatiable appetite to transform education through data.
  • Experience with concurrent server-side languages such as Erlang, Go, Elixir
  • Experience with AWS
  • Open source contributor
  • Experience with ad-tech
  • Favorite color is orange.