Backend Engineer

Overview

Job Description

Responsibilities

• - Maintain and grow the data pipeline that enables users to import their data from API and database sources
• - Expand the source library for users
• - Refactor how data is streamed from ClickHouse to object storage using Arrow
• - Design and implement a core interface for expanding the source library
• - Debug memory issues in the data pipeline service
• - Implement granular schema control for users
• - Build a graph traverser to materialize user-submitted queries
• - Instrument usage tracking to allow users to understand their import volume and costs

Required Skills

• - Experience with Python and Django
• - Hands-on experience with the Arrow data format
• - Strong skills in designing, architecting, and building data systems from the ground up
• - Experience using Temporal
• - Experience with ClickHouse
• - Experience with open source table formats (Iceberg or Delta tables)
• - Experience with ASTs
• - Experience dealing with incidents and carrying a pager
• - Comfortable with provisioning and deploying infrastructure

Benefits

• - Generous, transparent compensation & equity
• - Unlimited vacation (with a minimum!)
• - Two meeting-free days per week
• - Home office coworking credit
• - Private health, dental, and vision insurance
• - Training budget
• - Access to Hedge House
• - Carbon offsetting
• - Pension & 401k contributions
• - Company offsites