Constructor
Senior Data Engineer
Constructor
$90k - $110k
Remote (Europe)
Python
Spark
Databricks

Senior Data Engineer

Overview

Constructor's AI-first solutions make it easier for shoppers to discover products they want to buy and for ecommerce teams to deliver highly personalized experiences that drive impressive results.

Job Description

Constructor is the only search and product discovery platform tailor-made for enterprise ecommerce where conversions matter. Constructor's AI-first solutions make it easier for shoppers to discover products they want to buy and for ecommerce teams to deliver highly personalized experiences that drive impressive results. Optimizing specifically for ecommerce metrics like revenue, conversion rate and profit, Constructor generates consistent $10M+ lifts for some of the biggest brands in ecommerce, such as Sephora, Petco, home24, Maxeda Brands, Birkenstock and The Very Group. Constructor is a U.S. based company that was founded in 2015 by Eli Finkelshteyn and Dan McCormick. For more, visit: constructor.io. We specialize in developing a cutting-edge search and discovery platform, encompassing search, autocomplete, browse, and recommendations, tailored specifically for online retailers, suppliers, and shops. Our goal is to provide all online stores with ability to have state-of-the-art discovery powered with AI and modern technologies, that optimize for the key e-commerce metrics, which differentiates us from our competitors. Boasting a robust infrastructure, we handle billions of requests daily and manage a vast data ecosystem, including ~400 GB of data intake daily and approximately 2PB stored in our data lake. The Data Platform is the central piece and the foundation of the data processing at Constructor. It is the set of tools and infrastructure that every data person uses in our company daily + it's used by some of our public-facing API to fetch data from. It is responsible for data landing from external clients (API), providing external visualization tools with data (Cube.js, ClickHouse), stores data in appropriate formats (S3, ClickHouse, Delta, Parquet), data processing (Python, Spark/Databricks, ClickHouse, AWS Athena, AWS Lambda), monitoring (Prometheus, PagerDuty, Sentry, custom internal APIs with FastAPI), automated testing of pipelines and data quality, cost observability, optimizations and many more things. We're hiring a Senior Data Engineer to work on our Data Platform. You'll be working in a team of engineers that both own, manage and develop cloud infrastructure that powers the platform and develop data pipelines, cubes, services and other tools that make it work. Tens of engineers, top management and external users will depend on your work.

Responsibilities

  • We're hiring a Senior Data Engineer to work on our Data Platform. You'll be working in a team of engineers that both own, manage and develop cloud infrastructure that powers the platform and develop data pipelines, cubes, services and other tools that make it work. Tens of engineers, top management and external users will depend on your work.

Required Skills

  • - Implement a data model for our tables (bronze, silver, gold) to incapsulate parsing logic, lower the costs and provide better abstractions
  • - Power our recommendation system with a fast, global data store.
  • - Improve the build system in our repositories to speed up test execution, job deployment and thus improving the developers productivity
  • - Optimize Spark pipelines, ClickHouse tables/queries, and streaming processing in AWS Lambda.

Benefits

  • - At least 4 years of experience
  • - Solid skills in any programming language (ideally Python)
  • - Big data engineering
  • - Web services
  • - Cloud providers (ideally AWS)
  • - Willing to build many diverse things to develop the platform

About the company

Constructor’s AI-powered search and product discovery platform delivers unmatched KPI optimization and fast ROI for enterprise ecommerce brands — while giving customers a personalized, enjoyable shopping experience.