Data Engineer
We’re an innovative Deep Tech startup that’s disrupting the Data & Analytics industry. Our world-first Analytics Processing Unit (APU) provides unparalleled query performance and accelerates database operations beyond CPU bounds. We’re seeking an outstanding Data Engineer to join our team of experts and build the foundation on which we measure and optimize our breakthrough technology. This is a rare opportunity to shape the future of data analytics — from the core!
Job Description
In this role, you will be responsible for building data infrastructure for performance analysis, tuning, and analysis of a new analytics product. As a member of our Data Performance team, you will collaborate closely with other SW & HW Engineers to improve the performance of our new cutting-edge APUs. You will collaborate with our business leaders and participate in the product design and implementation. You will evaluate, implement, and integrate a diverse set of tools and technologies such as Spark, Comet, Velox, Dagster, Hardware emulators and software simulators.
Responsibilities
Join a multi-disciplinary team of experts operating at the foundation of Speedata’s data infrastructure stack
Build a robust data benchmarking infrastructure
Develop in-house measurements and ETL tools
Conduct detailed performance analysis and characterization
Research state-of-the-art benchmarks and techniques for SQL and data optimization
Qualifications
BS degree in Computer Science or equivalent relevant experience
At least 4 year experience in a Data Engineering role
At least 2 years working with Spark
In depth knowledge of SQL
Strong development skills in Python
Advantages
Experience with SQL benchmarks, specifically TPC-H and TPC-DS
Experience with SQL query tuning
Experience with GPUs or other hardware accelerators