Data Engineer Interview Questions

Data Engineer

Interviewed at Catalytic Data Science

2.2★

Oct 13, 2020

Questions on System design, Python and SQL

Preguntas de pandas multiple choice

Data Engineer

Interviewed at Homegate AG

3.5★

May 6, 2021

What is the biggest challenge in your previous work?

Data Engineer

Interviewed at Aryaan Solutions

4★

Jun 6, 2022

tell me about youself ?

Basic concepts about Data Engineering

Data Engineer

Interviewed at ciValue

4.2★

Mar 16, 2023

Spark optimizations: what are the optimizations that can be done for the below snippet code: shoppers_df (customers description DF) 250MB, 15M records: schema: StructType = StructType(Array(StructFiled("shopper_id", LongType, nullable = True), StructField("retailer_id", StringType, nullable = True), StructField("shopper_group_id", StringType, nullable = True), StructField("join_date", DateType, nullable = True), StructField("shopper_type", StringType, nullable = True), StructField("gender", StringType, nullable = True))) sku_df (dimension DF): 15 MB, 90K records purchase_df (transactions DF): 50GB of parquet compressed files 5,000,000,000 records. schema: StructType = StructType(Array(StructFiled("shopper_id", LongType, nullable = True), StructField("product_id", LongType, nullable = True), StructField("pos_id", IntegerType, nullable = True), StructField("purchase_date", DateType, nullable = True), StructField("units", DoubleType, nullable = True), StructField("total_spent", DoubleType, nullable = True))) Current code: products_purchased_df = purchase_df.alias("purchase").join(shoppers_df, on = "shopper_id", how = "left outer").join(sku_df.alias("sku"), on = "product_id").select(Col("purchase.*"), Col("sku.*")) usage: status_df = products_purchased_df.groupBy(["shopper_id", "product_id"]).agg(...) Optimize join statement

Data Engineer

Interviewed at LifePod Solutions

4.5★

Jul 22, 2020

We will give you a take-home project to do and you will have to do research and come up with architecture around it?

Senior Data Engineer

Interviewed at Otto Car

3.3★

Feb 27, 2024

Two rounds - Online technical test Multiple choice answer and question format (skip questions that are not relevant) Technical questions on current problems the company faced and how you would solve it

Data Engineer

Interviewed at Technical Consulting and Research

4.1★

Aug 17, 2020

Talk about a project that involved Databases

Software/Data Engineer

Interviewed at Tygart Technology

4.7★

Aug 9, 2022

What are your career goals for the next 5 years