Azure Batch Storage and .Net applications
Data Engineer Interview Questions
18,773 data engineer interview questions shared by candidates
There were questions like "what technologies would you choose for your next project if you had $1m" without specifying any project-related info/requirements or even the underlying data for which you should pick the tools.
ADF: scenario based Pyspark: Coalesce vs repartition wide vs narrow transformation spark architecture one dataset to apply pivot transformation SQL: two questions (department wise highest salary, SQL question using REPLACE function)
How do you manage your daily tasks during the pandemic?
You are given a sorted array with repeated numbers. [1,1,1,3,3,3,3,3,4,5,6,6,6] Your task is to return the array by not repeating any number more than twice. And the array count. (In place) Output : [1,1,3,3,4,5,6,6]
About project , architectures ,some basics like partition,bucketing,RDD, Data frames, DAG execution engine, why from Hive to Spark SQL, difference between RDD, DataFrames, Datasets, how to make joins between data frames, what to do in spark job if our infrastructure is limited.
- What is the difference between shallow and deep copy in Python?
General purpose Azure Storage types ?
SQL queries, Informatica, Alteryx and Data warehouse concepts
Tell me about yourself was the first question after that they started asking question related to my resume, projects
Viewing 1581 - 1590 interview questions