Asked question on previous projects, HDFS commands and Kubernetes. Lots of question on technologies I used
Big Data Engineer Interview Questions
898 big data engineer interview questions shared by candidates
What my Qualifications are and How many years i have been in the Field for
Why work in data engineering?
First Round Experience He asked me 2 SQL Questions(Questions were based on Join and group byAlso asked to write same code in pyspark) and few basic spark questions like cache and persist, reparation and coalesc, RDD, Dataframe and dataset difference. I cleared first round and HR again scheduled second round Second Round: 2 SQL questions which was based on joins and union, union and union all difference, RDD vs Dataframe vs Dataset, Repartition and coalesce,Spark Architecture, Hive and other project related and basic questions. I cleared second round as well then HR scheduled next round which is HR round. HR round: Introduce yourself, What I know about Impetus, Why changing job and walked me through company info and CTC breakdown. She has some budget constraints or approval constraints so not sure why they called and conducted this whole process.
-mostly on resume - some hive questions - How map-reduce works? - Spark architecture questions.
About buckets, maps, analytical function, udf etc
Mostly ask about hadoop and spark and scala
Spark optimization techniques. Spark memory management.
Spark basics,Hive analytical functions, window functions, pivoting columns
General big data qns, Hadoop, mgmt qns, spark .
Viewing 881 - 890 interview questions