spark cluster confuguration to process 1 TB of file 2. quetions on data modelling 3.GCP related quetions 4 How do you implement logging 5.SMB join in hive along with this few scenario based quetions and some architecture related quetions on cloud and kubernetes
Senior Data Engineer Interview Questions
2,447 senior data engineer interview questions shared by candidates
What's the hardest data set you've come to work with and why?
why are you switching the job? why you left your first job?
just normal spark DAG, Lineage, Spark architecture, coding question which i was able to decode, list reverse, find unique list from multiple items in list,
About project in details. Python Pyspark Aws cloud
What are some things you would like to change within your team?
Examples of past work, how to handle upgrades, presentations, clashing priorities, customer requirements, and behavioral questions. I rated the interview difficulty as average compared to some interviews, although I feel there was a bit of a Slumdog Millionaire effect - they happened to ask questions I could find good examples to answer with. Pleasant people/environment.
1.Spark Architecture 2.Spark optimizations 3,Coding Questions
all remote 1. (45min)HR phone screen 2. (1 hr)Tech interview #1, leetcode medium Algorithn * 1 3. (1hr)Tech interview #2, leetcode hard * 3, SQL 4. (1hr)Behavior Questions, Hiring manager
“What is data shuffling and how does it impact performance?” “What’s data skew?” “How would you resolve it?” “What is Kubernetes?”
Viewing 1551 - 1560 interview questions