1.) Tell about yourself? 2.) Tell about your latest project and challenges faced in the project? 3.) Some Technical question in SPARK.
Senior Big Data Engineer Interview Questions
75 senior big data engineer interview questions shared by candidates
About experience in preview jobs
we have 2 feeds: 1st feed: device_id, timestamp, location 2nd feed: device_id,timestamp, ssid (as array list) need to retrieve the most recent ssid's when you provide location need to retrieve the most recent location when you provide ssid
Explain MapReduce
Well thought out data structures & algorithm questions with interesting spins on common questions. If you have a decent foundation in CS fundamentals and are able to think on your feet to apply these fundamentals you should be able to do well.
What is the importance if elastic search and what is inverted indexing.
What the difference between partitioning and bucketing? How to optimized spark job?
Data structures for big data use-cases.
what's you expected salary?
Discussion around current project and challenges around it. How would you scale the current infrastructure? System design related questions. Write a program to find x number of max elements from m number of sorted arrays. General discussion around your project. Write spark code to find the unique routes from a given flight routes table where there could be individual entry for MumBai --> Kolkata/Kolkata--> Mumbai Write a spark scala code to get the employee who earns highest among employess whose salary is more than avg salary and age is less than the avg age. What is master in Spark? What does appName do in Spark? How the local scheduler work in Apache Airflow? How it differs from Kubernetes? Questions around airflow architecture. Given two programs for word count tell the difference between reduceBykey and groupbyKey?
Viewing 11 - 20 interview questions