Tiger Analytics Data Engineer Interview Questions and Answers

I have extensive experience in data engineering, focusing on ETL processes, data warehousing, and big data technologies.

• Developed ETL pipelines using Apache Spark to process large datasets for a retail client, improving data availability by 30%.

• Designed and implemented a data warehouse using Amazon Redshift, enabling faster reporting and analytics for business stakeholders.

• Worked with cloud technologies like AWS a...read more

Indexing in SQL is a technique to improve the performance of queries by creating a data structure that allows for faster retrieval of data.

• Indexes are created on columns in a database table to speed up the retrieval of data.

• They work similar to the index in a book, allowing the database to quickly find the rows that match a certain value.

• Indexes can be created using single or multiple columns.

• Examples: CREATE INDE...read more

SQL joins combine rows from two or more tables based on related columns, essential for data retrieval.

• INNER JOIN: Returns records with matching values in both tables. Example: SELECT * FROM A INNER JOIN B ON A.id = B.id;

• LEFT JOIN: Returns all records from the left table and matched records from the right. Example: SELECT * FROM A LEFT JOIN B ON A.id = B.id;

• RIGHT JOIN: Returns all records from the right table and m...read more

Discussing expected and current salary for negotiation purposes.

• Be honest about your current salary and provide a realistic expectation for your desired salary.

• Highlight your skills and experience that justify your desired salary.

• Be open to negotiation and willing to discuss other benefits besides salary.

• Research industry standards and salary ranges for similar positions to support your negotiation.

• Focus on the va...read more

Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads, while Delta Warehouse is a cloud-based data warehouse service.

• Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark and big data workloads.

• Delta Warehouse is a cloud-based data warehouse service that provides scalable storage and analytics capabilities.

• Delta Lake is mo...read more

Spark architecture is a distributed computing framework that consists of a driver program, cluster manager, and worker nodes.

• Consists of a driver program that manages the execution of tasks

• Utilizes a cluster manager to allocate resources and schedule tasks

• Worker nodes execute the tasks and store data in memory or disk

• Supports fault tolerance through resilient distributed datasets (RDDs)

Databricks DLT is a unified data management platform for batch and streaming processing.

• Databricks DLT (Delta Lake Table) is a storage layer that brings ACID transactions to Apache Spark and big data workloads.

• Batch processing is used when data is collected over a period of time and processed in large chunks, while streaming processing is used for real-time data processing.

• Use batch processing for historical data ...read more