Role: PySpark Plantir Data Engineer

Location: Bangalore, Hyderabad

We are seeking a skilled Data Engineer with expertise in PySpark using Palantir platform to join our dynamic team. The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a passion for solving complex data problems.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable data pipelines using PySpark.

Data Integration: Integrate various data sources into Palantir Foundry, ensuring data quality and consistency.

Data Transformation: Perform data cleaning, transformation, and aggregation to support analytics and reporting.

Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

Optimization: Optimize data processing workflows for performance and cost-efficiency.

Documentation: Create and maintain comprehensive documentation for data pipelines and processes.

Experience: 5+ years of experience in data engineering, with a focus on PySpark and Palantir

Technical Skills:

Proficiency in PySpark and Python.

Experience with Palantir Foundry or similar data platforms.

Strong SQL skills and experience with relational databases.

Familiarity with cloud platforms (AWS, GCP, Azure) and their data services.

Knowledge of data warehousing concepts and ETL processes.