Senior Data Engineer – Databricks/PySpark

Location: Chennai (Hybrid)
Experience Required: 5 to 8 years
Salary Range: Up to 20 LPA
Job Type: Full-Time, Immediate Joiners Preferred


Role Overview

The Senior Developer will be responsible for designing and implementing solutions that adhere to best practices and are cost-effective. The role requires a strong background in backend development and Databricks, as well as the ability to mentor junior developers and coordinate with offshore/onsite teams. This long-term position will renew annually based on performance.


Key Responsibilities

  • Application Design: Develop applications with consideration for cost-efficiency, scalability, and industry best practices.
  • Development and Code Quality: Write high-quality, efficient code and conduct thorough code reviews, ensuring alignment with project requirements and design specifications.
  • Mentorship: Guide and mentor junior developers in technical skills and best practices.
  • Collaboration with QA/Automation Teams: Work closely with QA and automation teams, ensuring all testing scenarios are covered and detailed.
  • Production Support: Manage production applications, including troubleshooting and updates as required.
  • Offshore/Onsite Collaboration: Partner with offshore and onsite resources to align on implementation details and timelines.
  • Documentation: Document all processes and maintain updated technical documentation.
  • Adaptable Work Hours: Available to flex working hours to support project deadlines, coordinate with onsite teams (including EST), and address production outages if needed.
  • Requirements Analysis: Work with business and technology teams to thoroughly understand requirements, identify potential gaps, and propose solutions.
  • Data Analysis: Utilize strong data analysis skills to support application functionality and performance.

Required Skills and Qualifications

  • Technical Expertise:
    • Proficiency in Python/PySpark, SQL/PL/SQL and Databricks.
    • Strong backend development experience, with a focus on data-driven projects.
    • Strong analytical and problem-solving skills.
  • Experience:
    • Minimum of 5 years in IT development, with substantial exposure to design, code reviews, and mentoring junior developers.
  • Communication:
    • Excellent communication skills for effective collaboration across teams and regions.
  • Adaptability:
    • Ability to self-learn and adapt to new technologies and practices in a fast-paced environment.

Preferred Skills

  • Experience with:
    • Java/C#
    • Azure and Azure Data Factory
    • Kafka
    • Node.js
    • Big Data Tools
    • Linux

Additional Responsibilities

  • Safeguard Company Assets: Ensure compliance with company policies and uphold security standards.
  • Compliance: Adhere to all company compliance protocols.
  • Industry Knowledge: Maintain up-to-date knowledge of industry standards and best practices.
  • Customer Service Focus: Maintain a strong commitment to service quality, efficiency, and growth.

Perks and Benefits

  • Competitive salary and potential for performance-based bonuses
  • Health and wellness programs
  • Ongoing professional development opportunities
  • Collaborative and dynamic work environment

Apply for this position

Allowed Type(s): .pdf, .doc, .docx