Hyderabad, TG, IN
Senior Data Engineer
About the Role
As a Senior Data Engineer, you'll be at the forefront of our data infrastructure, designing and building scalable data pipelines that transform raw information into valuable business intelligence. You'll lead technical initiatives, make architectural decisions, and collaborate with cross-functional teams to understand data needs and implement solutions that enable data-driven decision making across the organization.
Key Responsibilities
- Lead and design robust, scalable data pipelines and ETL processes using Python, PySpark, and other modern technologies
- Architect and implement complex data models and structures in various databases including MongoDB and SQL Server
- Build and optimize enterprise-level data workflows using Palantir / Azure AI Foundry platforms to ensure efficient data processing
- Drive collaboration with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
- Establish data quality standards by implementing validation procedures, monitoring systems, and data governance practices
- Lead troubleshooting efforts for complex data issues while maintaining system performance
- Evaluate and recommend new data technologies to continuously improve our data infrastructure
- Create and maintain technical specifications, processes, and best practices for sharing knowledge
- Mentor and develop junior engineers and contribute to establishing engineering standards across the organization
About the Team
We are a team that believes in engineering excellence and that our leaders should also be engineers themselves. We build applications that are carefully designed, thoughtfully implemented by working together with product owners. Quality and stability are first-class deliverables in everything we do, and we lead by example by embedding high standards into our processes.
About You
You're an experienced problem solver who thrives in collaborative environments and approaches challenges with creativity and analytical thinking. You have a deep passion for data engineering and stay current with emerging technologies. You're a natural leader who can guide technical discussions and mentor team members.
We are looking for candidates who meet these requirements:
- Bachelor's degree in computer science, Engineering, or related field with 12+ years of experience in data engineering roles
- Advanced proficiency in Python programming with extensive experience building enterprise-level data pipelines and ETL processes
- Deep expertise with PySpark for large-scale data processing and analytics in production environments
- Comprehensive experience with Palantir and Azure Data Factory & AI Foundry platforms for data integration and analysis at scale
- Proven expertise in database technologies including MongoDB and SQL Server, with advanced SQL skills
- Demonstrated experience leading technical initiatives and making architectural decisions
These are additional nice to have:
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services at enterprise scale
- Advanced knowledge of data visualization tools like Tableau, Power BI, or similar
- Expertise with real-time data processing frameworks such as Kafka or Spark Streaming
About Swiss Re
Swiss Re is one of the world’s leading providers of reinsurance, insurance and other forms of insurance-based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. We cover both Property & Casualty and Life & Health. Combining experience with creative thinking and cutting-edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 14,000 employees across the world.
Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.
If you are an experienced professional returning to the workforce after a career break, we encourage you to apply for open positions that match your skills and experience.
Reference Code: 137483