Principal Production Engineer

Principal Production Engineer Hybrid, Bangalore or Pune, India JOB OVERVIEW Are you passionate about automation, cloud infrastructure, Kubernetes, and reliability engineering? As a Principal Production Engineer at Legion, you will build and operate a secure, highly scalable, and cost-effective AWS/Kubernetes-based cloud platform. You will work across infrastructure automation, CI/CD pipelines, observability, and production reliability. Simply put, the SRE team ensures Legion’s platform is reliable, scalable, and continuously improving for our customers. This role includes participation in an on-call rotation. RESPONSIBILITIES AND DUTIES • Serve as subject matter expert for the entire production infrastructure stack and software build pipelines. • Work independently on initiatives to improve security, stability, and responsiveness of Legion’s applications. • Train and mentor other members of the team. • Collaborate across teams to share knowledge and best practices widely within the Legion organization. • Support and operate Legion’s AWS-based cloud platform and Kubernetes (EKS) environments. • Leverage GenAI tools (e.g., Claude Code, Codex, or similar) to accelerate infrastructure development, automation, and auto-remediation of common production issues. • Build and maintain infrastructure-as-code using Terraform. • Develop automation and internal tooling using Go or Python. • Improve CI/CD pipelines to increase deployment safety and velocity. • Define and improve monitoring, alerting, and observability systems. • Respond to production incidents, conduct root cause analysis, and implement systemic improvements. • Develop and automate operational runbooks and remediation workflows. • Support production deployments, including during off-hours as needed. REQUIRED SKILLS AND QUALIFICATIONS • 8+ years of experience in SRE, DevOps, or SaaS production operations. • 5+ years of hands-on experience operating large scale production workloads in AWS. • Strong experience with Terraform and infrastructure-as-code practices. • 5+ years of experience with containerized environments using Docker and Kubernetes (EKS preferred); familiarity with Helm. • Proficiency in Go or Python (or similar programming language). • Experience building and maintaining CI/CD systems (Git-based workflows, Argo, Jenkins or similar). • Strong Linux/Unix systems experience. • Bachelor’s degree in Computer Science or equivalent practical experience. PREFERRED QUALIFICATIONS AND ATTRIBUTES • Experience with observability tools such as Datadog, CloudWatch, ELK stack, Prometheus, or similar. • Experience managing AWS RDS and/or Aurora MySQL including slow query analysis, replication, and upgrade operations. • Experience implementing SLIs/SLOs and reliability best practices. • Experience working effectively with remote, distributed teams. • Experience with supporting SOC 2 / ISO 27001 audits. • AWS certification preferred. COMPENSATION & BENEFITS At Legion, we offer competitive compensation and benefits packages to all employees. As a fully remote employer, pay for positions is determined using local, national, and industry-specific survey data. We strive to make competitive offers allowing employees room for future growth. Salaries will be based on the applicant’s location, level of experience, education, and specialized knowledge and skills. Additionally, we consider the external market rate, the amount we have budgeted internally, and internal equity within the company for the same position. Benefits include, but are not limited to: • Health Benefits • Paid Time Off and Paid Holidays • Parental Leave • Equity • Monthly Wellness Reimbursement • Monthly Lunch on Legion ABOUT LEGION Join Legion's mission to turn hourly jobs into good jobs. We're a remote, mission-driven team seeking exceptional talent to propel this vision. Embrace a culture that's collaborative, fast-paced, and entrepreneurial. With us, you'll grow your skills, work closely with experienced executives, and contribute significantly to our mission. Legion Technologies delivers the industry’s most innovative workforce management platform. It enables businesses to maximize labor efficiency and employee engagement simultaneously. The award-winning, AI-driven Legion WFM platform is intelligent, automated, and employee-centric. It’s proven to deliver 13x ROI through schedule optimization, reduced attrition, increased productivity, and increased operational efficiency. Legion delivers cutting-edge technology in an easy-to-use platform and mobile app that employees love. If you're ready to make an impact and grow your career, Legion is where you belong. Join us in making hourly work rewarding and fulfilling. BACKGROUND AND OPPORTUNITY There are almost 75 million hourly workers in the United States, representing more than half of the entire workforce. Historically, managing hourly employees has been difficult due to high attrition (average of 60%) and high replacement costs (average of $3,200 per employee in retail). The ongoing labor shortage and competition from the gig economy make it more difficult to attract and retain hourly employees. The top reasons hourly employees leave their jobs are a lack of schedule empowerment, poor communication with employers, and an inability to get paid early. Gen Z and the millennial workforce demand gig-like flexibility, modern technology, and compelling work options. Legion’s mission is to turn hourly jobs into good jobs, serving the hourly workers who make up the majority of the US workforce. We believe in empowering employees and helping employers be efficient and innovative by enabling intelligent automation powered by Legion’s Workforce Management platform to optimize labor efficiency and enhance the employee experience simultaneously. Legion WFM was built for the cloud with AI at the core and designed to handle the complexity of modern businesses and meet the needs of today’s hourly employees. Our team is comprised of dedicated individuals from all backgrounds and experiences, globally distributed across all time zones. For more information, visit https://legion.co EQUAL EMPLOYMENT OPPORTUNITY Legion Technologies is proud to be an equal-opportunity employer and is committed to maintaining a diverse and inclusive work environment. All qualified applicants will be considered for employment without regard to race, color, religion, sex, age, disability, marital status, familial status, sexual orientation, pregnancy, genetic information, gender identity, gender expression, national origin, ancestry, citizenship status, veteran status, and any other legally protected status under federal, state, or local anti-discrimination laws. DISABILITY ACCOMMODATION For individuals with disabilities who need additional assistance at any point in the application and interview process, please email recruiting@legion.co We have noticed a rise in recruiting impersonations across the industry, where scammers attempt to access candidates' personal and financial information through fake interviews and offers. All Legion recruiting email communications will always come from the @legion.co domain. Any outreach claiming to be from Legion via other sources should be ignored. If you are uncertain whether you have been contacted by an official Legion employee, reach out to recruiting@legion.co Legion is an equal opportunity employer. All applicants will be considered for employment without attention to race, religion, color, sex, sexual orientation, gender identity, age, national origin, veteran, disability status, or any other basis covered by appropriate law. How We Determine What We Pay As a global employer, Legion determines pay for positions using local, national, and industry-specific survey data. We evaluate external equity and the cost of labor/prevailing wage index in the relative marketplace for jobs directly comparable to jobs within our company. Our posted salary range is based on national data and may be refined for a candidate's region/town/cost of living. For new hires, we strive to make competitive offers allowing the new employee room for future growth. Salaries will be based on the applicant’s location, level of experience, education, and specialized knowledge and skills. Additionally, we consider the external market rate, the amount we have budgeted internally, and internal equity within the company for the same position. An employee/candidate with a stronger skill set will receive higher pay. Job Applicant Privacy Policy This Job Applicant Privacy Policy (“Policy”) describes how Legion Technologies, Inc. (“Legion”, “we”, “us” and “our”) collects, uses, and discloses “personal information” as defined under California law from and about job applicants who are residents of California. This Policy does not apply to our handling of data gathered about you in your role as a user of our consumer-facing services. When you interact with us as in that role, the Legion Privacy Policy applies. • Types of Personal Information We Handle We collect, store, and use various types of personal information through the application and recruitment process. We collect such information either directly from you or (where applicable) from another person or entity, such as an employment agency or consultancy, background check provider, or other referral sources. This information includes: • Identification and contact information, and related identifiers such as full name, date and place of birth, citizenship and permanent residence, home and business addresses, telephone numbers, email addresses, and such information about your beneficiaries or emergency contacts. • Professional or employment-related information, including: • Recruitment, employment, or engagement information such as application forms and information included in a resume, cover letter, or otherwise provided through any application or engagement process; and copies of identification documents, such as driver’s licenses, passports, and visas; and background screening results and references. • Career information such as job titles; work history; work dates and work locations; information about skills, qualifications, experience, publications, speaking engagements, and preferences; and professional memberships • Education Information such as institutions attended, degrees, certifications, training courses, publications, and transcript information. • Legally protected classification information such as race, sex/gender, religious/ philosophical beliefs, gender identity/expression, sexual orientation, marital status, military service, nationality, ethnicity, request for family care leave, political opinions, and criminal history. • Other information such as any information you voluntarily choose to provide in connection with your job application. • How We Use Personal Information We collect, use, share, and store personal information from job applicants for our and our service providers’ business and operational purposes in the recruitment process such as: processing your application, tracking your application through the recruitment process, contacting references with your authorization, conducting background checks you authorize, and making hiring decisions. We will also use job applicant information for internal analysis purposes to understand the applicants who apply and to improve our recruitment process. We may sometimes need to use applicant information for legal purposes, such as in connection with any challenges made to our hiring decisions. • With Whom We Share Personal Information We will disclose job applicant personal information to the following types of entities or in the following circumstances (where applicable): • Internally: to other Legion personnel involved in the recruiting and hiring process. • Vendors: such as technology service providers, travel management providers, human resources suppli…