Skip navigation EPAM

Senior/Lead AI DevOps/SRE Georgia or Remote

  • hot

Senior/Lead AI DevOps/SRE Description

We are currently seeking an experienced Senior/Lead AI DevOps/SRE to join our team. In this pivotal role, you will collaborate closely with data scientists and software developers to ensure seamless integration and optimize the operational efficiency of our AI deployments. Your expertise will be pivotal in deploying, maintaining, and scaling our cutting-edge AI solutions, encompassing LLMs and RAG systems.

As a key team member, you will spearhead both traditional DevOps responsibilities and innovative approaches to MLOps. Your proactive involvement will be essential in driving the success of our AI initiatives and maximizing their impact across the organization.


What You’ll Do

  • Implement and maintain CI/CD pipelines for AI and machine learning projects, ensuring robust deployment strategies and continuous integration
  • Monitor and ensure the reliability, availability, and performance of AI applications, particularly those involving LLMs and RAG
  • Collaborate with AI research teams to operationalize machine learning models and systems efficiently
  • Develop and enforce best practices for version control, configuration management, and testing of AI-driven software solutions 
  • Utilize MLOps tools such as Kubeflow, MLflow, or TensorFlow Extended (TFX) to streamline the machine learning lifecycle from experimentation to production
  • Implement monitoring solutions that track both system metrics and model performance to facilitate proactive issue resolution
  • Participate in on-call rotations to support the operational health of critical systems, employing SRE principles to meet service-level objectives (SLOs) and reduce downtime

What You Have

  • Bachelor’s degree in Computer Science, Engineering, or a related field
  • Proven experience as a DevOps Engineer or SRE, with a strong background in software development and automation
  • Expertise in deployment and management of LLMs, including technologies like RAG
  • Proficient in CI/CD tools (Jenkins, GitLab CI, CircleCI) and infrastructure as code (Terraform, Ansible)
  • Solid knowledge of container orchestration technologies (Kubernetes, Docker)
  • Familiarity with MLOps tools and practices to support machine learning lifecycle management

Nice to have

  • Experience with cloud services (AWS, GCP, Azure), particularly in AI/ML deployments
  • Background in monitoring tools like Prometheus, Grafana, and ELK stack
  • Understanding of Python, particularly in data science and machine learning contexts
  • Certification in Kubernetes, AWS/GCP/Azure, or similar technologies

We Offer

  • We connect like-minded people :
    • Delivering innovative solutions to industry leaders, making a global impact 
    • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
    • Opportunity to work abroad for up to two months per year 
    • Relocation opportunities within our offices in 50+ countries
    • Corporate and social events 
  • We invest in your growth:
    • Leadership development, career advising, soft skills and well-being programs 
    • Certifications, including GCP, Azure and AWS
    • Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru 
    • Free English classes with certified teachers 
  • We cover it all:
    • Participation in the Employee Stock Purchase Plan 
    • Monetary bonuses for engaging in the referral program 
    • Comprehensive medical & family care package   
    • Five trust days per year (sick leave without a medical certificate)   
    • Benefits package (sports activities, a variety of stores and services)

About EPAM

  • EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow