Skip navigation EPAM

Senior Big Data Engineer Remote

  • hot

Senior Big Data Engineer Description

Job #: 50971
Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


A remote Senior Big Data Engineeris needed. This position is a part of our new EPAM Anywhere program for remote workers. EPAM Anywhere offers a variety of IT jobs for remote workers. Join us to work on ambitious and long-term projects, get a stable workload, and enjoy a work-life balance!

Project technologies and tools

  • Programming Languages: Java/ Scala; Python; SQL; Bash
  • Big Data stack: Hadoop, Yarn, HDFS, MapReduce, Hive, Spark, Kafka, Flume, Sqoop, Zookeper
  • NoSQL: Cassandra/ Hbase; MongoDB
  • Queues and Stream processing: Kafka Streams; Spark Streaming; Event Hub; IOT Hub; Storage Queues; Service Bus; Stream Analytics
  • Data Visualization: Tableau, QlikView
  • ETL & Streaming Pipelines: Pentaho; Talend; Apache Oozie, Airflow, NiFi; Streamsets
  • Operation: Cluster operation, Cluster planning
  • Search: Solr, Elasticsearch/ELK
  • InMemory: Ignite, Redis
  • Solid Cloud experience with more than 1 leading Cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)
  • Enterprise Design Patterns (ORM, Inversion of Control etc.)
  • Development Methods (TDD, BDD, DDD)
  • Version Control Systems (Git, SVN)
  • Testing: Component/ Integration Testing, Unit testing (JUnit)
  • Deep understanding of SQL queries, joins, stored procedures, relational schemas; SQL optimization
  • Experience in various messaging systems, such as Kafka, RabbitMQ
  • Rest, Thrift, GRPC, SOAP
  • Build Systems: Maven, SBT, Ant, Gradle
  • Docker, Kubernetes, Yarn

Requirements

  • Over 3 years of experience in enterprise software development
  • Solid background in BigData and distributed computing for 3+ years
  • Experienced and highly self-motivated professional with outstanding analytical and problem solving skills
  • Able to work closely with customers and other stakeholders
  • Good experience in developing BigData, highly available, largely scalable applications and systems
  • Able to play mentoring role on a project and ensure that solutions meet business requirements and expectations
  • Experienced in working with modern Agile developing methodologies and tools
  • Advanced experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning)
  • Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security
  • Experience building data ingestion pipelines, Data Warehouse or Database architecture
  • Experience with data modeling; hands-on development experience with modern Big Data components
  • Cloud: experience in designing, deploying and administering scalable, available and fault tolerant systems
  • Good understanding of CI/CD principles and best practices
  • Analytical approach to problem; excellent interpersonal, mentoring and communication skills
  • Data-oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAA
  • Motivated, independent, efficient and able work under pressure with a solid sense for setting priorities
  • Ability to work in a fast-paced (startup like) agile development environment
  • Experience in high load and IoT Data Platform architectures and infrastructures
  • Experience with Containers and Resource Management systems: Docker, Kubernetes, Yarn
  • Experience in direct customer communications
  • Solid skills in infrastructure troubleshooting, support and practical experience in performance tuning and optimization, bottleneck problem analysis
  • Experienced in different business domains
  • English proficiency
  • Advanced understanding of distributed computing principles

We offer

  • Competitive compensation depending on experience and skills
  • Work in enterprise-level projects on a long-term basis
  • Full-time remote work (you can work from anywhere you are)
  • Unlimited access to learning courses (LinkedIn learning, EPAM training courses, English regular classes, Internal Library)
  • Community of 36,700+ industry’s top professionals

HELLO! HOW CAN WE HELP YOU?


OUR OFFICES