Description
We are looking for a dynamic Data Engineer who has a blend of traditional Java engineering skills and experience within the Big Data space. This role requires strong knowledge in API development, AWS, and a passion for working with big data technologies like Hive, Hadoop, and Spark. If you enjoy working on an industry-leading Data Platform and contributing to open-source communities, this opportunity is for you!
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Project technologies and tools
- Java (Spring, concurrency, streams, lambdas)
- Hadoop ecosystem (Spark, Hadoop, Hive)
- AWS (EMR, S3), Kubernetes, Docker
- Terraform, Helm
- Microservices architecture, Kafka (Spark Streaming, Flink)
- Linux / Python (bash scripting, grep, sed, awk)
Responsibilities
Write clear, efficient, and well-tested codeCollaborate with other experienced software engineers to drive improvements to our technologyDesign and develop new services and software solutionsBuild and track metrics to ensure high-quality resultsWork independently with little to no guidance, and support and coach junior team membersBuild rapport with other engineering teams to ensure seamless integrationDevelop scalable and highly performant distributed systems, focusing on availability, monitoring, and resiliencyHelp shape the future of Data Lakes and take architectural ownership for various critical components and systemsEvolve development standards and design patternsDeploy and maintain applications in production environmentsCommunicate and document solutions and design decisions effectivelyRequirements
7+ years of core and server-side Java programming (Spring, concurrency, streams, lambdas)Strong knowledge of the Hadoop ecosystem (Spark, Hadoop, Hive)Extensive experience with cloud computing platforms (AWS, EMR, S3, Kubernetes, Docker)Proficiency with infrastructure-as-code tools (Terraform, Helm)Experience with microservice architecture, design, and best practices for scalabilityFamiliarity with Agile methodologies (Scrum, code reviews, pair programming)Experience with Kafka, including Spark Streaming or FlinkStrong skills in performance and scalability tuning, algorithms, and computational complexityProficiency in Linux / Python (bash scripting, grep, sed, awk)Passionate about open-source contributionsNice to Have
Contributions to open-source projectsExperience with other Big Data technologiesFamiliarity with Apache Iceberg and other modern data lakes toolsStrong interpersonal and communication skills to work effectively with cross-functional teamsWe Offer
Career plan and real growth opportunitiesUnlimited access to LinkedIn learning solutionsInternational Mobility Plan within 25 countriesConstant training, mentoring, online corporate courses, eLearning and moreEnglish classes with a certified teacherSupport for employees initiatives (Algorithms club, toastmasters, agile club and more)Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)Flexible work schedule and dress codeCollaborate in a multicultural environment and share best practices from around the globeHired directly by EPAM & % under payrollLaw benefits (IMSS, INFONAVIT, 25% vacation bonus)Major medical expenses insurance : Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)13 % employee savings fund, capped to the law limitGrocery coupons30 days December bonusEmployee Stock Purchase Plan12 vacations days plus 4 floating daysOfficial Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)Relocation bonus : transportation, 2 weeks of accommodation for you and your family and moreMonthly non-taxable amount for the electricity and internet bills