Big Data Engineer

at Wal-Mart Associates, Inc. in Bentonville, Arkansas, United States

Job Description

Duties: Define the data elements and Business requirements for the Enterprise Data Lake. Analyze and strategies the programs to collect, store and visualize data from various sources and Design data elements into a structured Data Model. Design the Data Model at Enterprise level using Modeling tool like Erwin, Visio, Lucid Chart etc. Prepare and Document Metadata definition for Enterprise Data Lake. Design and development of Big data applications using Core Java, Scala; deploy the applications and workflow into cloud environments. Competent knowledge on Hadoop eco system using real-time streaming technologies using Spark. Experience with cloud-based systems including Infrastructure and Platforms as a Service. Experience working with NoSQL databases Cassandra or MongoDB. Experience with ETL Technologies and creating data pipelines; interpret business requirement converting to technical design. Wring shell scripts using Linux to invoke and schedule applications; proficient knowledge on version control system like GIT or SVN. Write complex SQL and Database level program like Procedures, Functions, Triggers etc. using Oracle SQL & PL/SQL along with real time monitoring and Tuning the Applications using Database Tools SQL Explain-Plan, SQL Profiler, AWR report, SQL Analyzer etc.


Minimum education and experience required: Bachelor's degree or the equivalent in Computer Science, Information Technology, Engineering or related field plus 5 years of experience in software engineering or related experience.


Skills required: Must have experience with: Preparing High Level Design Documents (HLD) and Low Level Design Documents (HLD) detailing various aspects of the application and functionality; designing and implementing REST web services and APIs using Java and Spring Framework; designing and developing cloud native micro services applications using 12 Factor App Principles; integrating micro services based architecture with patterns and frameworks that provide resiliency such as Hystrix (Cloud Circuit Breaker Pattern and Self-Healing Distributed Systems); using NoSQL and Relational Database Systems; implementing API Gateway using Zuul; using Cloud based configuration management system (Spring Cloud); designing and implementing Authentication and Authorization using Spring Security; implementing Service Registry and Discovery for micro services using tools such as Eureka; using CI/CD tools such as Jenkins; and using Centralized Logging Systems such as ELK and Splunk and monitoring systems such as Dynatrace. Employer will accept any amount of experience with the required skills.

To apply for this position:  Send your resume to and reference the following Job ID number: R-660865

Copy Link

Job Posting: 2991895

Posted On: Jul 22, 2021

Updated On: Aug 22, 2021