Big Data Engineer

at Wal-Mart Associates, Inc. in Bentonville, Arkansas, United States

Job Description

Duties: Define the data elements and Business requirements for the Enterprise Data Lake. Analyze and strategize programs to collect, store and visualize data from various sources and Design data elements into a structured Data Model. Design the Data Model at Enterprise level using Modeling tool like Erwin, Visio, Lucid Chart etc. Prepare and Document Metadata definition for Enterprise Data Lake. Design and development of Big data applications using Core Java, Scala; deploy the applications and workflow into cloud environments. Competent knowledge on Hadoop eco system using real-time streaming technologies using Spark. Experience with cloud-based systems including Infrastructure and Platforms as a Service. Experience working with NoSQL databases Cassandra or MongoDB. Experience with ETL Technologies and creating data pipelines; interpret business requirement converting to technical design. Writing shell scripts using Linux to invoke and schedule applications; proficient knowledge on version control system like GIT or SVN. Writing complex SQL and Database level program like Procedures, Functions, Triggers etc. using Oracle SQL & PL/SQL along with real time monitoring and Tuning the Applications using Database Tools SQL Explain-Plan, SQL Profiler, AWR report, SQL Analyzer etc.

Minimum education and experience required: Bachelor’s degree or the equivalent in Computer Science, Information Technology, Engineering or related field plus five years of experience in software engineering or related experience.

Skills required: Must have experience with: building scalable, fault-tolerant, high performance, service-oriented applications in retail and banking domains; C and C++ to build logics to process inventory within the distribution center; 4GL to design front-end screens and build business logics by calling backend services like C, C++, and Java to process data; ESQL/C and Pro*C to connect databases to send and retrieve data; Java and J2EE to communicate with external systems and building logics to process inventory within the warehouse; designing and implementing projects using modern technologies (Java, React JS, Angular, JavaScript, Azure Cloud, and Block Chain); React to send and retrieve data and Exago to retrieve reports; SQL and PL/SQL to write queries for data manipulation operations on databases; UNIX Shell scripting to invoke SQL scripts, C, C++, Pro*C or Java programs, and scheduling jobs using Crontab utility; Operating Systems (Windows, Unix, and Linux) to maintain and support applications; and Git, JIRA, Excel files and DBeaver to track activities like code versions and issues, and interface communications with external systems. Employer will accept any amount of experience with the required skills.

To apply for this position:  Send your resume to and reference the following Job ID number:  R-1109961

Copy Link

Job Posting: 3430749

Posted On: Jun 21, 2022

Updated On: Jul 22, 2022