Big Data Engineer

at Wal-Mart Associates, Inc. in Bentonville, Arkansas, United States

Job Description

Duties: Define the data elements and Business requirements for the Enterprise Data Lake. Analyze and strategies the programs to collect, store and visualize data from various sources and Design data elements into a structured Data Model. Design the Data Model at Enterprise level using Modeling tool like Erwin, Visio, Lucid Chart etc. Prepare and Document Metadata definition for Enterprise Data Lake. Design and development of Big data applications using Core Java, Scala; deploy the applications and workflow into cloud environments. Competent knowledge on Hadoop eco system using real-time streaming technologies using Spark. Experience with cloud-based systems including Infrastructure and Platforms as a Service. Experience working with NoSQL databases Cassandra or MongoDB. Experience with ETL Technologies and creating data pipelines; interpret business requirement converting to technical design. Writing shell scripts using Linux to invoke and schedule applications; proficient knowledge on version control system like GIT or SVN. Writing complex SQL and Database level program like Procedures, Functions, Triggers etc. using Oracle SQL & PL/SQL along with real time monitoring and Tuning the Applications using Database Tools SQL Explain-Plan, SQL Profiler, AWR report, SQL Analyzer etc.


Minimum education and experience required: Bachelor’s degree or the equivalent in Computer Science, Information Technology, Engineering, or related field plus 5 years of experience in software engineering or related experience.


Skills required: Must have experience with: coding in Unix and writing scripts and wrappers; creating Hive SQL queries (HQL); Oracle databases and other standard database query tools, and creating SQL queries, triggers and stored procedures (PL/SQL); ETL and creating DataStage jobs and sequences using DataStage; ESP and automic scheduling for monitoring and scheduling purposes; BI reporting tools for reporting purposes; Oracle databases, coding and debugging Oracle stored procedures and various other objects; creating Informix jobs and sequences using Informix ETL tools; Netezza Developer, conducting ETL development in Netezza environments using standard design methodologies; conducting database performance tuning, and performance tuning experience in all the databases and queries for Oracle; and  Teradata Developer, conducting ETL development in Teradata environments using standard design methodologies. Employer will accept any amount of experience with the required skills.

To apply for this position:  Send your resume to and reference the following Job ID number: R-705746

Copy Link

Job Posting: 3033064

Posted On: Aug 27, 2021

Updated On: Oct 12, 2021