Big Data Engineer

at Wal-Mart Associates, Inc. in Bentonville, Arkansas, United States

Job Description

Duties: Define the data elements and Business requirements for the Enterprise Data Lake. Analyze and strategies the programs to collect, store and visualize data from various sources and Design data elements into a structured Data Model. Design the Data Model at Enterprise level using Modeling tool like Erwin, Visio, and Lucid Chart. Prepare and Document Metadata definition for Enterprise Data Lake. Design and development of Big data applications using Core Java, Scala; deploy the applications and workflow into cloud environments. Competent knowledge on Hadoop eco system using real-time streaming technologies using Spark. Experience with cloud-based systems including Infrastructure and Platforms as a Service. Experience working with NoSQL databases Cassandra or MongoDB. Experience with ETL Technologies and creating data pipelines; interpret business requirement converting to technical design. Wring shell scripts using Linux to invoke and schedule applications; proficient knowledge on version control system like GIT or SVN. Write complex SQL and Database level program like Procedures, Functions, Triggers etc. using Oracle SQL & PL/SQL along with real time monitoring and Tuning the Applications using Database Tools SQL Explain-Plan, SQL Profiler, AWR report, and SQL Analyzer.


Minimum education and experience required: Bachelor’s Degree or equivalent in Computer Science, Information Technology, Engineering, Business Administration or related plus 5 years of software engineering experience.


Skills required: Must have experience with: Building Chatbot applications using Microsoft Bot framework SDK v3 and v4; building machine learning models NLP/NLU using Microsoft LUIS; creating knowledge based utility using QnA Maker tool; application monitoring and logging using Azure Telemetry and Azure Application Insights; creating voice assistant applications using Microsoft Cortana and Google Assistant; deploying Chatbot applications to Azure cloud Bot Service authentication using Azure Active Directory Service; using Azure Cosmos DB for storage or MongoDB for external storage; developing web applications or n-tier architecture applications using Java/JEE, Struts, Spring, Hibernate Frameworks and JSP, Ajax, RESTFul APIs, and SOAP; Working experience in Restful API protocols in building SOA applications; developing UI Pages using Javascript, NodeJS, AngularJS and ReactJS; creating customer 360 degree view applications using Bigdata tools HBase, Hive, and MongoDB NoSQL; and Object Oriented design principles and developing Java J2EE based applications. Employer will accept any amount of experience with the required skills.

To apply for this position:  Send your resume to and reference the following Job ID number: R-801353

Copy Link

Job Posting: 3101197

Posted On: Oct 22, 2021

Updated On: Nov 22, 2021