Big Data Engineer

at Wal-Mart Associates, Inc. in Bentonville, Arkansas, United States

Job Description

Duties: Define the data elements and Business requirements for the Enterprise Data Lake. Analyze and strategies the programs to collect, store and visualize data from various sources and Design data elements into a structured Data Model. Design the Data Model at Enterprise level using Modeling tool like Erwin, Visio, Lucid Chart etc. Prepare and Document Metadata definition for Enterprise Data Lake. Design and development of Big data applications using Core Java, Scala; deploy the applications and workflow into cloud environments. Competent knowledge on Hadoop eco system using real-time streaming technologies using Spark. Experience with cloud-based systems including Infrastructure and Platforms as a Service. Experience working with NoSQL databases Cassandra or MongoDB. Experience with ETL Technologies and creating data pipelines; interpret business requirement converting to technical design. Wring shell scripts using Linux to invoke and schedule applications; proficient knowledge on version control system like GIT or SVN. Writing complex SQL and Database level program like Procedures, Functions, Triggers etc. using Oracle SQL & PL/SQL along with real time monitoring and Tuning the Applications using Database Tools SQL Explain-Plan, SQL Profiler, AWR report, SQL Analyzer etc.


Minimum education and experience required: Bachelor's degree or the equivalent in Computer Science, Information Technology, Engineering or related field plus 5 years of software engineering or related experience.


Skills required: Must have experience with: designing, coding and developing Web services using JAVA, SCALA, C++,and C; building and optimizing BIG DATA pipelines, architectures and data sets along with cloud computing services such as GCP and AZURE; Web based application development technologies using markup languages such as AngularJS, HTML, UML, JSON, XML, SOAP, IrfanView, XDS-View, and XUI Data Manager; using Scripting languages such as JScript, VBScript, ShellScript, PerlScript, XSL, and Python; configurating Management tool usage such as GIT, Clearcase, CVS, SVN, Accurev, and P4; Software development methodologies such as AGILE, KANBAN, and LEAN; designing and building the infrastructure for data extraction, preparation and loading of data using database technology such as SQL, DB2, JDBC, Google Bigquery, Informix, and Teradata; testing and Troubleshooting using various tools such as SNMPTest, QTDesigner, Junit, Dynatrace, and Fiddler; using defect Tracking tools such as JIRA, Bugzilla, IBM Clear Quest, Test Link, Remedy, and PM Smart; developing Internet standard protocol on IP networks and processes commands (SNMP, CLI); using Terminal Emulator such as Putty, Filezilla, and Teraterm PRO; developing and simulating codes using tools such as Eclipse, IBM Rational ClearQuest, IBM Rational Rose, IBM Rational Purify, Source Insight, Exceed, and CIPT; using Operating systems such as Unix, Linux, and Windows.  Employer will accept any amount of experience with the required skills.

To apply for this position:  Send your resume to and reference the following Job ID number: R-705726

Copy Link

Job Posting: 3033060

Posted On: Aug 27, 2021

Updated On: Oct 12, 2021