Lead Data Engineer - Hadoop Admin
Target - Minneapolis, Minnesota
JOIN US AS A LEAD DATA ENGINEER – HADOOP ADMIN
The Lead Data Engineer is responsible for the development of high performance, distributed computing tasks using Big Data technologies such as Hadoop (platform level), NoSQL, text mining and other distributed environment technologies based on the needs of the organization. The Lead Data Engineer is also responsible for analyzing, designing, programing, debugging and modifying software enhancements and/or new products used in distributed, large scale analytics solutions.
PRINCIPAL DUTIES AND RESPONSIBILITIES
Designing and Implementation:
-
Assist in the definition of software architecture to ensure that the online organization’s software solutions are built within a consistent framework
-
Assist in the decision-making process related to the selection of software architecture solutions
-
Implement architectures to handle web-scale data and its organization
-
Execute strategies that inform data design and architecture partnering with enterprise standard
-
Assist in creating documents that ensure consistency in development across the online organization. Implements and improves core software infrastructure
-
Develop interactive dashboards, reports, and analysis templates
-
Implement and support a platform that can provide ad-hoc access to large datasets
Scope of Work:
-
Translate strategic requirements to ensure effective solutions meet business requirements.
-
Provide consultation on complex programs
-
Review and approve specifications to ensure consistency in approach and use
-
Assist partners as a technical and business-savvy resource to software engineering personnel on a range of software design issues
-
Perform systems and applications performance characterization and trade-off studies through analysis and simulation
-
Research improvements in coding standards
JOB REQUIREMENTS
MINIMUM REQUIREMENTS:
-
5 plus years of experience in developing software applications including: analysis, design, coding, testing, deploying and supporting of applications
- BS in Computer Science, Applied Mathematics, Physics, Statistics or area of study related to data sciences and data mining or relevant experience
- Proficient in application/software architecture (Definition, Business Process Modeling, etc.)
- Responsible for Operations of the complete Big Data Ecosystem
- The role will be responsible for providing innovative operational solutions and best practices
- Troubleshoot live site issues, engage appropriate parties, and drive through to resolution
- Handle escalations and communicate with users and partners
- Collaborate with teams/partners to improve overall operational maturity of Big Data ecosystem
- Experience with operational aspects of platforms such as monitoring and alerts management, availability, capacity management and service management
Posted: 30+ days ago
