Big Data Engineer
AT&T - El Segundo, Georgia
The Big Data Engineer will be responsible for interpreting the requirements of various Big Data Analytic Use Cases and Scenarios, and driving the design and implementation of specific data models to ultimately help drive better business decisions through insights from a combination of external and AT&T’s data assets. This role is also accountable for developing the necessary enablers and data platform in the Big Data Lake Environment and has the responsibility of maintaining its integrity during the life cycle phases.
Key Roles and Responsibilities:
- This position will define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools in the Big Data Environment.
- This function needs to support the standardization, customization and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data.
- Implements statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists in data sourcing and preparation to visualize data and synthesize insights of commercial value.
- Will work with Big Data Policy and Security teams and Legal to create data policy and develop interfaces and retention models which requires synthesizing or anonymizing data.
- Develop and maintain data engineering best practices and contribute to Insights on data analytics and visualization concepts, methods and techniques.
- Solves unique problems through evaluative judgment/precedent. Independently applies sophisticated analysis in evaluating issues.
- Develops new concepts/methods/techniques for cross functional initiatives. Recognizes/pursues alternative methods.
- Mentors and provides technical guidance and explains advanced concepts to others in work area. Coordinates across multiple departments.
- Promotes active listening and open communication and provides leadership/guidance to others.
Qualifications:
-
Bachelors of Science in Computer Science, Math or Scientific Computing preferred
-
5-7 years total experience in development mainly around Java and all related technologies in the Java stack (e.g. Spring)
-
2-3 year in depth knowledge & experience in Hadoop around all the Hadoop ecosystem (HDP, M/R, Hive, pig, Spark/scala, kafka, Hbase, Elastic search and log stash a plus)
-
5 years of experience working in Linux/Unix
-
Good understanding & experience with Performance and Performance tuning for complex S/W projects mainly around large scale and low latency
-
Experience with leading Design & Architecture
-
NoSQL experience, mainly around MongoDB
-
Web dev experience, mainly around Angular.
-
Hadoop/Java certifications is a plus.
-
Excellent communication skills.
-
Ability to work in a fast-paced, team oriented environment.
Positions available in the Alpharetta, GA, Plano, TX and El Segundo, CA.
Posted: 30+ days ago
About AT&T
At AT&T, we’re bringing it all together. We deliver advanced mobile services, next-generation TV, high-speed Internet and smart solutions for people and businesses. That’s why we stand alone as a fully integrated solution provider.... more
