Share this Job

IT Data Architect

Apply now »

Date: Mar 27, 2021

Location: Painted Post, NY, US, 14870 Charlotte, NC, US, 28216

Company: Corning

Requisition Number: 44104

 

Corning is one of the world’s leading innovators in materials science. For more than 160 years, Corning has applied its unparalleled expertise in specialty glass, ceramics, and optical physics to develop products that have created new industries and transformed people’s lives.

Corning succeeds through sustained investment in R&D, a unique combination of material and process innovation, and close collaboration with customers to solve tough technology challenges.

The global Information Technology (IT) Function is leading efforts to align IT and Business Strategy, leverage IT investments, and optimize end to end business processes and associated information integration technologies.  Through these efforts, IT helps to improve the competitive position of Corning's businesses through IT enabled processes.  IT also delivers Information Technology applications, infrastructure, and project services in a cost efficient manner to Corning worldwide.

Role Summary: Data and technologies have drastically transformed the processes of industrial manufacturers from heavily human-powered to efficiently automated and system driven. Corning is creating innovative digital solutions for business divisions and functions and are looking for passionate, hard-working, and talented staff-level data engineers to help build our data-driven investment products for reuse, velocity and scale. The Data Architect (Ingestion Pipelines) will work with application development and IT operations to help achieve a state-of-the-art data pipelines that meet current and future business objectives, while at the same time ensuring that the company’s digital products offer the highest reliability and performance possible. This position will involve both hands-on data pipeline and engineering development and testing as well as data storage and processing tasks alongside an overall data ingestion architecture. The candidate will be responsible for driving innovation, technology strategy, and architecture across a wide range of new and existing data engineering capabilities. They will evaluate and recommend different solutions and provide leadership to the product and engineering teams in delivering architecture, design, and development of solutions across multiple products. Additionally, they will collaborate with key partners in the adoption of emerging standards and new technologies on highly complex projects that require in-depth domain knowledge.

Essential Responsibilities:

  • Designing and implementing highly performant data ingestion pipelines from multiple sources using both batch and replication capabilities such as Qlik Data Integration, Informatica, or AWS DMS
  • Developing scalable and re-usable frameworks for ingesting of structured and unstructured data sets
  • Architecting change data capture, historical load, and data recovery design patterns
  • Landing data in native object stores such as S3 as well as Apache Spark and/or Databricks
  • Delivering and presenting proofs of concept to of key technology components to project stakeholders.
  • Providing operational support documentation and operational procedures as well as resolving data pipeline operational issues to stated SLAs.
  • Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
  • Working with event based / streaming technologies to ingest and process data
  • Working with other members of the project team to support delivery of additional project components
  • Evaluating the performance and applicability of multiple data ingestion approaches against customer requirements
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
  • Analyzes, designs and develops a roadmap, design pattern, and implementation plan based upon a current vs. future state in a cohesive architecture viewpoint.
  • Review and/or analyzes and develops architectural requirements at data domain level within product portfolio or team.
  • Contributes to the development of data patterns and data delivery platforms that are service-oriented with reusable components that can be orchestrated together into different methods for different businesses.
  • Leads the research and evaluation of emerging data technology, industry and market trends to assist in project development and/or operational support actives.
  • Mentors team members to promote overall team development
  • Demonstrate excellent presentation, documentation & communication skills, and the skills required to influence technology direction in business context for the partners
  • Making decisions over technical issues, project policies, standards, and strategies
  • Designing integration patterns across raw ingestion, transformation, and aggregate/prediction data structures

Qualifications/Requirements:

  • Bachelor's Degree. Information Systems, Information Technology (IT), Computer Science, or Engineering preferred
  • 7-10 years relevant IT experience
  • 4+ years of experience as a Data Engineer or in a similar role
  • 5+ years of experience developing ETL and ELT
  • 4+ years of programming proficiency in, at least, one modern scripting or programming language such as Python, NodeJS, Java, or Scala.
  • 3+ years of experience with at least one ETL tool (Talend, Pentaho, SSIS) and open source data movement tools including Spark, AWS Kinesis or Apache Kafka/Storm
  • 3+ years of experience working in a data warehousing, business intelligence, big data, & data architecture
  • 2+ years of experience working with data replication tools such as Qlik Attunity, HVR, or GoldenGate
  • Experience with data modeling, data warehousing, and building ETL pipelines
  • Experience with a variety of data file formats such as Parquet or Avro
  • Experience in SQL and NoSQL
  • Expertise on AWS data platforms, including AWS Data Migration Services (DMS), AWS Data Pipeline, Data Pipeline and EMR/EC2.
  • Experience with Apache Kafka / Nifi for use with streaming data / event-based data
  • Proficient with continuous deployment methodology, DevOps and Agile and supporting tools such as Jira, Trello, Chef, Jenkins and/or Terraform

General Qualifications: The Data Architect will be an overall effective communicator. The individual will be able to conceptualize, plan, document and communicate effectively. The correct candidate will possess energy, develop value-added service definitions, and help lead change. The successful candidate for this position will have the following general experience and expertise:

  • Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
  • Experience providing technical leadership and mentoring other engineers for best practices on data engineering
  • Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
  • Understanding of various business data domains (e.g. Manufacturing, Engineering, Sales and Supply-chain)
  • Dedicated to meeting the expectations and requirements of internal and external customers
  • Works collaboratively with multiple levels to develop innovative or creative solutions that work effectively
  • Copes with change and decides well without having the total picture
  • Solves difficult problems with effective solutions using rigorous logic and methods
  • Knowledgeable about current and possible future IT trends and technology
  • Provides direct, complete, and “actionable” positive and corrective feedback to others
  • Deals with concepts and complexity comfortably
  • Effective communicator and presenter in formal and informal settings
  • Communicates a compelling and inspired vision or sense of core purpose
  • Highly self-motivated and directed
  • Team-oriented, collaborative environment leadership skills
  • Effective leadership, organization, and planning skills, with ability to handle changing priorities
  • Excellent communications, interpersonal and influencing skills
  • Ability to lead international teams across multiple initiatives that span various lines of business, geographic borders, time zones, and cultures
  • Must be a self-starter, able to work in team environment and motivate others

Travel: Limited work travel

We prohibit discrimination on the basis of  race, color, gender, age, religion, national origin, sexual orientation, gender identity or expression, disability, or veteran status or any other legally protected status.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.


Nearest Major Market: Corning