Share this Job

IT Data Architect

Apply now »

Date: Sep 22, 2021

Location: Charlotte, NC, US, 28216 Painted Post, NY, US, 14870

Company: Corning

Requisition Number: 49931

 

Corning is one of the world’s leading innovators in materials science. For more than 160 years, Corning has applied its unparalleled expertise in specialty glass, ceramics, and optical physics to develop products that have created new industries and transformed people’s lives.

Corning succeeds through sustained investment in R&D, a unique combination of material and process innovation, and close collaboration with customers to solve tough technology challenges.

The global Information Technology (IT) Function is leading efforts to align IT and Business Strategy, leverage IT investments, and optimize end to end business processes and associated information integration technologies.  Through these efforts, IT helps to improve the competitive position of Corning's businesses through IT enabled processes.  IT also delivers Information Technology applications, infrastructure, and project services in a cost efficient manner to Corning worldwide.

 

Location: Charlotte, NC – Corning, NY – Remote Options

 

Role Summary: Data and technologies have drastically transformed the processes of industrial manufacturers from heavily human-powered to efficiently automated and system driven. Corning is creating innovative digital solutions for business divisions and functions and are looking for passionate, hard-working, and talented staff-level data engineers to help build our data-driven investment products for reuse, velocity and scale.

 

The Data Architect will work with application development and IT operations to provide deep technical subject matter expertise for successfully deploying large scale data solutions in the enterprise, using modern data/analytics technologies. Their primary responsibility will be to develop productized, reliable and instrumented data ingestion pipelines that land inbound data from multiple process and operational data stores throughout the company to on-premise and cloud-based data lakes.  These pipelines will require data validation and data profiling automation along with version control and CI/CD to ensure ongoing resiliency and maintainability of the inbound data flows supporting our data and analytics projects. This position will involve both hands-on data pipeline and engineering development and testing as well as designing the data infrastructure to organize data for authorized individuals to access.

 

Essential Responsibilities:

  • Designing and implementing highly performant data ingestion pipelines from structured and unstructured sources using both batch and replication capabilities such as Qlik Data Integration, Informatica, or AWS DMS and process the data using S3, Apache Spark, Deltalake, MPP, OLAP and other relevant tech stacks
  • Design and implement patterns of practice for productized, CI/CD automated and highly performant data transformations and aggregations with an emphasis on integrated data models that support broad based KPIs
  • Architecting change data capture, historical load, and data recovery design patterns
  • Delivering and presenting proofs of concept to of key technology components to project stakeholders.
  • Providing operational support documentation and operational procedures as well as resolving data pipeline operational issues to stated SLAs.
  • Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
  • Working with event based / streaming technologies to ingest and process data
  • Working with other members of the project team to support delivery of additional project components
  • Evaluating the performance and applicability of multiple data ingestion approaches against customer requirements
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
  • Analyzes, designs and develops a roadmap, design pattern, and implementation plan based upon a current vs. future state in a cohesive architecture viewpoint.
  • Review and/or analyzes and develops architectural requirements at data domain level within product portfolio or team.
  • Leads the research and evaluation of emerging data technology, industry and market trends to assist in project development and/or operational support actives.

 

Qualifications/Requirements:

  • Bachelor's Degree. Information Systems, Information Technology (IT), Computer Science, or Engineering preferred
  • 7-10 years relevant IT experience
  • 5+ years of experience in big data engineering roles, developing and maintaining ETL and ELT pipelines for data warehousing, on-premise and cloud datalake environments
  • 4+ years of experience as a Data Architect or in a similar role
  • 4+ years of programming proficiency in, at least, one modern scripting or programming language such as Python, NodeJS, Java, or Scala.
  • 3+ years of experience with at least one ETL tool (Talend, Pentaho, SSIS) and open source data movement tools including Spark, AWS Kinesis or Apache Kafka/Storm
  • 2+ years of experience high-level Apache Spark APIs (Scala, PySpark, SparkSQL), and demonstrated strong, hands-on technical familiarity with Apache Spark architecture,
  • Demonstrated deep technical proficiency with Spark core architecture including physical plans, UDFs, job management, resource management, S3, parquet and Delta Lake architecture, structured streaming practices
  • 2+ years of experience working with data replication tools such as Qlik Attunity, HVR, or GoldenGate
  • Experience in SQL and NoSQL
  • Expertise on AWS data platforms, including AWS Data Migration Services (DMS), AWS Data Pipeline, Data Pipeline and EMR/EC2.
  • Advanced level proficiency with agile software development & continuous integration + continuous deployment methodologies along with supporting tools such as Git (Gitlab), Jira, Terraform, New Relic

General Qualifications: The Data Architect will be an overall effective communicator. The individual will be able to conceptualize, plan, document and communicate effectively. The correct candidate will possess energy, develop value-added service definitions, and help lead change. The successful candidate for this position will have the following general experience and expertise:

  • Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
  • Experience providing technical leadership and mentoring other engineers for best practices on data engineering
  • Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
  • Understanding of various business data domains (e.g. Manufacturing, Engineering, Sales and Supply-chain)
  • Dedicated to meeting the expectations and requirements of internal and external customers
  • Works collaboratively with multiple levels to develop innovative or creative solutions that work effectively
  • Copes with change and decides well without having the total picture
  • Solves difficult problems with effective solutions using rigorous logic and methods
  • Knowledgeable about current and possible future IT trends and technology
  • Provides direct, complete, and “actionable” positive and corrective feedback to others
  • Deals with concepts and complexity comfortably
  • Effective communicator and presenter in formal and informal settings
  • Communicates a compelling and inspired vision or sense of core purpose
  • Highly self-motivated and directed
  • Team-oriented, collaborative environment leadership skills
  • Effective leadership, organization, and planning skills, with ability to handle changing priorities
  • Excellent communications, interpersonal and influencing skills
  • Ability to lead international teams across multiple initiatives that span various lines of business, geographic borders, time zones, and cultures
  • Must be a self-starter, able to work in team environment and motivate others

 

Travel: Limited work travel

 

We prohibit discrimination on the basis of race, color, gender, age, religion, national origin, sexual orientation, gender identity or expression, disability, veteran status or any other legally protected status.

 

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.


Nearest Major Market: Charlotte