Share this Job

Senior Software Engineer - Advanced Analytics

Apply now »

Date: Jul 19, 2022

Location: Charlotte, NC, US, 28216

Company: Corning

Overview

 

The Senior Software Engineer, Advanced Analytics will be part of a core development team working with domain experts, application developers, controls engineers, data engineers and data scientists. Their primary responsibility will be to design large scale, distributed and modular contextualization systems that will serve prepared datasets for model training and inferencing. You will also develop outbound machine learning deployment pipelines and address lifecycle management of these machine learning pipelines, in coordination with their architecture peers and communities of practice throughout the company. These systems will span both cloud and on-premise environments and will require close collaboration with many technical teams to ensure success.

The Senior Software Engineer- Advanced Analytics will work on a team called ‘Value Acceleration’ whose mission is to work directly with the Corning businesses to deliver digital work products that provide new value to the enterprise. They will work closely with the customer, the product owner, other engineers, data scientists, analysts and domain experts to deploy MVPs and Products built with our digital application platforms. Your work will be crucial to our global digital transformation efforts because it helps deliver actionable insight, leveraging agile methodologies to create value more effectively. The successful candidate will be responsible to participate in various MVP and Product implementations leveraging agile practices and the value delivery teams, leveraging advanced analytics and application development platforms to incorporate enterprise data and workflow information, interact with other enterprise systems and present this information to users that need it. Members of this new exciting team will get direct feedback from their customers on business value and how it is accelerating Corning's digital transformation.

 

Responsibilities

 

As a Senior Software Engineer, Advanced Analytics, your main responsibilities will be:

• Designing and implementing portable, modular, instrumented and highly performant data contextualization pipelines from landed and cleansed, batch and streamed unstructured data, using Apache Spark, Deltalake and/or Databricks

• Designing and implementing portable, modular, instrumented and highly performant model deployment pipelines for many types of machine learning including supervised and unsupervised learning as well as CNNs, RNNs or other deep learning algorithms

• Working with data engineering to define pipelines that serve curated datasets to business intelligence, reporting and HMI systems

• Working closely with domain expert data scientists, process and controls engineers, both within and outside the company to understand and automate transformation, normalization and other contextualization operations based on the types of analytics being performed on the inbound datasets, as well as model performance management requirements and design suitable inferencing instrumentation systems and practices that meet them

• Delivering and presenting proofs of concept implementations that explain the key technologies you have selected for your design and the recommended patterns of practice for ongoing development and lifecycle management. The target audience for these efforts span the company and include project stakeholders, data scientists, process experts, other domain architects and relevant technical communities of practice interested in leveraging your code for their own projects

• Working with your fellow developers using agile development practices, and continually improving development methods with the goal of automating the build, integration, deployment and monitoring of production inferencing and dataset delivery systems

• Working with the relevant communities of practice on roadmaps, and serving as a trusted committer for your code for inner sourcing efforts with other development teams in the company

 

Education & Experience

• Advanced degrees in computer science and data science strongly preferred, though an equivalent level engineering, data science or mathematics degree, a technical undergraduate degree and relevant experience will also be considered

• 3+ years of experience working with data scientists in a large-scale data engineering or production machine learning inferencing capacity, working with various types of supervised and unsupervised learning algorithms for classification, recommendation, anomaly detection, clustering and segmentation, as well as CNNs, RNNs or other deep learning algorithms

• 3+ years of full-stack experience developing large scale distributed systems and multi-tier applications

• 6 years of programming proficiency in, at least, one modern JVM language (e.g. Scala) and at least one other high-level programming language such as Python

• 2+ years of production DevOps experience

• 2+ years of programming on the Apache Spark platform, leveraging both low level RDD and MLlib APIs and the higher-level APIs (SparkContext, DataFrames, DataSets, GraphFrames, SparkSQL, SparkML). Demonstrated deep understanding of Spark core architecture including physical plans, DAGs, UDFs, job management and resource management

• Familiarity with MLflow and a demonstrated ability to implement in Databricks on AWS

• Demonstrated experience working with inner sourcing initiatives, serving both as a trusted committer and contributor

• Strong technical collaboration and communication skills

• Unwavering commitment to coding best practice and a strong proponent of code review

• Cultural bias towards continual learning, sharing best practice, encouraging and elevating less experienced colleagues as they learn

 

Additional Technical Qualifications

• Proficiency with functional programming methods and their appropriate use in distributed systems

• Experience with AWS foundational compute services, including S3 and EC2, ECS and EKS, IAM and CloudWatch

• Experience working with Kubernetes and Docker

• Experience with continuous integration and continuous deployment methodologies

• Experience with data management fundamentals and data storage principles

 

Other Qualifications

• Strong relationship building skills

• Proven success working in highly matrix environment.

• Excellent analytical and decision-making abilities.

• Must demonstrate a proven willingness to go the extra mile, to take on the things that need to be done and maintain a positive attitude that can adapt to change.

• Strong leadership and excellent verbal and written communications skills, with the ability to develop and sell ideas.

 

What sets us apart?

Corning’s unwavering commitment to Diversity. Diversity is integral to Corning’s belief in the fundamental dignity of the individual – one of Corning’s seven Values. We are committed to providing an environment where all employees can thrive. This begins with an understanding that our global workforce consists of a rich mixture of diverse people. This diversity will continue to be a source of our strength as well as a competitive advantage. If you have a passionate belief in the power of innovation to change the world; and if you are up to the challenge of working for a world-class organization that makes real, profitable advanced materials, then visit Corning’s website at www.corning.com


Nearest Major Market: Charlotte