Domain-informed Statistical Machine learning and modeling with Uncertainty Quantification

Statistical and machine learning methods for engineering processes and systems, integrating domain knowledge with data and uncertainty.

Our research integrates domain knowledge, statistical and machine learning modeling, and uncertainty quantification. The original diagram connects physics/engineering knowledge, data-driven modeling, and a Bayesian framework.

  • Domain Knowledge: physics/engineering knowledge
  • Statistical/ML Modeling: data-driven modeling
  • Uncertainty Quantification: Bayesian framework
Domain knowledge integrated with data-driven modeling
Domain knowledge integrated with data-driven modeling View full-size figure

Research directions

Research interests

Integration of domain knowledge into the data-analytics/machine-learning models

Data-driven Modeling, Design, Control, and Analysis on various Engineering Processes and Systems by leveraging the domain knowledge.

Monitoring, Diagnostics, Prognostics, and Prescriptive analysis (decision-making) on Engineering systems

Methodologies of interest: Statistical Analysis, Bayesian Modeling, Bayesian Optimization, Gaussian Processes, Reinforcement Learning, Physics-Informed Machine Learning

Previous & ongoing work

Tasks: 

  • Quality Control (Process Monitoring [J3, C3], Prognosis [J9,J15], Diagnosis [J2, J15], Preventive Maintenance [J9,J11]), 
  • Process/Design Optimization [J5, J8, J7, C5], 
  • Statistical Calibration/Inference [J2, J4], 
  • PDE Heterogeneous Parameter Estimation (Inverse Problem) [J10]
  • Faults Identification [J12, J13, J14]

Approaches: 

  • Probabilistic Modeling [J3, C3, J11], 
  • Statistical/Bayesian Modeling [J2, J4, J15], 
  • Bayesian optimization [J5, J8, C5], 
  • Gaussian process modeling [J4, J5, J8, J15, C5], 
  • Survival Model [J15], 
  • Uncertainty Quantification [J2, J4, J5, J8, J15],
  • Reinforcement Learning [J11],
  • Physics-Informed Machine Learning [J10]

Applications:

  • Advanced Manufacturing Process: e.g., Nano-scale Inkjet Printing, GFET Nanosensor Manufacturing & Design
  • Manufacturing System: e.g., Autobody assembly
  • Service System
  • Clinical Imaging (Elastography)/Bone biomechanics
Overview of data science methods for engineering processes and systems
Overview of data science methods for engineering processes and systems View full-size figure

Projects & applications

Preventive Maintenance on multi-component system (IoT-enabled Smart and Connected Production System)

Goal: Establishing a reinforcement learning method combined with a stochastic model to find the optimal preventive maintenance policy in a multi-components production system.

Methodologies: Deep Reinforcement learning, deep neural network, stochastic process modeling

Collaborators: This work is done with a Ph.D. student, T. Srikitrungruang and Collaborator, Dr. S. Jahani

Publications

Research diagram: Preventive Maintenance on multi-component system (IoT-enabled Smart and Connected Production System)
Preventive Maintenance on multi-component system (IoT-enabled Smart and Connected Production System) View full-size figure

Physics-Informed Machine Learning to estimate heterogeneous stiffness (elastic moduli) of bones based on the bone deformation data

Goal: To infer the unobserved underlying elastic properties based on observed noisy deformation data using the law of physics (partial differential equation; PDE).

Methodologies: Physics-Informed Neural Network, deep neural network

PDE Equation: Linear Elasticity with heterogeneous elastic moduli

Collaborators: This work is done with a Ph.D. students, T. Srikitrungruang, S Aghaee, an undergraduate student, M. Lemon, and  Collaborator, Dr. Yuxiao Zhou.

Publications

Research diagram: Physics-Informed Machine Learning to estimate heterogeneous stiffness (elastic moduli) of bones based on the bone deformation data
Physics-Informed Machine Learning to estimate heterogeneous stiffness (elastic moduli) of bones based on the bone deformation data View full-size figure

Prognostics with diagnostics capability : Real-time failure time and types prediction and uncertainty quantification

Methodologies: Bayesian Hierarchical Modeling, Convolutional Gaussian Process, Variational Inference, Proportional Cox Hazard model

Collaborators: This work is done with a Ph.D. student, S. Aghaee

Publications

Research diagram: Prognostics with diagnostics capability : Real-time failure time and types prediction and uncertainty quantification
Prognostics with diagnostics capability : Real-time failure time and types prediction and uncertainty quantification View full-size figure

Monitoring: Probability Modeling & Quality Control of Additive Nanosensor Manufacturing Process

Goal: Establishing a stochastic geometry model and a statistical quality control method using the image data

Methodologies: Stochastic geometry modeling, Stochastic process, physical property analysis

Publications

Research diagram: Monitoring: Probability Modeling & Quality Control of Additive Nanosensor Manufacturing Process
Monitoring: Probability Modeling & Quality Control of Additive Nanosensor Manufacturing Process View full-size figure

Data-driven Robust Design Optimization of Advanced Engineering System or Nanosensors

Goal: Data-driven design method minimizing the variance while satisfying mean outputs leveraging prediction & uncertainty

Methodologies: Bayesian optimization, Gaussian process modeling

Publications

Other Bayesian optimization (Process/System/Design optimization) papers:

Research diagram: Data-driven Robust Design Optimization of Advanced Engineering System or Nanosensors
Data-driven Robust Design Optimization of Advanced Engineering System or Nanosensors View full-size figure

Nonparametric Statistical Functional Data Modeling for Nanosensors & Statistical Calibration with Uncertainty Quantification

Goal: Uncertainty quantification, inference of underlying physical variable based on functional data

Methodologies: Functional data modeling, Gaussian Process modeling, Bayesian inference

Publications

Research diagram: Nonparametric Statistical Functional Data Modeling for Nanosensors & Statistical Calibration with Uncertainty Quantification
Nonparametric Statistical Functional Data Modeling for Nanosensors & Statistical Calibration with Uncertainty Quantification View full-size figure

Diagnosis on Faulty Operation leveraging domain knowledge IoT-enabled Smart and Connected Manufacturing System

IoT-enabled Smart and Connected System

Goal: Identifying faulty operations with excessive variation in a multistage manufacturing system; establishing a sparse-variance statistical model.

Methodologies: Random-effects model, hierarchical Bayesian prior modeling

Publications

Research diagram: Diagnosis on Faulty Operation leveraging domain knowledge IoT-enabled Smart and Connected Manufacturing System
Diagnosis on Faulty Operation leveraging domain knowledge IoT-enabled Smart and Connected Manufacturing System View full-size figure

Collaborated Research: Fully Inkjet-Printed, 2D Materials-Based Field-Effect Transistor for Water Sensing

Detail: Printing uniform channels by the (nano) inkjet printer is extremely challenging due to the well-known coffee-ring effects. The quality of the inkjet printed pattern hinges on many factors, including various material properties and temperature, which are often difficult to obtain. In this work, we proposed a method to achieve a uniform channel covered by an average of a single layer of graphene. By leveraging the fact that multiple printing passes can smooth out the coffee ring effects on the boundary, we formulate an optimization problem and achieve a uniform single layer coverage on the target region.

Publications

  • [J7] Xiaoyu Sui, Sonal V. Rangnekar, Jaesung Lee, Stephanie E. Liu, Julia R. Downing, Lindsay E. Chaney, Xiaodong Yan, Hyun-June Jang, Haihui Pu, Xiaoao Shi, Shiyu Zhou, Mark C. Hersam, and Junhong Chen, “Fully Inkjet-Printed, 2D Materials-Based Field-Effect Transistor for Water Sensing,” Advanced Materials Technologies, vol. 8, no. 22, article 2301288, 2023, doi:10.1002/admt.202301288.

    Publication record: [J7]

    • This paper was selected as the top viewed article in 2023.
Research diagram: Collaborated Research: Fully Inkjet-Printed, 2D Materials-Based Field-Effect Transistor for Water Sensing
Collaborated Research: Fully Inkjet-Printed, 2D Materials-Based Field-Effect Transistor for Water Sensing View full-size figure