1 / 113

Data Processing and Data Analysis

An Introduction to Hilbert-Huang Transform: A Plea for Adaptive Data Analysis Norden E. Huang Research Center for Adaptive Data Analysis National Central University. Data Processing and Data Analysis.

prema
Download Presentation

Data Processing and Data Analysis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. An Introduction to Hilbert-Huang Transform:A Plea for Adaptive Data AnalysisNorden E. HuangResearch Center for Adaptive Data AnalysisNational Central University

  2. Data Processing and Data Analysis • Processing [proces < L. Processus < pp of Procedere = Proceed: pro- forward + cedere, to go] : A particular method of doing something. • Analysis [Gr. ana, up, throughout + lysis, a loosing] : A separating of any whole into its parts, especially with an examination of the parts to find out their nature, proportion, function, interrelationship etc.

  3. Data Analysis • Why we do it? • How did we do it? • What should we do?

  4. Why?

  5. Why do we have to analyze data? Data are the only connects we have with the reality; data analysis is the only means we can find the truth and deepen our understanding of the problems.

  6. Ever since the advance of computer and sensor technology, there is an explosion of very complicate data. The situation has changed from a thirsty for data to that of drinking from a fire hydrant.

  7. Henri Poincaré Science is built up of facts*, as a house is built of stones; but an accumulation of facts is no more a science than a heap of stones is a house. * Here facts are indeed our data.

  8. Data and Data Analysis Data Analysis is the key step in converting the ‘facts’ into the edifice of science. It infuses meanings to the cold numbers, and lets data telling their own stories and singing their own songs.

  9. Science vs. Philosophy Data and Data Analysis are what separate science from philosophy: With data we are talking about sciences; Without data we can only discuss philosophy.

  10. Scientific Activities Collecting, analyzing, synthesizing, and theorizing are the core of scientific activities. Theory without data to prove is just hypothesis. Therefore, data analysis is a key link in this continuous loop.

  11. Data Analysis Data analysis is too important to be left to the mathematicians. Why?!

  12. Mathematicians Absolute proofs Logic consistency Mathematical rigor Scientists/Engineers Agreement with observations Physical meaning Working Approximations Different Paradigms IMathematics vs. Science/Engineering

  13. Mathematicians Idealized Spaces Perfect world in which everything is known Inconsistency in the different spaces and the real world Scientists/Engineers Real Space Real world in which knowledge is incomplete and limited Constancy in the real world within allowable approximation Different Paradigms IIMathematics vs. Science/Engineering

  14. Rigor vs. Reality As far as the laws of mathematics refer to reality, they are not certain; and as far as they are certain, they do not refer to reality. Albert Einstein

  15. How?

  16. Data Processing vs. Analysis All traditional ‘data analysis’ methods are really for ‘data processing’. They are either developed by or established according to mathematician’s rigorous rules. Most of the methods consist of standard algorithms, which produce a set of simple parameters. They can only be qualified as ‘data processing’, not really ‘data analysis’. Data processing produces mathematical meaningful parameters; data analysis reveals physical characteristics of the underlying processes.

  17. Data Processing vs. Analysis In pursue of mathematic rigor and certainty, however, we lost sight of physics and are forced to idealize, but also deviate from, the reality. As a result, we are forced to live in a pseudo-real world, in which all processes are Linear and Stationary

  18. 削足適履 Trimming the foot to fit the shoe.

  19. Available Data Analysis Methodsfor Nonstationary (but Linear) time series • Spectrogram • Wavelet Analysis • Wigner-Ville Distributions • Empirical Orthogonal Functions aka Singular Spectral Analysis • Moving means • Successive differentiations

  20. Available Data Analysis Methodsfor Nonlinear (but Stationary and Deterministic) time series • Phase space method • Delay reconstruction and embedding • Poincaré surface of section • Self-similarity, attractor geometry & fractals • Nonlinear Prediction • Lyapunov Exponents for stability

  21. Typical Apologia • Assuming the process is stationary …. • Assuming the process is locally stationary …. • As the nonlinearity is weak, we can use perturbation approach …. Though we can assume all we want, but the reality cannot be bent by the assumptions.

  22. The Real World Mathematics are well and good but nature keeps dragging us around by the nose. Albert Einstein

  23. Motivations for alternatives: Problems for Traditional Methods • Physical processes are mostly nonstationary • Physical Processes are mostly nonlinear • Data from observations are invariably too short • Physical processes are mostly non-repeatable. • Ensemble mean impossible, and temporal mean might not be meaningful for lack of stationarity and ergodicity. • Traditional methods are inadequate.

  24. What?

  25. The Job of a Scientist The job of a scientist is to listen carefully to nature, not to tell nature how to behave. Richard Feynman To listen is to use adaptive methods and let the data sing, and not to force the data to fit preconceived modes.

  26. How to define nonlinearity? Based on Linear Algebra: nonlinearity is defined based on input vs. output. But in reality, such an approach is not practical. The alternative is to define nonlinearity based on data characteristics.

  27. Characteristics of Data from Nonlinear Processes

  28. Duffing Pendulum x

  29. Hilbert Transform : Definition

  30. Hilbert Transform Fit

  31. Conformation to reality rather then to Mathematics We do not have to apologize, we should use methods that can analyze data generated by nonlinear and nonstationary processes. That means we have to deal with the intrawave frequency modulations, intermittencies, and finite rate of irregular drifts. Any method satisfies this call will have to be adaptive.

  32. The Traditional Approach of Hilbert Transform for Data Analysis

  33. Traditional Approacha la Hahn (1995) : Data LOD

  34. Traditional Approacha la Hahn (1995) : Hilbert

  35. Traditional Approacha la Hahn (1995) : Phase Angle

  36. Traditional Approacha la Hahn (1995) : Phase Angle Details

  37. Traditional Approacha la Hahn (1995) : Frequency

  38. Why the traditional approach does not work?

  39. Hilbert Transform a cos  + b : Data

  40. Hilbert Transform a cos  + b : Phase Diagram

  41. Hilbert Transform a cos  + b : Phase Angle Details

  42. Hilbert Transform a cos  + b : Frequency

  43. The Empirical Mode Decomposition Method and Hilbert Spectral AnalysisSifting

  44. Empirical Mode Decomposition: Methodology : Test Data

  45. Empirical Mode Decomposition: Methodology : data and m1

  46. Empirical Mode Decomposition: Methodology : data & h1

  47. Empirical Mode Decomposition: Methodology : h1 & m2

  48. Empirical Mode Decomposition: Methodology : h3 & m4

  49. Empirical Mode Decomposition: Methodology : h4 & m5

  50. Empirical Mode DecompositionSifting : to get one IMF component

More Related