You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

advviz-2-concepts.dox 12KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172
  1. /**
  2. \page Doc_Mensia_AdvViz_Concepts Concepts
  3. \section Doc_Mensia_AdvViz_Concepts_Intro Introduction
  4. The <b>Mensia Advanced Visualization Toolset</b> is a collection of boxes dedicated to
  5. the visualization of the result of electrophysiological signal analysis, and are especially suitable for the <b> real-time
  6. analysis of EEG signals </b>, from raw signal display to 3D source reconstruction.
  7. It addresses many different use-cases among users.
  8. Neurophysiologists can observe accurately in real-time <b> spatial and
  9. temporal patterns </b> in the brain activity (motor activity, cognitive processes). EEG signal
  10. processing specialists can <b>evaluate and compare</b> instantly algorithms effects (source
  11. separation, denoising techniques). BCI researchers can study how their ERP-based system may
  12. be tuned to elicit and detect the best brain response.
  13. \image html designer-box-list.png "Simple integration in the graphical user interface"
  14. \image latex designer-box-list.png "Simple integration in the graphical user interface" width=\textwidth
  15. \section Doc_Mensia_AdvViz_Concepts_VisualizationParadigms Visualization paradigms
  16. This Toolset has been designed to be very versatile. The main design concept revolves around
  17. the data presentation. You basically want to display matrices of numbers which may have temporal,
  18. and/or spatial meanings. The most adapted data presentation may vary from one case to another,
  19. according to the type of events or patterns on which you need to get a good contrast.
  20. Before choosing the right visualization box, ask yourself:
  21. - How do I want my data to be displayed ? curves ? levels ?
  22. - What will be the best way to <b> enhance the contrast </b> between the information I want to extract and the rest of the data ?
  23. - Is my data stream <b>continuous</b> in time ? or am I dealing with discontinuous epochs (e.g. ERPs) ?
  24. To be adapted in most situation, the Mensia Advanced Visualization Toolset has been designed to cover
  25. different visualization paradigms. Take a look at all the possibilities and choose what will best fit your needs.
  26. - \ref Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Oscilloscope
  27. - \ref Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Bars
  28. - \ref Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Bitmap
  29. - \ref Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Topo
  30. - \ref Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Reco
  31. You can also have a look at the \ref Doc_Mensia_AdvViz_UseCases "list of use-cases", showing how each box can be used on concrete, real-life examples.
  32. \subsection Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Oscilloscope The Oscilloscope view
  33. It is the most basic paradigm, used to display temporal numerical data in the form of <b> curves </b> (dots linked by lines).
  34. The Oscilloscope views are all expecting <b>centered</b> values (i.e. distributed around 0).
  35. Hence it is advised to use at least one temporal filter (e.g. band passing between 2 and 40 Hz using a \ref Doc_BoxAlgorithm_TemporalFilter box) before displaying an EEG signal.
  36. Four boxes use this paradigm:
  37. - <b> \ref Doc_BoxAlgorithm_ContinuousOscilloscope </b> box: displays continuous data from left to right on a defined horizontal scale (goes back to origin upon reaching the end of the scale),
  38. channels are displayed vertically one after another, but spikes may overlap.
  39. - <b> \ref Doc_BoxAlgorithm_InstantOscilloscope </b> box: displays each block of data received as it comes, filling all the horizontal space available.
  40. - <b> \ref Doc_BoxAlgorithm_ContinuousMultiOscilloscope </b> box: same as the Continuous Oscilloscope, but every input channels are displayed along the same horizontal axis with a different color, additively.
  41. - <b> \ref Doc_BoxAlgorithm_InstantMultiOscilloscope </b> box: same as the Instant Oscilloscope, but every input channels are displayed along the same horizontal axis with a different color, additively.
  42. <b>Example</b>: raw EEG signal display.
  43. \image html ContinuousOscilloscope_Display.png "Continuous Oscilloscope displaying 2 EEG channels"
  44. \image latex ContinuousOscilloscope_Display.png "Continuous Oscilloscope displaying 2 EEG channels" width=10cm
  45. \subsection Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Bars The Bar view
  46. Like histograms, this paradigm can be used to display and compare <b> series of levels </b> . Levels are displayed one after another from left to right, within a <b> color gradient </b> .
  47. Channels are displayed vertically, one after another with a fixed interval (thus some "high" levels may overlap).
  48. With a high definition (i.e. a rather high frequency display), the result can be viewed as a curve colored below the line.
  49. Two boxes uses this paradigm:
  50. - <b> \ref Doc_BoxAlgorithm_ContinuousBars </b> box: displays continuous data from left to right on a defined horizontal scale (goes back to origin upon reaching the end of the scale).
  51. - <b> \ref Doc_BoxAlgorithm_InstantBars </b> box: displays each block of data received as it comes, filling all the horizontal space.
  52. <b>Example</b>: spectrum display.
  53. \image html InstantBars_Display.png "Instant Bars displaying the signal spectrum"
  54. \image latex InstantBars_Display.png "Instant Bars displaying the signal spectrum" width=10cm
  55. \subsection Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Bitmap The Bitmap view
  56. The bitmap paradigm displays matrices of data using a color gradient. The result is a <b> 2D map where each cell is given a color "bit" </b> .
  57. This view using colors can enhance easily the constrast between 2 temporal or spatial patterns, as the difference
  58. between "cold" and "hot" colors is quickly caught by the analyst's eye.
  59. You can even add an additional dimension by using <b> stacked bitmaps </b> : every time a new bitmap is received, it is placed on top or left to the previous one.
  60. Four boxes uses this paradigm:
  61. - <b> \ref Doc_BoxAlgorithm_ContinuousBitmap </b> box: displays continuous data from left to right on a defined horizontal scale (goes back to origin upon reaching the end of the scale).
  62. - <b> \ref Doc_BoxAlgorithm_InstantBitmap </b> box: displays each block of data received as it comes, filling all the horizontal space.
  63. - <b> \ref Doc_BoxAlgorithm_StackedBitmapVertical </b> box: each bitmap is placed on <b> top </b> of the previous one.
  64. - <b> \ref Doc_BoxAlgorithm_StackedBitmapHorizontal </b> box: each bitmap is placed <b> left </b> to the previous one.
  65. <b>Example</b>: Time-frequency map.
  66. \image html StackedBitmapHorz_Display.png "Stacked Bitmap (Horizontal) displaying the result of a Time-Frequency analysis"
  67. \image latex StackedBitmapHorz_Display.png "Stacked Bitmap (Horizontal) displaying the result of a Time-Frequency analysis" width=10cm
  68. \subsection Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Topo The Topographic view
  69. This paradigm adds a strong spatial constraint on the input data: each channel must be <b> labelled
  70. with an electrode name </b> in a defined nomenclature, such as the standard 10-20 system.
  71. Please see \ref Doc_Mensia_AdvViz_Concepts_ChannelLocalization for further details.
  72. Here again the data itself is displayed using a color gradient, mapped to a 2D or 3D model using <b> spherical spline interpolation</b>.
  73. For more details about the spherical spline interpolation, please check <i>F. Perrin, J. Pernier, O. Bertrand, J.F. Echallier,
  74. Spherical splines for scalp potential and current density mapping, Electroencephalography and Clinical Neurophysiology, Volume 72, Issue 2, February 1989, Pages 184-187</i>.
  75. The 2D model is a planar projection of the scalp, covering the scalp roughly from the frontal area to the occipital area (i.e. from Fp1-Fp2 to O9-O10 sites).
  76. The projection result takes the shape of a disk with a crescent growth at the back for the occipital region.
  77. Three boxes uses this paradigm:
  78. - <b> \ref Doc_BoxAlgorithm_2DTopography </b> box: maps the input (which channels are labelled in the 10-20 system standard) to a planar projection of the scalp.
  79. - <b> \ref Doc_BoxAlgorithm_3DTopography </b> box: maps the input (which channels are labelled in the 10-20 system standard) to a projection on a 3D model of the scalp.
  80. - <b> \ref Doc_BoxAlgorithm_3DCubes </b> box: an alternative view where each channel is represented by a 3D cube, positionned in space as the electrode would be on the 3D model.
  81. The activity is rendered by changing the size and color of the cubes.
  82. <b>Example</b>: Displaying the power of a specific frequency band on a 3D head model.
  83. \image html 3DTopography_Display.png "Alpha power mapped on a head model using the 3D topography"
  84. \image latex 3DTopography_Display.png "Alpha power mapped on a head model using the 3D topography" width=10cm
  85. \subsection Doc_Mensia_AdvViz_Concepts_VisualizationParadigms_Reco The Reconstruction view
  86. Tomographic reconstruction algorithms offer an inside look, into the brain, from only surface measurements.
  87. Several techniques exist, including the algorithms of the popular LORETA family which slice the brain in a stack of little cubes called voxels,
  88. and computes the <em>inverse model</em>, a model reconstructing the sources of the potentials acquired at the measurement site.
  89. One box implements the source reconstruction view:
  90. - <b> \ref Doc_BoxAlgorithm_3DSourceVisualization </b> box : displays a 3D source reconstruction using 2394 colored/translucent voxels in a 3D head model.
  91. This box expects 2394 input channels, produced by an inverse model (i.e. a spatial filter with N sensor inputs for 2394 sources outputs). This model must be
  92. tailor-made for the precise EEG setup being used (e.g. using sLORETA).
  93. \image html 3DTomographicVisualization_Display.png "3D tomographic reconstruction using the 3D Tomographic Visualization box"
  94. \image latex 3DTomographicVisualization_Display.png "3D tomographic reconstruction using the 3D Tomographic Visualization box" width=10cm
  95. \section Doc_Mensia_AdvViz_Concepts_ChannelLocalization Channel localization
  96. Every visualization box can use the spatial information conveyed by the electrode naming. The channels can be positionned relatively to each
  97. other as long as you provide in the box settings a file containing the cartesian coordinates of the electrodes.
  98. Most of the time, EEG manufacturers use the 10-20 system as an electrode naming standard. For convenience, we provide within the Toolset a file compiling all the
  99. coordinates of the electrodes in the 10-20 system.
  100. The cartesian coordinates of all the electrodes are computed in the 3D space, where the origin is at the center of [Fpz,Oz] and [T7,T8].
  101. - the X axis goes from the occipital lobe to the frontal lobe
  102. - the Y axis goes from the right temporal lobe to the left temporal lobe
  103. - the Z axis goes from the center of the head to the top
  104. And as for the unit, here are some key points at the maximum of the axis:
  105. - Fpz (1,0,0)
  106. - Oz (-1,0,0)
  107. - T7 (0,1,0)
  108. - T8 (0,-1,0)
  109. - Cz (0,0,1)
  110. The following figures illustrates the cartesian coordinates of the extended 10-20 system used in the Mensia Advanced Visualization Toolset.
  111. \image html CartesianCoordinates1.png "Cartesian coordinates of the 10-20 system, side view."
  112. \image latex CartesianCoordinates1.png "Cartesian coordinates of the 10-20 system, side view." width=8cm
  113. \image html CartesianCoordinates2.png "Cartesian coordinates of the 10-20 system, front view."
  114. \image latex CartesianCoordinates2.png "Cartesian coordinates of the 10-20 system, front view." width=8cm
  115. For more information, please see <i>Oostenveld, R. & Praamstra, P. (2001). The five percent electrode system
  116. for high-resolution EEG and ERP measurements. Clinical Neurophysiology, 112:713-719</i>
  117. Please note that using the 10-20 system is not mandatory. To use all the Toolset features related to the spatial disposition of the electrodes, you
  118. just need to provide a file that maps electrode name with their coordinates in the space described above.
  119. The format of this file is simple text. You must provide:
  120. - the electrode names as a list of quoted labels
  121. - the coordinate system labels
  122. - the electrode coordinates of the electrodes, in the same order as in the electrode names
  123. For example:
  124. \code
  125. [
  126. ["O1" "O2" ... ]
  127. ["x" "y" "z" ]
  128. ]
  129. [
  130. [-0.309017 -0.951057 4.48966e-011 ]
  131. ]
  132. [
  133. [0.309017 -0.951057 4.48966e-011 ]
  134. ]
  135. ...
  136. \endcode
  137. For a complete example, please look at the file provided with the Toolset (<i>../share/mensia /openvibe-plugins/cartesian.txt</i>)
  138. */