An Introduction to Silent Speech Interfaces.
Material type:
- text
- computer
- online resource
- 9783319401744
- 006.454
- TK5102.9
Intro -- Preface -- Contents -- Chapter 1: Introduction -- 1.1 Silent Speech -- 1.2 A Speech Production Primer for SSI -- 1.3 Current SSI Modalities: An Overview -- 1.4 Best Systems -- 1.5 Main Challenges in SSI -- 1.6 Following Chapters -- References -- Chapter 2: SSI Modalities I: Behind the Scenes-From the Brain to the Muscles -- 2.1 Brain Activity and Silent Speech Interfaces -- 2.1.1 Mapping Speech-Related Brain Activity -- 2.1.2 Measuring Brain Activity -- 2.1.3 Electroencephalographic Sensors -- 2.1.4 Electrocorticographic Electrodes -- 2.2 Muscular Activity and Silent Speech Interfaces -- 2.2.1 Muscles in Speech Production -- 2.2.2 Measuring Electrical Muscular Activity -- 2.2.3 Surface Electromyography -- 2.3 Conclusions -- References -- Chapter 3: SSI Modalities II: Articulation and Its Consequences -- 3.1 Measuring Non-visible Articulators and Changes in the Vocal Tract -- 3.1.1 Electromagnetic and Permanent Magnetic Articulography -- 3.1.2 Vocal Tract Imaging -- 3.1.3 Ultrasound and Speech Articulation -- 3.1.4 Ultrasound and Silent Speech Interfaces -- 3.2 Measuring Visible Articulators and Visible Effects of Articulation -- 3.2.1 Visual Speech Recognition Using RGB Information -- 3.2.2 RGB-Based Features -- 3.2.3 Local Feature Descriptors -- 3.2.4 Ultrasonic Doppler Sensing -- 3.2.5 Ultrasonic Doppler Uses in Silent Speech Interfaces -- 3.3 Measuring Other Effects -- 3.3.1 Non-audible Murmur Microphones -- 3.3.2 Other Electromagnetic and Vibration Sensors -- 3.4 Conclusions -- References -- Chapter 4: Combining Modalities: Multimodal SSI -- 4.1 Silent Speech Interfaces Using Multiple Modalities -- 4.2 Challenges: Which Modalities and How to Combine Them -- 4.3 A Framework for Multimodal SSI -- 4.3.1 Data Collection Method and General Setup for Acquisition -- 4.3.1.1 Setup A: Base Data Collection.
4.3.1.2 Setup B: Data Collection Including "Ground Truth" Modalities -- 4.3.1.3 Scaling the Setup to Additional Modalities -- 4.3.2 Synchronization -- 4.3.2.1 Offline Synchronization -- 4.3.3 Data Processing, Feature Extraction, and Feature Selection -- 4.3.3.1 Processing Ultrasound Data for Ground Truth Definition -- 4.3.3.2 Feature Extraction -- 4.3.3.3 Feature Selection -- 4.4 Conclusions -- References -- Chapter 5: Application Examples -- 5.1 Basic Tutorial: How to Build a Simple Video-Based SSI Recognizer -- 5.1.1 Requirements and Setup -- 5.1.2 Overall Presentation of the Pipeline -- 5.1.3 Step 1: Database Processing -- 5.1.4 Step 2: Feature Extraction -- 5.1.5 Step 3: Train the SSI Recognizer -- 5.1.6 Step 4: Test the SSI Recognizer -- 5.1.7 Experimenting with Other Modalities -- 5.1.8 EMG-Based Recognizer -- 5.1.9 Other Experimentations -- 5.2 A More Elaborate Example: Assessing the Applicability of SEMG to Tongue Gesture Detection -- 5.2.1 Corpora -- 5.2.2 Data Processing -- 5.3 Results -- 5.4 An SSI System for a Real-World Scenario -- 5.4.1 Overall System Architecture -- 5.4.2 A Possible Implementation -- 5.5 Conclusions -- References -- Chapter 6: Conclusions -- 6.1 Current Trends -- 6.2 Concluding Remarks -- References -- Index.
Description based on publisher supplied metadata and other sources.
Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2024. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries.
There are no comments on this title.