Voice Controlled App Example - iOS

This iOS example application demonstrates voice-controlled navigation using the Switchboard SDK. Users can easily navigate through a curated movie list and interact with various items through comprehensive voice commands, showcasing the capabilities of voice recognition technology in mobile applications.

Features

• Voice Commands: Users can give voice commands for navigation and actions. Common commands include:

  • Navigation: Say "down", "forward", "skip", or "next" for going to the next item, and "up", "last", "previous", or "back" for returning to the previous one.
  • Actions: Users can express preferences with commands like "like", "favourite", or "heart" to show appreciation, and "dislike" or "do not like" to express dissatisfaction. Additional commands such as "expand", "details", or "open" allow users to access more information.

• Voice Processing Pipeline: The app employs a structured audio processing pipeline that incorporates:

  Microphone → Voice Activity Detection → Speech Recognition → String Processing → UI Action
  

• SDK Components:

  • SBSwitchboardSDK: The core audio processing engine.
  • SBWhisperExtension: Responsible for the speech-to-text conversion.
  • SBSileroVADExtension: Handles voice activity detection.

Movie Navigation

Users can jump directly to specific movies by saying their titles, such as "Dune", "Jaws", or "Avatar".

Customization Options

Developers can enhance the app by adding new voice commands or modifying existing data and processing parameters:

• Adding New Voice Commands: Update the triggerKeywords in TriggerDetector.swift and adjust the TriggerType enum accordingly.
• Modifying Sample Data: Change movie titles by editing the movieData array in DataModels.swift.
• Audio Processing Tuning: Adjust the sensitivity of the voice activity detection in AudioGraph.json and change buffer sizes as necessary.

This project serves as an excellent reference for developers looking to integrate voice control features into their iOS applications, leveraging the power of the Switchboard SDK for seamless audio interactions.