LipSurf - Voice Control for the Web

Browse the web with your voice -- eating, multitasking or just to give your hands a break. Speech recognition for executing commands in the browser that would normally require a mouse and keyboard. An excerpt of the basic commands: * Scroll up, down, little down, little up, autoscroll, bottom, top... * Play, pause, mute videos... * Dictate text input (Premium), open arbitrary urls (Premium) * Push-to-talk key, wake-word (say "hey LipSurf" to turn it on) (Premium) * Click anything on the page by saying "tag" then saying the annotation in the yellow box next to it. * Next tab, previous tab, select tab, new tab... * Zoom in, zoom out * ... many more! More features: * (NEW) Dictation mode for long-form text, auto scroll mode * (NEW) Add custom corrections, shortcuts, homophones or synonyms by clicking the transcript! x * 75+ default commands that can be expanded to infinity with additional plugins and tons of options * Multi-language support (Russian and Japanese in beta, other languages may be added by users) * 18 powerful default plugins: * Reddit * Google * Tabs and Windows * Text Input * Scrolling * Navigation * Gmail (BETA) * LipSurf * Timer * Weather * Dictionary * Wikipedia * Japanese<->English Dictionary * Hacker News * Anti-procrastination * Top Sites * Anki * WaniKani (Japanese Kanji Learning Tool) Please go through the tutorial to make sure you configure everything properly, and just say "help" to see the commands that are possible for the current page you're on! Enjoy! See more update info. along with video demos here: https://www.lipsurf.com/updates Recent Updates: 2019-7-13 New way to click links (by saying "click [link name]" Improved dictation mode (PREM) Improved wake word 2019-5-25 Allow for multi-line custom shortcuts (try clicking the live text to add a custom shortcut) More accurate auto scrolling to posts in Reddit (Premium) Fixed dictate and dictation mode homophone issue. 2019-5-15 (Premium) Added undo (BETA) and redo (BETA) support to dictation mode. (Premium) Improved dictation mode and dictate. 2019-5-11 Fixed issue with live text and needs upgrade dialogue where they wouldn't show when LipSurf was restarted on the same page. 2019-5-6 Tutorial usability improvements. More Japanese homophones. Options show disabled plugins as faded in the sidebar. Better highlighting of valid commands in the live transcript. 2019-5-4 Fixed issue with being occasionally signed out when installed on multiple computers. Improved linking to options. 2019-4-30 More Japanese homophones. Keep context help closed if user closes it manually. Fixed issue where sometimes two context windows would show. Fixed issue with live text sometimes not appearing. Improved tutorial scrolling. Reduced size of the application. 2019-4-25 Fixed issue where tutorial was opening for old users. Overhauled tutorial. 2019-4-5 Performance improvements. Better tagging. Better dictation mode (Premium) Bug fixes when no tabs with urls are open. WaniKani contexts! 2019-3-21 Fixed issues with custom homophones dialog on Gmail. Improved custom homophones autocomplete. 2019-3-19 New pricing plan Fixed Gmail scrolling 2019-3-13 Now you can customize per-plugin settings! Change the default new tab page in the Tabs & Windows plugin! Added speed up and slow down as alternatives for auto-scrolling faster and slower, respectively. Fixed issue with push-to-talk key not turning off on key release. Fixed issue with dictation mode being hard to exit when on free version. Added more homophones. 2019-3-8 PRO Dictation mode improvements. 2019-3-7 PRO Dictation mode for long-form dictation. Introducing contexts! Certain commands are now only possible in a given context (eg. faster/slower commands are only valid if you're in the autoscroll context). Contexts are entered via commands: say autoscroll to enter the autoscroll context, dictation mode to enter the long form dictation context. Commands might be ignored in your context... In the dictation context all the normal commands are ignored and tab, space, new paragraph, new line, and exit dictation are added. In the autoscroll context nothing is ignored, only the faster/slower commands are added. To exit the autoscroll context, say stop or scroll manually. To exit the dictation context say exit dictation. NOTE: switching tabs will also exit a context. Better options page with sidebar for easier navigation. Split up Browser plugin into: Scrolling, TabsAndWindows, Media, Navigation, DictationPRO and LipSurf. Added weather in * as an alternative match pattern for the weather lookup command. Fixed tag and scrolling issues on DuckDuckGo.com. 2019-2-24 PRO Made wake-word even less sensitive. 2019-2-23 PRO Made wake-word less sensitive. 2019-2-22 Fixed issue with uh-oh page sometimes being opened after initial upgrade from v1.9.2 2019-2-20 PRO Added wake-word! (It's "grasshopper" for now). Added push-to-talk key! Configurable sound effects for LipSurf activation/deactivation in options. PRO Added many homophones for WaniKani. Stability enhancements. 2019-1-15 Fixed issue with Japanese word splitter. Fixed issues with live-text getting in the way of the page at times. Made it more clear that page that automatically opens after install is the LipSurf tutorial. 2019-1-12 Updates to make all WaniKani number items properly recognized. Fixed issues with homophones being expanded to infinity. Don't allow blank custom homophone transcript sources. 2019-1-10 Fixed issues with language switching for ja/en. New zoom in, zoom out and reset zoom commands! Fixed some issues with recognizing certain vocab/kanji with numbers in them. 2019-1-8 Fixed issues with loading local plugins. Thanks Pat! Infrastructural improvements 2019-1-6 Better microphone permission handling and troubleshooting in the tutorial and options. Fixed issue with fonts on Windows and macOS. More ?? Russian translations and some fixes general language handling (including ?? Japanese). Thank you @ulalasava! Fixed issues on smaller resolutions (eg. help being cut off). Fixed issue with custom shortcuts/homophones and synonyms metrics gathering. Warning in the tutorial for Chromium users about incompatiblity. (Install Google Chrome instead). 2018-12-30 Custom homophones/synonyms/shortcuts can now be added by clicking the live text! Quickly add a shortcut to do a Google ... query, or activate any other command of your choosing. Map simple words to things that are hard to dictate ...PRO (eg. email addresses, unpronounceable usernames, random sequences of characters, etc.) Correct any misheard transcriptions. Map commands to vocabulary that you have an easier time saying or remembering. New "feeling lucky" command let's you automatically go to the first result of a search query. Try feeling lucky Django documentation. Improved the tag command. 2018-12-20 Fixed bug where saying tag would cause high CPU usage. 2018-12-17 Completely rehauled the Japanese kanji➡kana conversion (new dictionary download is necessary). Big improvements to the WaniKaniPRO plugin Loading icon, and language displayed in the icon. Improved language switching speed. Improved subscription modification button 2018-12-11 Fixed issue that prevented sign-out and may have caused other authentication issues. 2018-12-5 Smarter deprecation logic depends on the user's previous version. 2018-12-5 Continuous deployment integration improvements. 2018-12-5 Fixed issue where Pro users would get repeat upgrade messages. Chained homophones in WaniKani PRO fix. Temporary WaniKani PRO fixes for certain characters. 2018-12-3 Hotfix to bug for brand new users in 1.6.4 2018-12-2 Testing new release automation. Important updates show as notifications. Better error handling. 2018-12-2 Better error handling. 2018-12-1 Fixed Japanese number to digit conversion. 2018-11-30 Hotfix: LipSurf wouldn't turn on with certain settings configurations. 2018-11-29 Added lessons capability for WaniKani PRO WaniKani PRO now shows fully correct answer in transcript even when transcript only fuzzy matched answer. Updates now hosted online instead of in-app. 2018-11-18 New dictionary command (try saying dictionary "exculpate"). New English ⬌ Japanese dictionary commands. Try saying Japanese lookup "jet lag" to lookup an English ➡ Japanese word. Switch to Japanese by saying Japanese then try saying じしょたこやき to lookup "takoyaki" a Japanese ➡ English word. New Wikipedia command (try saying wikipedia "John Perry"). Fixed bug with top part of page being un-clickable. Tip of the Update Remember you can say Japanese or えいご to switch between Japanese and back to English, respectively. 2018-11-16 Internal improvements to Pro version. Added privacy policy. 2018-11-7 Better bug/error tracking 2018-11-2 Commands in the middle of a transcript are now recognized (see video on the left)! Faster command recognition. New scroll right and scroll left commands. Smarter scroll commands look at viewport height. Thank you @aparajita! Live text stays on top of new tabs and pages. Tip of the Update Remember you can say options or right click the extension icon and click "options" to see and configure all the possible commands. 2018-10-16 New ANKI plugin! Sign-in and registration included in tutorial. Faster play video command. Go to r [subreddit name] is no longer global. Tutorial command. 2018-10-08 v1.0 and LipSurf Pro are finally here! New Commands PRO Dictate Text Quick text dictation by focusing on an input and saying dictate [text you want to input]. Great for search boxes, short comments, or messages! You can redo the dictation just by repeating the command. PRO Go to URL Go to any URL by saying go to [url]. You can also spell the URL if it's a really hard one. Even the rarer sites are now at your finger ti— err... the tip of your tongue! LipSurf now never starts as activated when Google Chrome opens (even if it was activated when the browser was shutdown last). Old annotate and unannotate command words added as alternatives to tag and untag respectively. 2018-09-26 Fixed error collection. 2018-09-26 Fixed issues with tutorial. 2018-09-26 New "Anti-Procrastination Plugin"! Try open Reddit for 10 seconds (you can say "open [any website] for [any duration]") Google calendar commands! Try add event to Google calendar or just Google calendar. Changed default shut off time from 20m to 5m. Fixed issue that would occur when many tabs were open (LipSurf wouldn't load). 2018-09-19 Infrastructure improvements. Added BETA Russian support! Added new window command. Added Hacker News plugin. Improved tutorial. Tip of the Update Now you can say tag and untag instead of annotate/unannotate, respectively. 2018-09-12 Improved annotations. Improved Reddit commands. Performance improvements. New Top Sites plugin. Try saying youtube! Improved Japanese recognition. New WaniKani plugin commands (more info, last 10) and added more homophones. Tip of the Update We now have a forum where you can make feature requests and ask questions: https://discuss.lipsurf.com 2018-09-06 Added "dev mode" and button to load local plugins. Make your own plugins. Improved core design. 2018-09-02 Hide updates for 0.7-0.7.1 to not annoy users with too many updates. 2018-09-02 Added more English dialects. Actually fixed issue with overlapping commands in WaniKani specifically. Language picker in first page of tutorial. 2018-08-31 Fixed issue with overlapping commands -- delaying commands that are partial matches of other commands. Fixed issue with command priority. Tip of the Update Try using a headset for improved transcript accuracy. Apple headphones work quite well! If you see 3 rings on your headphone jack (like in the picture), that means there's a microphone. 2018-08-13 Fixed issue where live text would show but commands would not be executed. Fixed issue where LipSurf would break after any network issue -- sometimes caused by saying many things while LipSurf is activated. Fixed issue with setting auto. off timer to 0 not working. Added English homophones: kay ➡ k, okay ➡ ok, are ➡ r, you ➡ u Fixed issue where toggling LipSurf on WaniKani would sometimes cause the wrong language to be selected. Fixed issue where LipSurf would stay on if it was shutdown while on a Japanese reading for WaniKani. Fixed issue with recognizing WaniKani vocab/kanji with numbers. Added many default homophones for WaniKani. esp. for Romaji ➡ Japanese. Fixed issue with apostrophes, hyphens in WaniKani answers. Tip of the Update Don't say "annotations off" say "turn off annotations" or "hide annotations" -- that way LipSurf doesn't jump the gun and think you're saying just "annotate". 2018-08-05 You can now spell out hard-for-the-recognizer words in WaniKani. If already in English mode (answering meanings) then just start spelling it out. If in Japanese mode, first say "えいご" then spell the reading as you would type it (eg. for しょうがつ say "s-h-o-u-g-a-t-s-u") Added commands to switch between Japanese and English. Fixed bugs with general Japanese and WaniKani. Tip of the Update You can spell out words if LipSurf is having trouble recognizing you. Try spelling out "g-o-o-g-l-e-l-i-p-s-u-r-f".