Speech-to-text to programmatically click buttons within the iframe based on speech to text output?

  • lk23j4lk234j
    Asked on June 20, 2024 at 2:13 PM

    Is it possible to have the answers in the form be "clicked" automatically? In my case via speech to text?


  • Jefferson JotForm Support
    Replied on June 20, 2024 at 2:29 PM

    Hi lukasstoecklein,

    Thanks for reaching out to Jotform Support. Are you referring to a scenario when a user uses a speech-to-text feature and selects an answer in an element? If that's not what you are referring to, can you elaborate more so we can help you better? We do have a voice recorder widget that may help capture the text of those who can't type out their information, though this is purely a recording and does not have the ability for text conversion. We also have a guide about the Voice Recorder that you can check out.

    After we hear back from you, we’ll have a better idea of what’s going on and how to help.

  • ftgfh
    Replied on June 20, 2024 at 2:42 PM

    Yes that's right. I have a website which can do speech to text. Now I have embedded jotforms and I would like to programmatically click buttons within the iframe based on my speech to text output. The speech to text is not really relevant to my question, just explaining my context. Does that make sense?

  • Jeric JotForm Support
    Replied on June 20, 2024 at 2:46 PM

    Hi anewway,

    Unfortunately, speech-to-text is not currently an available feature with Jotform.

    While the feature you’re looking for isn’t currently available, rest assured we’re always working to add new services and features to Jotform. I've gone ahead and escalated your request to our Developers. When or if it's implemented depends on their workload, how viable it is, and how many other users request it. If there are any updates, we’ll circle back to this thread and let you know.

  • lk23j4lk234j
    Replied on June 21, 2024 at 4:33 AM

    Thanks for forwarding it to a developer.


    To clarify, the speech to text is already working and is not directly relevant to my question.

    Some questions:

    Is it possible to interact with the DOM inside the iframe programmatically / artificially clicking elements within the iframe?

    Are there CORS / iframe limitations?

    Has this been done before using Jotforms?


    Thank you

  • Sonnyfer JotForm Support
    Replied on June 21, 2024 at 4:39 AM

    Hi anewway,

    I understand the speech to text is already working on your website, but can you explain a bit more about programmatically clicking buttons within the iframe based on speech to text output? Did you mean to using a voice-command to go to the next fields on the form? As for your other question, I moved it to a separate thread to avoid confusion. You can check that out here.

    Once we hear back from you, we'll be able to help you more with this.

 
Your Answer