Feature Request: Speech to text keyboard function like FUTO project

Feature Requests
1

Dear all,

I know i am doing a lot UX.
One of my biggest but maybe far far away since a lot of effort? Woule be to habe a TTS keyboard. Since i usually dont write anymore too much…

Maybe one could also reuse FUTO functionality (my opinion the best open source offline TTS available)

High effort high reward?

Chris

2

For speech to text you can use speech note from openrepos, there is also a keyboard plugin. For swipe there is okboard, but no idea if it already works with jolla phone

Edit: in order to use speech keyboard you have to install both, speech note and speech keyboard

1 Like
3

I was an avid user of Speech Note Keyboard under sfos 5.0.x - it worked great. Now under 5.2.x I can’t get it to work. I haven’t had time to make a proper bug report yet.

Edit: SpeechNote still works great, though

4

I’ve filed an issue on the dsnote github page now. Last time I filed something, it was me being a n00b, but they responded in a reasonable amount of time. :grinning_face:

3 Likes
5

I can see the keyboards after installing

But when i use it it has no option to “record”

Do you have the same error / sitution?

Speechnote solely works like a charm.

1 Like
6

Yes that works fine for me with X10 III with SFOS 5.1.0.11

1 Like
7

I don’t get the voice controls next to the clipboard, as it was under 5.0.x. I can’t figure out the disconnect

I put an issue up on the speech note github page.

1 Like
8

Is that just the regular OKboard version from Openrepos? If it works under 5.1.x then why not 5.2.x, I wonder. I shall have to give it another try.

EDIT: Just tried it again and when I enable it, NO keyboards come up at all when entering a text field. Weird.

9

there is “Speech Keyboard” in openrepos which isn’t that great, because of language support is all over the place and even english is way too hit and miss for my liking, Its backend issue and this project hasnt been updated in 3 years…so yeah. (also that you need choose the correct language model by configure using Speech Note app was so ..sigh…annoying)

this did remind me of GitHub - cjpais/Handy: A free, open source, and extensible speech-to-text application that works completely offline. · GitHub if someone (Jolla?) could use it as a backend

10

I have in the past recompiled it for myself and that works for 5.1 too. When I get 5.2 I could test that out and let you know how it works for me too.
I did read somewhere here that there is a built in Swype like functionality in 5.2?

11

Annoyingly, I’d already programmed a whisper-based tool for sfos before I found Speech Note. The Speech Note app/keyboard does an excellent job of leveraging the openly available speech-to-text/vice-versa resources that are out there in many, many languages. Yep, english-centric and yep, you will have to experiment with which model is the right balance of speed and accuracy for you.

1 Like
12

I have tried now several models.

What works for me Ok ish:

Set to quality before speed

Set to multi lingual model not a specific one.

13

Speech Keyboard workaround for Sailfish OS 5.2

DSKeyboard 1.6 installs its handler files one directory above where Sailfish 5.2 expects them.

This workaround creates six symbolic links without editing or replacing package files. In the terminal on your jolla.

devel-su
cd /usr/share/maliit/plugins/com/jolla/handlers

for f in SttInputHandler.qml SpeechService.qml SttPanel.qml SpeechIndicator.qml BusyIndicatorWithProgress.qml KeyBase.qml; do
if [ -e "../$f" ] && [ ! -e "$f" ] && [ ! -L "$f" ]; then
ln -s "../$f" "$f"
fi
done

# Press Ctrl-D once, then restart the keyboard:
systemctl --user restart maliit-server

Tested on Sailfish OS 5.2.0.13 with Speech Note 4.9.0 and DSKeyboard 1.6.0. It restores the missing speech controls and ✓ text insertion.

The command does not overwrite existing files or create links to missing files. A future DSKeyboard update may make the workaround unnecessary. I have fed back this info to the Speech Note team.

3 Likes
14

Small clarification on OKBoard: the installed OpenRepos version 0.6.38 contains no Sailfish 5.2 patch. On 5.2.0.13 it falls back to its 5.0.0.55 patch, which applies with fuzz and offsets, but enabling the resulting plugin makes all keyboards disappear. Maliit remains active, and disabling OKBoard restores the standard keyboard.

@lakeboy’s working 5.1 version maybe was personally recompiled, so it may not be directly comparable with the current OpenRepos package. A dedicated 5.2-compatible build/patch appears necessary.

1 Like
15

If you don’t use the pre-formatted text tags, the quotation marks gets converted to ones that cannot be copy&pasted to terminal. Well of course they can be copied, but the commands won’t work like expected.

devel-su
cd /usr/share/maliit/plugins/com/jolla/handlers

for f in SttInputHandler.qml SpeechService.qml SttPanel.qml SpeechIndicator.qml BusyIndicatorWithProgress.qml KeyBase.qml; do
if [ -e "../$f" ] && [ ! -e "$f" ] && [ ! -L "$f" ]; then
ln -s "../$f" "$f"
fi
done

# Press Ctrl-D once, then restart the keyboard:
systemctl --user restart maliit-server
1 Like
16

Thanks for that. I amended my post above.

17

This workaround was adopted by the SpeechNote project (until more phones get access to 5.2 - they dont have a J2), and shouldn’t be needed any more. :slight_smile:

3 Likes
18

I am porting FUTO Keyboard to Sailfish OS. I can say that it’s about 90% completed

2 Likes
19

Does the Speech Note keyboard work with text prediction? Because I have a speech note keyboard, which has the speaker button, but it’s a separate keyboard layout, without text prediction :thinking:.

20

Nope. One gets to swipe between keybords depending on if you want to speak, or to type with prediction.

The return of prediction is very recent, so anything can still happen, if there’s someone willing and able to take it on.