Microphone Text Input

Changelog

1. adjust: use io.github.jaffe2718:whisper-jni:1.0.1 as Whisper dependency, use musl libc as default for Linux + CPU, current version of the binary dynamic link library is not compatible with the old versions
2. fix: split the message into multiple parts not longer than 256 characters to avoid overflow due to the limited chat message length of Minecraft
3. fix: auto switch to default native library if the custom library load failed

Download Whisper Model

• Official Whisper GGML Model
• Unofficial Whisper GGML Model
• VAD Model

Dependencies

Compatibility

NOTE

The provided dynamic link libraries of Vulkan and CUDA in GitHub Releases are compiled on ubuntu-22.04 with GLIBC 2.35, and may not be compatible with all Linux distributions. There are some solutions that may work, if your game crashes and it is confirmed in the crash log that it is incompatible between GLIBC versions, you can try any of the following:

1. Use a different version of GLIBC (recommended)
   1. Check the environment variables for Vulkan or CUDA Toolkit 12.4
   2. Download glibc-2.35.tar.gz
   3. Compile & install at /path/to/your/glibc-2.35, DO NOT replace the system glibc and DO NOT set up any global environment variables for it
   4. Use some launcher that supports custom environment variables, such as Prism Launcher, set LD_LIBRARY_PATH to /path/to/your/glibc-2.35/lib64
2. Compile the dynamic link library yourself and edit the config file of the mod
   1. Clone the Jaffe2718/whisper-jni repository: git clone https://github.com/Jaffe2718/whisper-jni.git
   2. Switch to the tag v1.0.1: cd whisper-jni && git checkout v1.0.1
   3. Install Vulkan SDK and ShaderC for building Vulkan dynamic link library, or CUDA Toolkit 12.4 for building CUDA dynamic link library
   4. Build

Custom Dynamic Library

1. Download the custom dynamic library from Jaffe2718/whisper-jni and extract the files, DO NOT USE OTHER VERSIONS
2. Enable the advanced configuration and set the useCustomDynamicLib to true in the configuration menu.
3. Set the customDynamicLibDir to the directory where the custom dynamic library is located in the configuration menu.
4. If you want to use the dynamic library which is supported vulkan, check your check that your computer has drivers and libraries running Vulkan installed.

   vulkaninfo
   

5. If you want to use CUDA, check that your computer has drivers and libraries running CUDA installed.

   nvidia-smi
   

   For Linux, you need to install CUDA Toolkit >= 12.4.0 and configure the environment variables. For Windows, if the game crashes, you have to force the game to use the Java >= 25, see Jaffe2718/whisper-jni/v1.0.1