YomiNinja v0.6
Added 2024-01-29 19:01:35 +0000 UTCHello everyone! YomiNinja 0.6 is finally here!
Version 0.6 brings support for Yomitan, Yomichan, and JPDBReader extensions, along with Google Cloud Vision integration and various other enhancements.
Summary:
- OCR Improvements
- Enhanced Extensions Support
- Overlay Improvements
- Upcoming Features
OCR Improvements
Google Cloud Vision Integration
YomiNinja now integrates with Cloud Vision, a powerful image analysis service used by Google Lens. It significantly enhances OCR capabilities, improving accuracy and enabling the detection of the position for each character. Check out these examples of YomiNinja in action with Cloud Vision.
Rain Code - レインコード
Another Code Recollection - アナザーコード リコレクション
While not perfect, it significantly improves the overlay, providing a "cleaner" and more immersive experience. I'm impressed with these results and will be exploring further possibilities to bring this level of precision to offline engines as well.
To use Cloud Vision with YomiNinja, you'll need a Google Cloud account and provide a service account key. It offers 1000 free requests per month, and you can check the pricing details here. Setting up an account might seem a bit complicated, so I'm considering putting together a guide soon.
Note that when using Cloud Vision, your images are sent directly to the Cloud Vision API without intermediaries, alleviating privacy concerns. If you want to do a quick test, there's an option to use the demo API, allowing you to try it out without setting up an account.
More PaddleOCR Parameters
The PaddleOCR engine settings have been expanded. With the added parameters, you can make adjustments to improve accuracy. For example, sometimes "っ" is recognized as "つ" and by increasing the "Text area expansion factor" this can be less frequent.
Result with default parameters
Result with adjusted parameters
Expanded Extensions Support
Support for Yomitan and Yomichan is finally here! This is a game-changer, as these extensions offer a lot of features, especially custom dictionaries, Anki integration, and pronunciation audio.
JPDBReader is now supported, providing useful features like furigana, jpdb.io integration, and a popup dictionary. An interesting and very useful feature is its ability to help you visualize which words you already know.
Overlay Improvements
The rendering of the overlay was improved and can now more precisely position the extracted characters. Also, now it offers many more customization options, like font weight, letter spacing, font outline, color opacity, and more.
Sometimes the OCR results have simple errors that could be manually fixed, so I added an editing mode. It's a simple but effective feature that can help you in situations where basic OCR mistakes are affecting the dictionary look-up. To use it, just [Ctrl + Double-Click] on the text you wanna edit.
Additionally, while the Auto OCR feature is still in development, an option to automatically hide the OCR results when leaving the overlay was added.
Hotkey Changes:
- Added "Toggle overlay".
- Added dedicated hotkeys for each OCR engine.
- Improved and reintroduced the "Copy text" hotkey.
- Support for mouse buttons as hotkeys.
Upcoming Features
Following the tied poll results for the next OCR engine, I'll be integrating Manga OCR. This will be great for people who prefer offline OCR options. Also, I want to implement the Auto OCR feature and explore adding support for Mac OS. Other features could be included in the next release as well, so I will create a poll to better define the priority list.
A huge thank you for the amazing support and feedback! This wouldn't be possible without you!
Also, a special thanks to:
- Everyone involved in Yomitan, Yomichan, 10ten, and JPDBReader development for creating such helpful tools.
- GameGengo for featuring YomiNinja in his video.
- GameGrammar and Japanese Quest for welcoming YomiNinja into their communities.
Comments
I did tried to login using that link using my gmail account, but google says cannot logging using this APP. Its preventing google login via YomiNinja.
Earl
2024-06-04 13:23:56 +0000 UTCHi! To log into jpdb.io, click on the "JPDB settings page" link from the JPDBReader extension settings screen. The link is right above the "API token" field.
Matheus M.
2024-06-04 13:07:05 +0000 UTCIt will be great if we can login using JPDB in the APP, using google login. As to add word to JPDB we need to be login in JPDB site as well in app.
Earl
2024-06-01 05:50:47 +0000 UTCCan you pin the newer version I usually join then check the top of the page and almost downloaded the wrong one.
Will Sellers
2024-05-16 03:46:10 +0000 UTCHi! Yes, the next release will include a macOS version.
Matheus M.
2024-04-21 19:11:43 +0000 UTCHey there, is a MacOS Version in Progress? As I don't have a Windows System? :)
Kreideberg
2024-04-20 14:44:25 +0000 UTCHello, thank you for making this tool, it makes everything so much easier! best OCR software available
Darkame
2024-04-06 07:28:26 +0000 UTCHello, firstly I wanted to thanks you for this amazing app that greatly helped me, especially the last update that added a lot of great things like yomichan integration. There is just one thing, I think it would be cool to have a paddleOCR setting to always scan text either vertically or horizontally (if it's possible). I have some trouble while reading manga in chinese where bubbles with more than 2 vertical lines would mess up the ocr and be scanned horizontally instead. Though this problem will probably be fixed for japanese with mangaOCR integration.
kaine nier
2024-04-05 18:10:07 +0000 UTCI definitely need it for Yakuza
Yury Katkov
2024-03-03 16:38:37 +0000 UTCCool! Thanks for letting me know! Maybe I could figure a way to switch between the extensions
Eric Blomquist
2024-02-07 02:36:30 +0000 UTCHi! I appreciate your interest!! Currently, YomiNinja doesn't support Migaku, and I'm unsure if it will in the future. I'm exploring options like displaying the overlay from a browser, but transparent windows aren't supported by browsers at the moment. This could potentially enable Migaku to work with YomiNinja, but I can't provide a specific timeframe for this. Thank you!
Matheus M.
2024-02-07 02:35:28 +0000 UTCHi! I am thinking about joining - but I wanted to know if it works with Migaku's extension?
Eric Blomquist
2024-02-06 15:28:04 +0000 UTCYeah this is just due to the game pausing whenever the games are alt+tabbed/clicked off of. Nothing to do with OCR itself
Slepy
2024-02-04 20:51:51 +0000 UTCoh, I definitely noticed that there are freezes, good to know!
Yury Katkov
2024-02-04 20:48:42 +0000 UTCThis is a bit of a niche workaround for anyone interested. For games like Persona that lose focus and freezes whenever using an OCR, there's an application called Special K that will allow you to keep the game running in the background.
Slepy
2024-02-03 02:17:01 +0000 UTCHoly heck this is amazing. Another job well done!
Issa mcmillan
2024-02-02 02:03:53 +0000 UTCNice. Thanks for all your hard work. Really looking forward to macos and auto-ocr!
risho
2024-01-30 02:22:09 +0000 UTCWith mangaOCR it's going to be Full-house! I have very pleasant experience with MangaOCR as an engine that powers Mokuro https://github.com/kha-white/mokuro
Yury Katkov
2024-01-30 00:22:27 +0000 UTCOh, now I understood about the text area expansion factor! So now we have at least three ways to fix the problematic recognition: 1. increase this factor 2. switch the OCR engine 3. manually fix the mistake by clicking with Ctrl key. I think it makes the process faster! Before I would have to first copy the wrongly recognized text somewhere and fix it there.
Yury Katkov
2024-01-30 00:20:36 +0000 UTC
