Re: [orca-list] OCR Current Window



Hello,
I'll explain how NVDA and its OCR addon are working on windows. I am afraid this is not entirelly translatable to orca but at least you will get the idea.

NVDA has a mode called object review. That's a concept similar to flat review orca features in order to be able to review text on the screen.
So when you found an inaccessible window with NVDA it most likelly only includes its window name as a part of the text you can browse using the object review commands. You can then run OCR on that object and once tesseract returns recognized texts along with character's regions NVDA OCR addon indexes this and presents it as a window text. While previewing by characters and words using the object review commands you are able to route the mouse to the corresponding spot depending on the character region from the tesseract output.

I haven't yet looked into whether we can retrieve window location, its coordinates when scripting orca however I expect this to be possible. I however don't know whether we can override flat review presentation along with retrieving character screen coordinates for an accessible object as represented by orca. Within NVDA the API is awesome and there are only a few methods to override.

Greetings

Peter


On 28.01.2015 at 10:43 chrys87 web de wrote:
 
i investigate a little time. It seems that the NVDA Guys use tesseract too.
 I also noticed that tesseract provide a way to get the coordinates of each OCR'ed character. so it should not hard to implement the movements of the mouse to objects etc.
how do you navigate in the nvda addon? does a window appear with OCR'ed wordlist like in the "list of ..." feature in the epiphany/firefox?
 
Gesendet: Mittwoch, 28. Januar 2015 um 01:32 Uhr
Von: "Josh k" <joshknnd1982 gmail com>
An: chrys87 <chrys87 web de>, "orca-list gnome org >> orca-list" <orca-list gnome org>
Betreff: Re: [orca-list] OCR Current Window
with the nvda OCR addon you can
1. OCR the current control weather its the whole screen or just a window
or button.
2. select and copy any OCR results to the clipboard.
3. route the mouse to controls that have been OCR'ed and do stuff with
them like left and right click double click and more.

follow me on twitter @joshknnd1982 or facebook email joshknnd1982 gmail com will find facebook site

On 1/27/2015 7:24 PM, chrys87 wrote:
> Thanks, its just a prototype for now :).
> i dont know if i can get the position of the text in the window with
> tesseract (so we can set the mouse to this position for example). Ill
> take a look in this.
> if you find this usefull, just let me know how to improve that.ill
> give a try.
> can you use the controlls with NVDA or jfw? what can you do already
> with this addons? sorry i never used it bevore.
> i m also not realy sure how to provide the information to the user
> (maybe in a box like orcas "list of..." featrue in the browsers? so i
> speak the content for now and set it to the clipboard.
>
> by the way... tesseract is an amazing software. it also does an layout
> "scan" by itself. this is realy solid since the last two versions.
>
> i m really impressed.
>
> Am 27.01.2015 um 23:41 schrieb B. Henry:
>> This is a very important function for some situations. I used NVDA's
>> ocr add-on some when it first came out. What would be great is if one
>> could use
>> controls that one can see with the ocr. I have not tested this, so if
>> this is already possible, congrats!
>> I'd forgotten about this, but I'd thought this would be a very good
>> and inportant addition ever since testing NVDA, and hearing of a
>> similar function in
>> jfw as well.
>> Thanks for sharing.
>>
>>
>>
>
> _______________________________________________
> orca-list mailing list
> orca-list gnome org
> https://mail.gnome.org/mailman/listinfo/orca-list
> Visit http://live.gnome.org/Orca for more information on Orca.
> The manual is at
> http://library.gnome.org/users/gnome-access-guide/nightly/ats-2.html
> The FAQ is at http://live.gnome.org/Orca/FrequentlyAskedQuestions
> Log bugs and feature requests at http://bugzilla.gnome.org
> Find out how to help at http://live.gnome.org/Orca/HowCanIHelp
 


_______________________________________________
orca-list mailing list
orca-list gnome org
https://mail.gnome.org/mailman/listinfo/orca-list
Visit http://live.gnome.org/Orca for more information on Orca.
The manual is at http://library.gnome.org/users/gnome-access-guide/nightly/ats-2.html
The FAQ is at http://live.gnome.org/Orca/FrequentlyAskedQuestions
Log bugs and feature requests at http://bugzilla.gnome.org
Find out how to help at http://live.gnome.org/Orca/HowCanIHelp



[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]