Read the word from the flex web page and click on that

Asked by Divesh Pathak

Hi

I am able to read the content from the flex web page. But if I need to search from huge number of words then it's get failed. Can you please tell me when the next version of Sikuli will come. which is perfectly able to read the content from the flex web page.

Thanks and Regards
Divesh Pathak

Hi

I want to read the content from a flex web page and click on that using Sikuli.
I am using java as a language,
 my code will be like this

Screen s = new Screen();
s.click("click me");

for some of the word it's working fine but most of the time it's not working.
Please help me I am new in Sikuli as well as in java.

Thanks and Regards
 Divesh Pathak

Question information

Language:
English Edit question
Status:
Answered
For:
SikuliX Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
obiwan-92 (obiwan-92) said :
#1

Hi.

The function "s.click("click me");" use OCR Tesseract who have a lot of problem in sikuli. (It's why it is disable by default)

You have two possibilities :
1. Use an image of your text, so the line will be s.click("click_me.png");
2. Try to not work with the all screen but on a smaller region (a line will be probably the best)

Regards

Revision history for this message
Divesh Pathak (diveshy) said :
#2

Thanks for your Reply.
But how to work with line.

Thanks and Regards
Divesh Pathak

On Wed, Jul 31, 2013 at 1:26 PM, obiwan-92 <
<email address hidden>> wrote:

> Your question #232999 on Sikuli changed:
> https://answers.launchpad.net/sikuli/+question/232999
>
> Status: Open => Answered
>
> obiwan-92 proposed the following answer:
> Hi.
>
> The function "s.click("click me");" use OCR Tesseract who have a lot of
> problem in sikuli. (It's why it is disable by default)
>
> You have two possibilities :
> 1. Use an image of your text, so the line will be s.click("click_me.png");
> 2. Try to not work with the all screen but on a smaller region (a line
> will be probably the best)
>
> Regards
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https://answers.launchpad.net/sikuli/+question/232999/+confirm?answer_id=0
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/sikuli/+question/232999
>
> You received this question notification because you asked the question.
>

Revision history for this message
obiwan-92 (obiwan-92) said :
#3

Hi.

Sorry for my late answer, but I'm in holiday.

We must find a common image to each line of your text (such as a puce or a dash)
or you can use a image of a complete line with a low score of similarity.

The code must be like this :
for line in findAll(Pattern("ref_point.png").similarity(0.60)):
    r = region(line.getX(), line.getY(), w, h) # replace w and h by a value to select
                                                                            # the region who include the complete line
    t = r.text()
    print "t:", t

See if it's working.
Regards.

Revision history for this message
Divesh Pathak (diveshy) said :
#4

Hi obiwan,

I am felling glad after looking on your reply.
Some how I managed to solve my Issue of reading the text,
*every time it's not reading properly, But in my scenario, I had given *
*alpha numeric text and inside a loop so that if it is missing in one sort
*
*it will read that in next sort.*
*
*
*Thanks for developing Sikuli. I want to know when the next version will
come.*
*I am using Sikuli with Java, and May be I will disturb you some more times.
*
*
*
*
*
*Thanks and Regards*
*Divesh Pathak (M-tech)*
*Motorola Mobility India Ltd.*
*
*
*
*

On Mon, Aug 5, 2013 at 3:41 PM, obiwan-92 <
<email address hidden>> wrote:

> Your question #232999 on Sikuli changed:
> https://answers.launchpad.net/sikuli/+question/232999
>
> Status: Open => Answered
>
> obiwan-92 proposed the following answer:
> Hi.
>
> Sorry for my late answer, but I'm in holiday.
>
> We must find a common image to each line of your text (such as a puce or a
> dash)
> or you can use a image of a complete line with a low score of similarity.
>
> The code must be like this :
> for line in findAll(Pattern("ref_point.png").similarity(0.60)):
> r = region(line.getX(), line.getY(), w, h) # replace w and h by a
> value to select
>
> # the region who include the complete line
> t = r.text()
> print "t:", t
>
> See if it's working.
> Regards.
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https://answers.launchpad.net/sikuli/+question/232999/+confirm?answer_id=2
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/sikuli/+question/232999
>
> You received this question notification because you asked the question.
>

Revision history for this message
RaiMan (raimund-hocke) said :
#5

The next version, that might have some improvements in the text read area will be 1.1 towards the end of this year.

Revision history for this message
Divesh Pathak (diveshy) said :
#6

Hi RaiMan,

I am waiting for the next version of sikuli, which has better OCR feature,
So that I can read the text from the flex web page. I checked the website
and found that, it is still in development. Can you please tell me when it
will be ready and this has better text reading feature or not. it will be
able to read the text from image file or not, like MPEG, PNG etc

If there is any small part of project where I can contribute, please feel
free to assign me. I will love to work on Sikuli.

Thanks and Regards
Divesh Pathak

On Tue, Aug 6, 2013 at 12:46 PM, RaiMan <
<email address hidden>> wrote:

> Your question #232999 on Sikuli changed:
> https://answers.launchpad.net/sikuli/+question/232999
>
> Status: Open => Answered
>
> RaiMan proposed the following answer:
> The next version, that might have some improvements in the text read
> area will be 1.1 towards the end of this year.
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https://answers.launchpad.net/sikuli/+question/232999/+confirm?answer_id=4
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/sikuli/+question/232999
>
> You received this question notification because you asked the question.
>

Revision history for this message
RaiMan (raimund-hocke) said :
#7

@ Divesh
Sorry to disappoint you.
The improvement of the text feature is postponed to version 1.2.
First betas might be available beginning next year.

But meanwhile you might use Tesseract directly to read text from image files.
https://code.google.com/p/tesseract-ocr/
But as far as I know: only images are supported. So if you want to read from an mpeg stream, you first have to isolate single images.

Revision history for this message
Divesh Pathak (diveshy) said :
#8

Hi RaiMan,

Thanks you very much, for your quick response.

Divesh Pathak

On Tue, Nov 18, 2014 at 1:26 PM, RaiMan <
<email address hidden>> wrote:

> Your question #232999 on Sikuli changed:
> https://answers.launchpad.net/sikuli/+question/232999
>
> Status: Open => Answered
>
> RaiMan proposed the following answer:
> @ Divesh
> Sorry to disappoint you.
> The improvement of the text feature is postponed to version 1.2.
> First betas might be available beginning next year.
>
> But meanwhile you might use Tesseract directly to read text from image
> files.
> https://code.google.com/p/tesseract-ocr/
> But as far as I know: only images are supported. So if you want to read
> from an mpeg stream, you first have to isolate single images.
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https://answers.launchpad.net/sikuli/+question/232999/+confirm?answer_id=6
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/sikuli/+question/232999
>
> You received this question notification because you asked the question.
>

Revision history for this message
RaiMan (raimund-hocke) said :
#9

just to keep the question answered

Can you help with this problem?

Provide an answer of your own, or ask Divesh Pathak for more information if necessary.

To post a message you must log in.