SikuliX

Сan Sikuli work on xml level?

Asked by Julia

Hi!
Is it possible that identify text field on the page browser,in which enter or select text? For example,on the id of the XML code or other parameters so, that be applied to this field "click" in Sikuli.
Or to use python in conjunction with XML?

In advance thanks!

Question information

Language:
English Edit question
Status:
Answered
For:
SikuliX Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
RaiMan (raimund-hocke) said : 		#1

not really clear what you mean :-(

... but let me try ...

--- XML
just google "jython xml" and you will find some entries that help you to find out what solution fits best for you

--- Is it possible that identify text field on the page browser
The most used technique used by Sikuli users is to capture a picture of the respective area on screen and click on it with a target offset to get the focus into the text field. Next actions depend on what you want to achieve (paste text or get the text, that is currently selected). There are many examples in this board, the docs and on the net.

Revision history for this message
Julia (rusalkaju) said : 		#2

Problem in that captured image of the field is not unique. On page it is a lot of such fields, they are same. Differ
only a title. However to recognize a text title and unambiguously to identify a field on a title it is impossible. If to do capture and to address to a field, there is many coincidence, and at reversal to field Sikuli sometimes confuses it to other same field. As a result the case scenario is fail. The Same field in xml has id and a row of other parameters. It would be healthy to address to a field on one of these parameters, for example, id. Something of type click (id = "medRecNumber"). So, of course, it is impossible, but if there is a method to operate with fields by means of this field parameters, it would allow to distinguish one field from another and at performance of the scenario of errors wouldn't happen.

Revision history for this message
RaiMan (raimund-hocke) said : 		#3

Ok, understood.

This is really a challenge with Sikuli, since the other option (searching for text instead of images) is not yet reliable and robust enough.

Is it possible, to create a list somehow with the field titles from top left to bottom right?
If possible, you can use findAll() for a list of matches, that sorted from top left to bottom right gives you a cross reference.

If this is not possible, I guess this case is more a thing for Selenium like test tools (injecting javascript to the web page).

If you go on with Sikuli, feel free to send to my mail (https://launchpad.net/~raimund-hocke) in a zip:
a screenshot and other stuff that gives me a deeper insight, so I can give you more tips.

Can you help with this problem?

Provide an answer of your own, or ask Julia for more information if necessary.

To post a message you must log in.