SikuliX

how to find gui elements (control id) by using python/ jython supported modules

Asked by Karthi

Hello Raimund,

I have tried importing so many python module(pyautogui,pywinauto,UIsoup,pyauto) for finding GUI elements. Nothing works for me. I know all are C - Python modules.

But I have developed my complete testing scripts in sikuli & now i would require python/ jython module for implementing GUI elements identification.

can you help me by suggesting some modules for finding GUI elements which can be used in sikuli.

when will the control id implementation be done in sikuli?

Question information

Language:
English Edit question
Status:
Answered
For:
SikuliX Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Revision history for this message
RaiMan (raimund-hocke) said : 		#1

Besides Selenium for WebGui's I have no idea.

Looks like Windows, and there you will always need access to the Windows API.

May be there is some JNI/JNA based Java library for that (like BridJ, that allows to access the WinAPI from Java)

Revision history for this message
Karthi (karthikeyanbece) said : 		#2

Thanks Raiman. I agree with this Java library based solution.

But I have developed and completed my 95% of DESKTOP Automation by using default Jython IDE in sikuli ( Image based control identification).

NOW, I'm in a need of using the GUI ELEMENT ID based control identification to complete my Automation and to compete with other tools also.

This will really helps me a lot to take the advantages of Sikuli over AutoIT.

So i 'm requesting you to suggest some solution of importing PYTHON/ JYTHON modules to continue my development in same IDE.

Will the version 2.0.0. has the possibility to provide such implementation?

Revision history for this message
RaiMan (raimund-hocke) said : 		#3

Sikuli/SikuliX is and will ever be Java based, so I am sorry: no easy solution. This will be true for version 2 also.

You either have to find a Java based library, which could be easily used from your Jython script or use AutoIt/Python in some subprocess or external process with some interprocesscommunication.

an example is an XML-RPC server in Python, that handles your GUI access on request from a client in your Jython script. Rather speedy and easy to implement on the same machine.

Can you help with this problem?

Provide an answer of your own, or ask Karthi for more information if necessary.

To post a message you must log in.