Sikuli Script integration with Java in Eclipse

It is simply as with every other Java package, whose API you want to use in Java code developed in Eclipse:

make sure, that sikuli-script.jar is in the class path.

The only additional aspect (supposing Windows):

path-to-Sikuli\libs and path-to-java\jre6\bin must be in the system path, when debugging/running the Java program (this is normally done by installing Sikuli with the installer package)

The docs have additional hints.

im new in java and sikuli so pls help me step by steps

i follow all the step that mention in the doc but program is not working i use sikuli 0.9.
can anyone help me???

Uuups, 0.9 is not supported any more.

You should upgrade to X-1.0rc3: better performance, more features.

Always uninstall a Sikuli version and reboot, before installing a newer version.
Make sure, the system path only contains pointers to the new version.

What is your environment? (system, Eclipse, Java, other relevant used stuff)

hello sir
i did installed sikuli x-1.0rc3 and i try to run my program and the error in the console of eclipse is " Paste stack traces into this console and follow hyperlinks to source code."

i use eclipse 3.6.

how can i solve this problem

--- What system + version? (Win, Mac, Linux?)

--- At least paste the error text you are getting (not the whole stack trace).

--- you say: im new in java and sikuli
hope that means new to Sikuli only!
pls. confirm: you should be familiar with Java programming in Eclipse.

win xp
n my program tht i write

import edu.mit.csail.uid.FindFailed;

public class helloworld {

        public static void main(String[] args) {
                Screen s = new Screen();
                try{
                        s.find("img1/startstart.png", 0);
                        s.click("img1/startstart.png");}

                catch(FindFailed e){
                        e.printStackTrace();
                }

        }

}

i add jar files "sikuli.script.jar" and corently im working on sikuli x-1.orc3

i have done java programing for selenium rc so i m familiar but dont have a waste knowledge of java and i.ll try to find and click operation of start button but it doesnt work
plss provide me some guidlines with the help of tht i tackle my problem ..

ok, when trying to get used to a new software, it is always a good idea to visit the docs.

on java programming:
http://sikuli.org/docx/faq/030-java-dev.html#how-to-use-sikuli-script-in-your-java-programs

BTW: since a click already makes a find():
                try{
                        s.click("img1/startstart.png");}

                catch(FindFailed e){
                        e.printStackTrace();
                }

... and if you do not really want to deal with FindFailed exceptions, tell Java your main throws FindFailed and get rid of the try/catch stuff - makes code really more readable and you do not loose anything.
get familiar with the exists() function.

Another tip: http://sikuli.org/doc/java-x/

Hello Sir..
 I have add the sikuli jar file in the class path of system variable C:\Program Files\Sikuli X
and after that i add path to sikuli\libs i.e. C:\Program Files\Sikuli X\libs in the path of system variable
and path to java\jre6\bin i.e. C:\Program Files\Java\jre6\bin in the path of system variable

and in the command line i write:- java -jar "C:\Program Files\Sikuli X\sikuli-script.jar" imgs2.sikuli // imgs2.sikuli is the name of the folder where i capture screen shot of the start button//

but it doesnt run in the command prompt..

and i write a program in java but i also show some error

package defaultt;

import edu.mit.csail.uid.FindFailed;

public class anu {

        public static void main(String[] args) throws FindFailed {
                Screen s = new Screen();
                s.click("imgs2/start.png", 0); // this command use for click on the start button//
    s.wait("imgs2/AnuragVM4Int.png"); // this command use for wait to open the start menu/
    s.find("imgs2/Run.png",0); // find the run button //
    s.click("imgs2/Run-1", 0); // click on run //

        }

}

now can u help me to tackle this problem...
if i made any mistake in command prompt, adding jar file and java file in system variable and in writting java program then plss guide me

Hello Sir..
 I have add the sikuli jar file in the class path of system variable C:\Program Files\Sikuli X
and after that i add path to sikuli\libs i.e. C:\Program Files\Sikuli X\libs in the path of system variable
and path to java\jre6\bin i.e. C:\Program Files\Java\jre6\bin in the path of system variable

and in the command line i write:- java -jar "C:\Program Files\Sikuli X
\sikuli-script.jar" imgs2.sikuli // imgs2.sikuli is the name of the
folder where i capture screen shot of the start button//

but it doesnt run in the command prompt..

and i write a program in java but i also show some error

package defaultt;

import edu.mit.csail.uid.FindFailed;

public class anu {

       public static void main(String[] args) throws FindFailed {
               Screen s = new Screen();
               s.click("imgs2/start.png", 0); // this command use for click on the start button//
                               s.wait("imgs2/AnuragVM4Int.png"); // this command use for wait to open the start menu/
                               s.find("imgs2/Run.png",0); // find the run button //
                               s.click("imgs2/Run-1", 0); // click on run //

       }

}

now can u help me to tackle this problem...
if i made any mistake in command prompt, adding jar file and java file in system variable and in writting java program then plss guide m

--- System Path
- no need to put sikuli-script.jar in the system class path, as long as you are running your java code from inside eclipse

you say: in the path of system variable

hope it is in system preferences the pane Systemproperties -> extended (or so) -> Environment Variables

There you should use the User Variables PATH entry and it should look like this:

any-stuff-that-is-not-Sikuli;C:\Program Files\Sikuli X\libs;C:\Program Files\Java\jre6\bin

make sure, that in the entries "any-stuff-that-is-not-Sikuli;" (which might not be there) there is no reference to older Sikuli stuff

(no need to touch the System Variables Path entry for that)

After editing this it might be a good idea to at least logout and login again.

--- java -jar "C:\Program Files\Sikuli X\sikuli-script.jar"
no ned to do that, to run a .sikuli.
use Sikuli-IDE.bat -r imgs2.sikuli

This command is only of use in situations, where you do not have the complete Sikuli installation or for test situations, where one doubts, it has something to do with the IDE part.

--- java code
If we are still talking about Eclipse:
add sikuli-script.jar to the class path settings of your java project.

The docs at
http://sikuli.org/docx/faq/030-java-dev.html#how-to-use-sikuli-script-in-your-java-programs

should have told you, that with X-1.0 it is no longer: import edu.mit.csail.uid.FindFailed;

but:
import org.sikuli.script.*

your image references are:
imgs2/start.png

but as far as I understand:
you captured your images in imgs2.sikuli (which is the folder, where the images reside).
So if you want to use the images in your java code:
imgs2.sikuli/start.png

Have a look at class ImageLocator. This contains the method addImagePath(). When adding your image locations this way, you do not have the need to specify a path with each image, just the filename.

Hello Sir..
 Now i found new problem (related to Sikuli) currently my main machine is Linux and I am working on VM-win machine
(Windows XP) and my VM machine (Window-XP) is correpted so i again setup VM-win but in that new VM-win machine (Window-XP) I again installed Sikuli X 1.0rc3 but it doesnt capture the image it just open and when i click on "take a screenshot" then it doesnt capture image even it's not exists again..

So Sir pls now guide me whech steps i follow to tackle this problem

and im working on integrate Sikuli-IDE with eclipse so how can i done this bcs sikuli 0.9.8 doesnt support eclipse..

plss guide me

Installed latest Java in standard place?
Try to use Sikuli-IDE.bat to start the IDE.

Hello Sir
I installed latest version of java but now im working to capture image from Sikuli IDE X 1.0 rc3 but it does not work it just open and when i click on "take a screenshot" menu option then it does not capture any image.

the screen is not going to black that happens in Sikuli 0.10 or 0.9.

so how can i tackle this problem
n before 2-3 days back it work on Sikuli X 1.0rc3 at that time it works fine and after that my Virtual machine is corrupted then i setup new VM so in that Vertual machine i installed Sikuli X 1.0rc3 but it just open and doesnt capture any image..

plss guide me sir ...

Hello Sir
I installed latest version of java but now im working to capture image from Sikuli IDE X 1.0 rc3 but it does not work it just open and when i click on "take a screenshot" menu option then it does not capture any image.

the screen is not going to black that happens in Sikuli 0.10 or 0.9.

so how can i tackle this problem
n before 2-3 days back it work on Sikuli X 1.0rc3 at that time it works fine and after that my Virtual machine is corrupted then i setup new VM so in that Vertual machine i installed Sikuli X 1.0rc3 but it just open and doesnt capture any image..

plss guide me sir ...

-- Did you use Sikuli-IDE.bat to start the IDE?
If not, then try this first.

-- if this does not help, add -Dsikuli.console=false the following to the line in Sikuli-IDE.bat that begins with %JAVA_EXE%
the modified line should look something like this from the beginning:
%JAVA_EXE% -Dsikuli.console=false -Xms64M ..... and the rest of the line unchanged

Using this modified .bat should show the aborting error in the command line window.

Yes Sir i use Sikuli-IDE.bat to start the IDE.
i,;; try to open the Sikuli-X-1.0rc3 .
Sikuli IDE new version have plenty of feature to automate application and lots of command available to use ..

sir can u give me a favour if i have any problem then can i discuss with u by Skype or through Mail ????

and i'll try to integrate Sikuli-IDE with eclipse but i face plenty of problems so can u provide me workspace or set up or any small project so with the help of that i try to tackle this ???

regard :-
Anurag Sharma

Yes Sir i use Sikuli-IDE.bat to start the IDE.
i,;; try to open the Sikuli-X-1.0rc3 .
Sikuli IDE new version have plenty of feature to automate application and lots of command available to use ..

sir can u give me a favour if i have any problem then can i discuss with u by Skype or through Mail ????

and i'll try to integrate Sikuli-IDE with eclipse but i face plenty of problems so can u provide me workspace or set up or any small project so with the help of that i try to tackle this ???

regard :-
Anurag Sharma

sir can u give me the doumentation of Sikuli X 1.0rc3 ..

--- i'll try to integrate Sikuli-IDE with eclipse
that does not make any sense (it is not Sikuli-IDE that is integrated).

You might either use the PyDev plugin to develop and run Jython code, that uses the Sikuli Jython API (see: http://sikuli.org/docx/faq/040-other-ide.html#how-to-use-sikuli-together-with-other-ide-s).

Or you might develop in plain Java (or any other Java based language like Scala, Groovy, JRuby, ...) using Sikuli's Java level API (see: http://sikuli.org/docx/faq/030-java-dev.html).

In both cases only sikuli-script.jar is relevant (and the native libraries coming with Sikuli).

In fact, you need some tool to capture images. Sikuli-IDE might be used for that. But you can use any other available capture tool or even write your own with a few lines of Sikuli code and run it from command line.

--- Sikuli-IDE not working

I asked you to try:

add -Dsikuli.console=false the following to the line in Sikuli-IDE.bat that begins with %JAVA_EXE%
the modified line should look something like this from the beginning:
%JAVA_EXE% -Dsikuli.console=false -Xms64M ..... and the rest of the line unchanged

Using this modified .bat should show the aborting error in the command line window.

But I did not see any feedback

--- can u give me the doumentation of Sikuli X 1.0rc3
http://sikuli.org/docx/

--- if i have any problem then can i discuss with u by Skype or through Mail
Skype: no
Mail: yes
send your stuff including appropriate screenshots altogether in one zipped file to my mail at: https://launchpad.net/~raimund-hocke

Yes Sir my Sikuli IDE X 1.0 rc3 is working fine ...
i capture script of http://dsc.discovery.com
when i completed my script then i send u sir

Hi SIr..
When i m giving input for email OR in the URL then previously use data is appear so how can i erase that with the use of sikuli-IDE

regard
Anurag sharma

-- previously use data is appear so how can i erase

have a look at question https://answers.launchpad.net/sikuli/+question/178696
and transpose the code to Java

Hello SIr Good Morning ...
i want to select a item drop down menu but when i'll try this it doesnt capture

i.e. click(123.png" \\123.png is the drop down menu tht menu have some other option i.e. country menu drop down n i want select india, india is place in 4 position \\
find(456.png) \\ 456.png is the list when i click on drop down menu then list appear\\
click(789.png) \\ 789.png is the name of item that i want select\\

but when i click on tht it doesnt select the list was disappear before after tht it click
so how can i select a drop down menu???

In situations like that, you have to use the capture hotkey:

- Have Sikuli IDE open with your script
- go to your app and prepare the situation to capture
- press capture hotkey - capture will now be possible

Sir i'll try fro hotkey but it doesnt work..
 my problem is like tht when i click on start button then drop down window will appear but when i'll try to click on the item those exists in that drop down list so it doesnt work...

how can i solve this problem and plss give me a some example ??\

I tested on my Win7 and have to admit, that I had problems.

Historically the hotkey was shift-ctrl 2, but that did not work anymore. Trying to add it again did not succeed: shift-ctrl 2 is blocked somehow.

Adding another combination like e.g. shift-ctrl 1 finally worked.

The capturing method still is:

- Have Sikuli IDE open with your script
- go to your app and prepare the situation to capture
- press capture hotkey - capture will now be possible and you will have the image in your script

But be aware, that Preview might not be possible with images captured that way.

Sir i use hotkey Ctrl+Shift+1 for capture image but it does not work it doesnt black the screen..

i use Ctrl+Shift+2 it work and it capture the drop down menu but it doesnt take the selected item of that drop down menu..

hot key (Ctrl+Shift+1) doesnt capture the screenshot so how can i tackle this ???

You have to register a new hot key like Ctrl+Shift+1 in Sikuli IDE's preferences before you can use it.