observe hidden window while working myself on the screen

EDIT: I solved the double execution by putting a sleep(5) in the end. But this must be a bug, no ?

myApp = App("title here")
myRegion = myApp.window()
if not myRegion:
    popup("didnt find it")
    exit(1)
myApp.focus()
myRegion.highlight(2)
while 1:
    while not exists("X.png"):
        wait(30)
    click(getLastMatch())
    wait(5)

-- title here
must be the title of the browsers title bar, which should reflect the frontmost browser tab. Since Sikuli has no feature to bring a browser tab to front, you should decide to run your game in a separate browser window, so you can use app.focus().

Based on this recommendation I have changed your script like above.

Generally: Sikuli can only find (and click) what is currently visible on the screen. So to not get any problems, you have to check, wether the region, you want to act on (contains some button you want to click) is visible. If you did not make your screen ready before starting your script or any other actions, to make things visible (like using class App), you will get find failed exceptions that usually stop the script.

Generally and especially while developing a script, endless looping does not make sense, unless they contain some coding to end the loop under specific conditions.

In your case, you might use instead of while 1:
for i in range(3):
which will run your loop 3 times and might be enough to test your approach.

While testing it is a good idea, to run the script in slow motion, which makes it easier to see, what the mouse is doing.

--- does not make sense
    while not exists("X.png"):
        wait(30)
This waits until X gets visible. But if it gets visible shortly after the exists() did not succeed, it takes another 30 seconds until the script continues.
so this is better:
    while not exists("X.png", 0): wait(2)
This checks every 2 seconds only once (without the ,0 it will wait 3 seconds for X to get visible until it continues), so you have a delay of max 3 seconds (2 secs + search time).

Since you know the region, where your X should be, you should restrict the search to that region, to speed things up.

So this would be my solution while testing.

myApp = App("title here")
myRegion = myApp.window()
if not myRegion:
    popup("didnt find it")
    exit(1)
myApp.focus()
myRegion.highlight(2)
for i in range(3):
    while True:
        mX = myRegion.exists("X.png",0)
        if not mX: wait(2)
        else: break
    click(mX)
    wait(5)

Have a look at http://sikuli.org/docx/region.html#exception-findfailed
There you can find an interactive version, to help to handle find failed situations during testing.

Thanks very much for looking into this and for all great advice.

So, changed the game to use its own window. Supporting tabs I guess is too much to ask for.

However my objective was to work in one window, and have another under surveillance with sikuli. But since you say that: "Generally: Sikuli can only find (and click) what is currently visible on the screen. " I feel it can't achieve what I set out to do.

If myApp.focus() had worked, it would have interrupted me all the time. However focus() is not working. and If I don't have the windows visible, it never detects the Xs :( why is it not focusing/bringing to front you suppose?

I added 0 to exists() thank you... and I finally understood why the extra 5 at the end works. It must be so fast that the answer to the click is not received before it tests again. we are talking only ms. so extra 1 at the end is enough.

I had forgot to add myApp = none and myRegion = none at end of the loop

so for now, this works as long as I'm away from keyboard and it has the window active. But it's not any help when I like to do other things with the computer. Is this something that is in the roadmap for sikuli? to at least observe without focusing ?

Not seeing any workaround, sounds like I need to search for other solutions.. and I have no idea what that would be, since the easy event handling of sikuli by just adding a pic like that, is amazingly easy and just GREAT !

Even if you could manage to have your own work and the other window, that the Sikuli script is working on, side by side on the screen, it is very difficult or impossible (with heavy concurrent usage) to "synchronize" the usage of mouse and keyboard between yourself and the script.

The only solution is to run the script on another machine (which might be a VM). So the script has its own screen/keyboard/mouse.

--- sounds like I need to search for other solutions
If you want to control, what is happening in hidden windows (in the sense, that their content is currently not visible on the screen caused by whatever reason), you need a tool, that is able to control the interface between the application and the window manager, like it is partly possible on Mac with AppleScript and the System UI Server or with Selenium for web pages.
Since it is a never-ending tug war between game users, who want to have bots, and the game developers, who want to have the humans in front of their games, I dought you will find something.

So if you do not have another machine, give Parallels/VMWare/VBox a try.