I want to use automated tools for load and stress testing of Mobile Games (iOS & Android platform). Could you please update me whether your tool help me out on this context?

Asked by Gurmeet Singh

Hi Guys,

I wanted to use automated tools for load and stress testing of Mobile Games (iOS & Android platform).
Could you please update me whether your tool help me out on this context?

Question information

Language:
English Edit question
Status:
Solved
For:
SikuliX Edit question
Assignee:
No assignee Edit question
Solved by:
Gurmeet Singh
Solved:
Last query:
Last reply:
Revision history for this message
Roman Podolyan (podolyan-roman) said :
#1

I used Sikuli for monkey and functional testing of iOS apps with iOS Simulator from XCode. From my point of view monkey testing is some sort of load and stress testing (no kidding).

If you tell more about how you are going to do that stress and load testing, I'll tell you my opinion if that can be done with Sikuli.

Revision history for this message
Gurmeet Singh (gurmeet-singh-a) said :
#2

Thanks a lot Roman Podolyan !

Below are the steps that I need to run:

1) Stress Testing: we download ‘n’ numbers of applications/data in our device to full its maximum memory limit and then run the given application, save some checkpoints and play it till the device get crashed. In a successful stress test, the application will come back to normality along with all of its saved data, even after the most terrible break down.

2) Load Testing: we create a dummy server and invite as many as users to check the load. The goal of load testing is to expose the defects in application related to buffer overflow, memory leaks and mismanagement of memory.

So can you find tell me whether these tests can be performed using Sikuli or not?

Revision history for this message
Roman Podolyan (podolyan-roman) said :
#3

I don't see where Sikuli fits in this context. It is not general testing framework or what. It is build around visual search and user-level keyboard and mouse action event simulation, pasting and so on.

So, if your tests don't have to use visual search (my were, because the visuals were the only thing I could read from iOS simulator and Mac display to generate input, read some state signs and determine if iOS app under test crashed), you don't need Sikuli for that. There is no any special functions or procedures to do that kinds of testing, and there is no built-in reporting tools in Sikuli, so it seems that there is nothing you could take advantage of.

But I might get you wrong, so please tell me what you expect from Sikuli except visual search and mouse-keyboard events.
If you see where you need them, like I make of them my Simulator controls and checking if app crashed and XCode stopped the simulator, then you can use it.

Revision history for this message
Gurmeet Singh (gurmeet-singh-a) said :
#4

I need to check the server performance through my device/simulator so is it possible through to Sikuli?

Revision history for this message
Roman Podolyan (podolyan-roman) said :
#5

Sorry, again did not get you.

I sit in office next to a team of load/performance testers, and they use instruments like Jmeter for that job. They generate a lot of requests or page loadings, and the requests and pages are the only thing the server gives out. The server admin guy monitors the server state with his tools. I think you need tools like that too.

And I wonder, what server load do you expect to get from Sikuli. Sikuli is just not for generating high server load. In my monkey script it gave hell to just one application, not the server.

Revision history for this message
Gurmeet Singh (gurmeet-singh-a) said :
#6

Thanks Roman !!