Simulate user interactions inside an application

wxPython Users
1

Hi everybody,

Has somebody got a trick to simulate user interactions inside an application ? I’ve seen there’s a WarpPointer method useful to move the mouse cursor programmatically but what about a mouse click ?

Cheers,

Thierry BRIZZI.

2

Probably a much simpler way to implement this, and know you do also get specific end-user simulation software for sort of bulk testing of software apps, but, the accessibility software I use to work with computers also includes it’s own form of UI macro’s, which would let you script actions like moving mouse, clicking on buttons, entering text, etc. etc.

Stay well

Jacob Kruger
Blind Biker
Skype: BlindZA
‘…fate had broken his body, but not his spirit…’

···

----- Original Message -----

From:
Thierry Brizzi

To: wxpython-users@googlegroups.com

Sent: Monday, 17 February, 2014 4:26 PM

Subject: [wxPython-users] Simulate user interactions inside an application

Hi everybody,

Has somebody got a trick to simulate user interactions inside an application ? I’ve seen there’s a WarpPointer method useful to move the mouse cursor programmatically but what about a mouse click ?

Cheers,

Thierry BRIZZI.

–
You received this message because you are subscribed to the Google Groups “wxPython-users” group.
To unsubscribe from this group and stop receiving emails from it, send an email to wxpython-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

what about the UIActionSimulator?

Or a test tool such as: Texttest.org

Werner

···

On 17/02/2014 15:26, Thierry Brizzi wrote:

Hi everybody,

Has somebody got a trick to simulate user interactions inside an application ? I've seen there's a WarpPointer method useful to move the mouse cursor programmatically but what about a mouse click ?

4

Werner (or anyone else here), have you used any of these tools to write
tests for your GUI software, and, if so, how did it go?

Thanks,
Che

···

On Mon, Feb 17, 2014 at 10:14 AM, Werner <wernerfbd@gmx.ch> wrote:

On 17/02/2014 15:26, Thierry Brizzi wrote:

Hi everybody,

Has somebody got a trick to simulate user interactions inside an
application ? I've seen there's a WarpPointer method useful to move the
mouse cursor programmatically but what about a mouse click ?

what about the UIActionSimulator?

Or a test tool such as: http://texttest.sourceforge.
net/index.php?page=ui_testing

Werner

5

We've been pecking away TextTest and StoryTest in our free time (ha!),
but it's been slow, has required some clean up of our code (naming
controls), and its support of wx is very limited (ie, the number of
widgets it supports are very limited). Also, the developer focus isn't
on wx and it shows. We're in the middle of implementing a screen
capture and comparison test, but it's still pretty rough.

I think it has potential, but requires a fair bit of time and effort
to become effective.

Anthony.

···

On Mon, Feb 17, 2014 at 9:27 AM, C M <cmpython@gmail.com> wrote:

On Mon, Feb 17, 2014 at 10:14 AM, Werner <wernerfbd@gmx.ch> wrote:

On 17/02/2014 15:26, Thierry Brizzi wrote:

Hi everybody,

Has somebody got a trick to simulate user interactions inside an
application ? I've seen there's a WarpPointer method useful to move the
mouse cursor programmatically but what about a mouse click ?

what about the UIActionSimulator?

Or a test tool such as:
Texttest.org

Werner

Werner (or anyone else here), have you used any of these tools to write
tests for your GUI software, and, if so, how did it go?

Thanks,
Che

--
You received this message because you are subscribed to the Google Groups
"wxPython-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to wxpython-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

6

Thanks, Anthony; sounds like I'm not even going to bother at this point.
The energy of activation barrier sounds probably just too high right now.
Good to know. (And wxPython deserves better.)

···

On Mon, Feb 17, 2014 at 12:44 PM, Anthony Floyd <anthonyfloyd@gmail.com>wrote:

We've been pecking away TextTest and StoryTest in our free time (ha!),
but it's been slow, has required some clean up of our code (naming
controls), and its support of wx is very limited (ie, the number of
widgets it supports are very limited). Also, the developer focus isn't
on wx and it shows. We're in the middle of implementing a screen
capture and comparison test, but it's still pretty rough.

I think it has potential, but requires a fair bit of time and effort
to become effective.

Anthony.

7

Hi,

Currently I’m using a tool named Sikuli : http://www.sikuli.org/. This software is framework agnostic and only based on image recognition. I’ve been able to build some unit tests using Jython to pilot the mouse cursor, generate mouse clicks and detect if the interface responds correctly to user requests. This is a great piece of software and I highly recommend it because it allows to directly tests user interactions for an application released as an executable to the end user.

The main problem with this approach is that I can only check the visual aspect of my widgets but not their internal states. That’s why I’ve asked if wxPython allows to simulate mouse (or keyboard) actions. Maybe some of you have code snippets or documentation pointers to dynamically generate mouse events, trigger them and process them programmatically to make an application responds to the created events ?

Cheers,

Thierry BRIZZI.

···

Le lundi 17 février 2014 19:05:47 UTC+1, Che M a écrit :

On Mon, Feb 17, 2014 at 12:44 PM, Anthony Floyd anthon...@gmail.com wrote:

We’ve been pecking away TextTest and StoryTest in our free time (ha!),

but it’s been slow, has required some clean up of our code (naming

controls), and its support of wx is very limited (ie, the number of

widgets it supports are very limited). Also, the developer focus isn’t

on wx and it shows. We’re in the middle of implementing a screen

capture and comparison test, but it’s still pretty rough.

I think it has potential, but requires a fair bit of time and effort

to become effective.

Anthony.

Thanks, Anthony; sounds like I’m not even going to bother at this point. The energy of activation barrier sounds probably just too high right now. Good to know. (And wxPython deserves better.)

8

Me, no I have it still on my Todo/Wishlist but never get to it.
Werner

···

Hi Che,

  On 17/02/2014 18:27, C M wrote:

        On Mon, Feb 17, 2014 at 10:14 AM,

Werner wernerfbd@gmx.ch
wrote:

On 17/02/2014 15:26, Thierry Brizzi wrote:

Hi everybody,

              Has somebody got a trick to simulate user interactions

inside an application ? I’ve seen there’s a
WarpPointer method useful to move the mouse cursor
programmatically but what about a mouse click ?

what about the UIActionSimulator?

          Or a test tool such as: [http://texttest.sourceforge.net/index.php?page=ui_testing](http://texttest.sourceforge.net/index.php?page=ui_testing)



              Werner

        Werner (or anyone else here), have

you used any of these tools to write tests for your GUI
software, and, if so, how did it go?

9

Here’s an interesting multi-platform API to programmatically control mouse cursor and keyboard : https://github.com/SavinaRoja/PyUserInput

···

Le mardi 18 février 2014 09:30:55 UTC+1, werner a écrit :

Hi Che,

  On 17/02/2014 18:27, C M wrote:

        On Mon, Feb 17, 2014 at 10:14 AM, > > Werner <wern...@gmx.ch> > >             wrote:

On 17/02/2014 15:26, Thierry Brizzi wrote:

Hi everybody,

              Has somebody got a trick to simulate user interactions

inside an application ? I’ve seen there’s a
WarpPointer method useful to move the mouse cursor
programmatically but what about a mouse click ?

what about the UIActionSimulator?

          Or a test tool such as: [http://texttest.sourceforge.net/index.php?page=ui_testing](http://texttest.sourceforge.net/index.php?page=ui_testing)



              Werner

        Werner (or anyone else here), have

you used any of these tools to write tests for your GUI
software, and, if so, how did it go?

Me, no I have it still on my Todo/Wishlist but never get to it.

Werner
10

For me, I think at this point I'd only really try to do GUI testing if
there were a rather hand-holdy Wiki page or something to walk me through
it. If there is anything out there like that already, let us know, or if
you have success, maybe we could at least start a Wiki page in the wxWiki
to address this.

···

On Tue, Feb 18, 2014 at 5:27 AM, Thierry Brizzi <thierry.brizzi@gmail.com>wrote:

Here's an interesting multi-platform API to programmatically control mouse
cursor and keyboard : GitHub - SavinaRoja/PyUserInput: A module for cross-platform control of the mouse and keyboard in python that is simple to install and use.