riccardo-sapuppo

Windows App Guided Tour

Teaches a Windows application without touching it: no source code, no plugin, nothing recompiled. An overlay dims everything except the control being explained, and moves on only when the application itself says the step is done.

Area
Operations & tools
Main stack
Electron · TypeScript · RobotJS · Robot Framework

Key features

  • • Interactive overlay with focused highlight
  • • Step-by-step paths with validation
  • • Centralised logging of user actions
  • • Action automation on the target app
  • • Enterprise packaging and deployment

About the project

Guided tour system for Windows desktop applications, which teaches software nobody here can change: no source code, no plugin, no SDK, nothing added to the program being taught. The tour is a separate process standing beside an application that was already installed and reading it through the same accessibility interface a screen reader uses, so the one thing it asks of the application is that its controls carry automation ids.

An Electron overlay highlights the relevant UI element while dimming the rest, guiding the user with tooltips and validation at each step. Steps produce a log and, when required, an automation runner performs the actual clicks and actions on the target application.

Technologies used

  • Electron
  • TypeScript
  • RobotJS
  • Robot Framework
  • Python
main
windows-app-guided-tour.mdUTF-8TypeScript