RPA AI Recorder
Show the task
Build the flow
A more natural way to create desktop automations. I worked with a team across Paris, Athens and Seattle to bring screen interaction, cursor movement and voice instructions into one recording experience.
01 / At a glance
Automation starts with expertise
Desktop flow creation can ask people to understand the automation tool before they can describe the task they want it to perform.
Connect the ways people explain
I reimagined the recorder and reconciled the classic recorder, element picker and task coach into a consistent interaction direction.
A task becomes a starting point
The experience combines actions on screen and spoken instructions to make desktop flow creation more approachable.
02 / The experience
Do it once
Show what matters
Follow the recording concept from explaining a task to reviewing the generated automation.
- 01 / 03 Prepare
Set up the recording
A focused recorder guides the person into the session before the desktop task begins.
Recording settings bring the setup into a compact desktop panel. - 02 / 03 Demonstrate
Work through the task
The person moves between applications and explains what they are doing. Voice and on-screen actions provide context together.
Working in a spreadsheet while the recorder captures the task and its explanation. - 03 / 03 Review
Return to an editable flow
The recording leads back into the automation designer, where the resulting actions can be reviewed and refined.
The recorded task becomes a flow in the designer, alongside Copilot.
03 / Design & leadership
One recorder
Several ways to explain
The design work connected the interaction model, visual consistency and an end-to-end demonstration.
Bring voice into the task
Voice instructions complement what is visible on screen and where the cursor moves. The recorder keeps that explanation beside the applications being used.
Make the whole journey reviewable
I created an end-to-end video demonstration for Ignite, working with data science, PM and development partners to make the concept concrete.
Unify the recording experiences
The classic recorder, element picker and task coach had to feel like parts of one experience. I focused on consistency across the interaction and visual design.
04 / What changed
A more approachable
way into automation
The project explored how multiple input modes can lower the barrier to creating desktop flows.
Start from the task
People can combine a demonstration with spoken instructions instead of defining every automation action upfront.
Voice meets the interface
UI interaction, cursor movement and voice are brought together in the desktop recording experience.
Make the concept tangible
The work included an Ignite demonstration and was selected as a key feature for Microsoft Build.
Keep exploring
All projectsRPA Self-healing with Copilot
View project