← All posts
TestingGuides

Lumi tests your app while you watch, with one command

npx shipvo lumi opens your app on an Android or iOS phone in your browser, taps through it and lists the problems it finds, each with a Replay button. What it found in our benchmark apps, and how to run it on yours.

Hans AdeNovember 7, 20262 min read
Lumi testsyour app Shipvo

You made an app. Does every button work?

Run this in your app folder:

bash
npx shipvo lumi

Shipvo builds a web copy of your app and opens it on a phone in your browser. Use npx shipvo lumi ios for an iPhone-style phone. Lumi is a small glowing orb beside the camera. Type test my app and it taps through your app.

Lumi running on Tide & Tackle: the phone on the left, the sidebar on the right with a list of taps, a list of findings with Replay buttons, and mid-run coverage of 13 screens and 22 of 42 controls.

This screenshot is a run on the sample app, taken while Lumi was still testing, so the coverage numbers are mid-run. We did not check each finding in it by hand, so read them as things to look at, not as confirmed bugs. The numbers under "What we measured" come from the benchmark apps (Lumi benchmark).

The same Lumi view on a 390 pixel wide window, with the sidebar below the phone.

What Lumi finds

Each problem is a finding in the sidebar:

  • a button that does nothing,
  • a screen that stays blank,
  • a network call that fails,
  • a form that accepts input it should refuse.

A caption names every step, such as "Tapping Checkout". Press Replay on a finding and the phone repeats the steps that led to it.

What we measured

We keep two apps in the repository with bugs planted on purpose, and a script that counts how many Lumi finds. With seed 1 and a budget of 200 steps, Lumi found 3 of 3 planted bugs in shop and 3 of 3 in account. It reached 5 screens in shop and 8 in account. The apps, the rules and the command to repeat the run are in the Lumi benchmark.

Ask in plain words

Commands are plain text and need no AI account:

TypeLumi does
test my appWalks the app from the start screen.
test checkoutFinds the path through Cart and Pay and says which one it picked.
try checkout with bad inputRuns the same path with invalid values.
replay bug 2Plays finding number 2 again.

A run repeats when you pass the same --seed, so you can check that your fix worked.

Lumi runs on your computer and answers only requests from its own page (Lumi on Shipvo Phone).

Try it

Follow the tutorial or read the docs.