# Have Lumi test your app while you watch

> You will run one command, ask Lumi to test your app, read what it found and watch one problem happen again. You need no AI account and you do not write code.

Canonical page: https://shipvo.dev/learn/test-your-app-with-lumi/

<video controls preload="metadata" playsinline tabindex="0" data-title="Have Lumi test your app while you watch" data-length="2 min 7 s" poster="/videos/test-your-app-with-lumi.jpg" src="/media/videos/test-your-app-with-lumi-ea953cd2.mp4"><track kind="captions" src="/videos/test-your-app-with-lumi.vtt" srclang="en" label="English">Your browser cannot play this video. Read the captions and transcript on the Videos page.</video>

Prefer to watch first? This 2 minute 7 second video covers the same steps. [Captions and transcript](https://shipvo.dev/learn/videos.md).

<details class="credits"><summary>ⓘ Copyright credits</summary>Music: "and then its all gone" by Williamson (<a href="https://www.jamendo.com">Jamendo</a>, <a href="http://creativecommons.org/licenses/by-sa/3.0/">CC BY-SA 3.0</a>). Source: <a href="https://www.jamendo.com/track/124446">https://www.jamendo.com/track/124446</a></details>

You will run one command, ask Lumi to test your app, read what it found and watch one problem happen again. You need no AI account and you do not write code.

**Level:** beginner. **Time:** about 10 minutes, most of it the first build.

New words are explained once, and collected in the [glossary](https://shipvo.dev/learn/glossary.md).

## What you need

- An app made with Shipvo or Expo, in a folder on your computer. If you have none, do [Create your first app](https://shipvo.dev/learn/first-app.md) first.
- Node 22 or newer and a terminal ([how to check](https://shipvo.dev/learn/first-app.md)).

## 1. Start Lumi

In your terminal, go to your app folder and type:

```bash
npx shipvo lumi
```

For an iPhone-style phone, type `npx shipvo lumi ios` instead. Android and iOS work the same way.

Shipvo builds a web copy of your app. You will see `Building <your app> for the simulator…`. The first build is the slowest. Your browser then opens with the phone on the left and the Lumi sidebar on the right. On a narrow window the sidebar is below the phone.

![Lumi on Tide & Tackle in a desktop browser: the phone on the left shows the app's home screen, the Lumi sidebar on the right says Idle, shows Findings 0 and has a box labelled Tell Lumi what to do.](https://shipvo.dev/img/brand/banner.webp)

> **If something goes wrong.**
> - The terminal shows an error from `npx expo export --platform web` and names a file: that file uses something that only works inside a phone's own system, such as a camera or Bluetooth module. Ask your assistant to fix it.
> - It says `Port 4547 is in use. Pass --ui-port <n>.`: type `npx shipvo lumi --ui-port 4600`.
> - It says `Port 4546 is in use.`: pass `--port <n>` the same way.

## 2. Ask Lumi to test your app

In the box labelled **Tell Lumi what to do**, type `test my app` and press Enter. Lumi taps through your app from the start screen. A caption names each step, such as "Tapping Checkout", and the sidebar lists every action.

To test one path, type its everyday name: `test checkout`, `test login` or `test sign up`. Lumi says which path it picked.

![Lumi mid-run: the sidebar lists each tap, such as Tapping Open search, and the phone shows the search screen.](https://shipvo.dev/img/brand/banner.webp)

## 3. Read the findings

Look at **Findings** in the sidebar. Each finding is something Lumi reported, such as a button that does nothing, a screen that stays blank or a network call that fails. Each problem is listed once. **Coverage** shows how many screens and controls Lumi tried.

![The Lumi sidebar with 26 findings, the first three visible, each with a Replay button, and Coverage showing 13 screens and 22 of 42 controls tried so far in a run that is still going.](https://shipvo.dev/img/brand/banner.webp)

This screenshot is a run on the sample app, taken while Lumi was still testing, so the coverage numbers are mid-run. We did not check each of its findings by hand, so read them as things to look at, not as confirmed bugs. The numbers under "What we measured" come from the benchmark apps ([Lumi benchmark](https://shipvo.dev/docs/lumi-bench.md)).

On a phone-width window the sidebar sits below the phone:

![Lumi on a 390 pixel wide window: the phone on top, the sidebar with findings below it.](https://shipvo.dev/img/brand/banner.webp)

## 4. Watch a problem happen again

Press **Replay** next to a finding. The phone repeats the steps that led to it. You can also type `replay bug 1`.

## 5. Try bad input

Type `try checkout with bad input`. Lumi runs the same path with invalid values in the text fields. A finding here means your app accepted something it should have refused.

## 6. Make a run repeat

Stop Lumi with Ctrl+C in the terminal, then start it with a seed:

```bash
npx shipvo lumi --seed 1
```

The same seed gives the same walk, so you can check that a fix worked.

## What we measured

On the benchmark apps in this repository, with seed 1 and a budget of 200 steps, Lumi found 3 of 3 planted bugs in each app and reached 5 screens in `shop` and 8 in `account`. The command, the date and the full table are in [Lumi benchmark results](https://shipvo.dev/docs/lumi-bench.md).

## Next steps

- [Lumi on Shipvo Phone](https://shipvo.dev/docs/lumi.md): every command and option
- [Test with an AI assistant](https://shipvo.dev/learn/test-with-an-assistant.md)
