Skip to content

omiGlass

Directory actions

More options

Directory actions

More options

Latest commit

 

History

History

omiGlass

README.md

omiGlass Front View

Overview

omiGlass is an open-source smart glasses project: a XIAO ESP32 S3 Sense with a camera, 3D-printed frame, and battery pack, paired with an open app and firmware.

XIAO microcontroller with camera Hardware, firmware, and software in this repo omiGlass is a developer kit. Features are experimental; treat battery life and stability as unvalidated until you test your own build.

How to get it

Order a pre-built kit when available Follow the guide below to build from scratch

Using it

Pair omiGlass with the Omi app like any other Omi device: power it on, open the app, and follow the pairing flow. The camera captures first-person photos; the microphone captures audio for transcription. End-user setup help lives in the help center.

Always get consent when recording others, and be mindful of local recording laws. Respect privacy in public and private spaces.

Prerequisites

Local AI model hosting For firmware upload For hardware components

Hardware components

Component Description Link
XIAO ESP32 S3 Sense Main microcontroller with camera Amazon
6x 150mAh batteries Main power supply Option 1 or Option 2
1x 250mAh battery Additional power Amazon
Wires For connections Amazon
Hinges For frame assembly Standard glasses hinges
The current design does not include a switch. See the contribution section for how you can help improve this.

Software setup

```bash git clone https://github.com/BasedHardware/omi.git cd omi/omiGlass npm install ``` 
Or with yarn:
```bash
yarn install
```
Copy the template and add your keys: 
```bash
cp .env.template .env
```

Edit `.env` and add:
- [Groq API key](https://console.groq.com/keys)
- [OpenAI API key](https://platform.openai.com/api-keys)
- Ollama URL (default: `http://localhost:11434/api/chat`)
```bash ollama pull moondream:1.8b-v2-fp16 ``` ```bash npm start ``` 
Or with yarn:
```bash
yarn start
```

<Tip>
This is an Expo project. Open the localhost link displayed after starting to access the web version.
</Tip>

Hardware assembly

Print the glasses mount case using the STL files in the `hardware` folder. Wire the batteries and XIAO board according to the assembly diagram. 
<Frame>
  <img src="https://github.com/user-attachments/assets/45ef303b-0f92-43eb-bfad-1b20a86e948c" alt="omiGlass Assembly" style={{ maxWidth: '400px', margin: '0 auto' }} />
</Frame>
Mount all components into the 3D printed case and attach hinges.

Firmware installation

Open the [firmware folder](https://github.com/BasedHardware/omi/tree/main/omiGlass/firmware) and load the `.ino` file in Arduino IDE. 
<Tip>
Alternatively, follow the [firmware readme](https://github.com/BasedHardware/omi/tree/main/omiGlass/firmware/readme.md) to build using `arduino-cli`.
</Tip>
Add the ESP32 board package: 
1. Go to **File → Preferences**
2. Add to "Additional Boards Manager URLs":
   ```
   https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_index.json
   ```
3. Go to **Tools → Board → Boards Manager**
4. Search for `esp32` and install the latest version
1. Select port (likely COM3 or higher) at the top of Arduino IDE 2. Search for `xiao` in the board selector 3. Select **XIAO_ESP32S3** Go to **Tools** dropdown and set **PSRAM** to **OPI PSRAM**. 
<Frame>
  <img src="/images/docs/hardware/images/image.png" alt="PSRAM Settings" />
</Frame>
Click the Upload button to flash the firmware to your XIAO ESP32S3 board.

For flashing and monitoring details, see Flash Firmware and Monitoring.

Contributing

Help improve omiGlass!

Software

Task Status
Connect glasses with Omi AI app ✅ Complete

Hardware

Task Status
Redesign legs/sides for bigger heads ⬜ Open
Add switch to design ✅ Complete
Get help with setup, contribute to the project, and connect with other builders

License

This project is licensed under the MIT License.

Related Documentation

Production Omi wearable Necklace form factor DevKit (legacy) General assembly instructions Start here