Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

6 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ›๏ธ Multimodal AI Asset Protection

Computer Vision + Environmental Sensors + AI Agent for Museum Asset Protection

Roni Bandini June 2026 MIT License


๐Ÿ“– Overview

Traditional asset protection systems often rely on a single sensing modality, such as a Passive Infrared (PIR) motion detector. While inexpensive and widely deployed, PIR-based systems are prone to false positives caused by temperature fluctuations, reflections, electrical noise, and environmental conditions.

This project explores a different approach: combining computer vision, environmental sensing, and an AI reasoning agent running entirely on a low-cost edge AI computer.

The prototype continuously monitors a valuable objectโ€”in this case, an Omega wristwatchโ€”and evaluates sensor data, object position, operating hours, and environmental conditions to determine the most appropriate response.

No cloud processing is required.


โœจ Features

  • ๐ŸŽฅ Object detection using Edge Impulse
  • ๐Ÿ‘๏ธ Continuous asset monitoring
  • ๐Ÿ“ Position tracking inside the camera frame
  • ๐ŸŒก๏ธ Non-contact temperature monitoring
  • ๐Ÿšถ Human presence detection
  • ๐Ÿค– AI-based reasoning with OpenClaw
  • ๐Ÿ”’ Fully local processing
  • โšก Runs on Qualcomm AI hardware
  • ๐Ÿ“ฒ Telegram and WhatsApp notifications

๐Ÿ—๏ธ System Architecture

                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚ PIR Sensor  โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚ RCWL-0516   โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚ MLX90614    โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚ USB Camera  โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

                โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                โ”‚     Rubik Pi 3     โ”‚
                โ”‚ Edge Impulse Model โ”‚
                โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

                โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                โ”‚      OpenClaw      โ”‚
                โ”‚     AI Agent       โ”‚
                โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                          โ”‚

      โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
      โ”‚ Log Event  โ”‚ Maintenanceโ”‚  Security  โ”‚ Authoritiesโ”‚
      โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

๐Ÿงฉ Components

Component Purpose
Edge Impulse Object detection
OpenClaw AI reasoning and decision making
Rubik Pi 3 Edge AI execution
PIR Sensor Motion detection
RCWL-0516 Microwave presence detection
MLX90614 Infrared temperature monitoring
USB Camera Visual monitoring

๐Ÿ–ฅ๏ธ Hardware

Rubik Pi 3

Specification Value
SoC Qualcomm Dragonwing QCS6490
CPU Architecture ARM64 / AArch64
AI Accelerator Hexagon NPU
GPU Adreno 643
AI Performance Up to 12 TOPS
RAM 8 GB LPDDR4x
Storage 128 GB UFS 2.2
Dimensions 100 ร— 75 mm

๐Ÿ“ฆ Bill of Materials

Qty Item
1 Thundercomm Rubik Pi 3
1 Active Cooler
1 USB-C PD Power Supply
1 Logitech USB Camera
1 PIR Motion Sensor
1 RCWL-0516 Microwave Sensor
1 MLX90614 Temperature Sensor
20 Dupont Jumper Wires

๐Ÿ” Sensors

PIR Sensor

Detects motion by measuring changes in infrared radiation emitted by surrounding objects.

RCWL-0516 Microwave Sensor

Unlike PIR sensors, the RCWL-0516 is an active sensor that emits microwave energy and detects changes in the reflected signal.

Advantages:

  • Works in hot environments
  • Detects movement regardless of temperature
  • Less affected by ambient heat

MLX90614 Infrared Temperature Sensor

Provides:

  • Object temperature
  • Ambient temperature

The sensor can detect:

  • Human contact
  • Object removal
  • Tampering attempts

by comparing the watch surface temperature against ambient conditions.


๐Ÿค– AI Decision Making

OpenClaw receives:

  • Asset presence
  • Asset coordinates
  • Motion events
  • Human presence detection
  • Temperature changes
  • Museum operating hours

Example reasoning:

IF
    Watch missing
    AND museum closed
    AND motion detected
    AND human presence detected

THEN
    Potential security incident

Possible actions:

Action Description
๐Ÿ“ Log Event Record incident
๐Ÿ”ง Notify Maintenance Possible equipment issue
๐Ÿ‘ฎ Notify Security Security review required
๐Ÿšจ Contact Authorities High-confidence incident

๐Ÿง  Edge Impulse Training

Dataset

Parameter Value
Images 80+
Resolution 96ร—96
Labels Bounding Boxes
Training Split 90 / 10
Epochs 70
Learning Rate 0.001

Workflow

  1. Create project
  2. Upload images
  3. Label watch
  4. Create Impulse
  5. Train model
  6. Test performance
  7. Deploy to Rubik Pi 3

โš™๏ธ Installation

System Packages

sudo apt update

sudo apt-get install \
libportaudio2 \
libportaudiocpp0 \
portaudio19-dev \
--break-system-packages

sudo apt install python3-pyaudio
sudo apt install selinux-utils
sudo apt install fswebcam -y
sudo apt install -y sox libsox-fmt-all
sudo apt install python3-smbus
sudo apt install gpiod

Python Packages

pip3 install edge_impulse_linux \
-i https://pypi.python.org/simple \
--break-system-packages

pip3 install "opencv-python>=4.5.1.48,<5" \
--break-system-packages

๐Ÿ“ท Camera Verification

lsusb
ls /dev/video*
fswebcam -d /dev/video0 \
-r 1280x720 \
--no-banner test.jpg

๐ŸŒก๏ธ Verify Temperature Sensor

i2cdetect -a -y -r 1

๐Ÿš€ Deploy Edge Impulse Model

sudo edge-impulse-linux-runner

Select the quantized model.

Qualcomm's Hexagon NPU supports quantized models. Float32 models will execute on the CPU.

Typical performance:

boundingBoxes 2ms. []
boundingBoxes 3ms. [{"label":"watch","value":0.70}]

๐Ÿฆž OpenClaw

Install:

curl -fsSL https://openclaw.ai/install.sh | bash

Configure:

  • OpenAI
  • Anthropic
  • Ollama
  • Telegram
  • WhatsApp

Telegram pairing:

openclaw pairing approve telegram XXXXX

โš™๏ธ Configuration

WATCH_DEFAULT_X = 32
WATCH_DEFAULT_Y = 40

WATCH_POSITION_THRESHOLD_PCT = 20

CONFIDENCE_THRESHOLD = 0.85

MUSEUM_OPEN_HOUR = 9
MUSEUM_CLOSE_HOUR = 18

DEFAULT_OBJECT_TEMP = 22.0
DEFAULT_AMBIENT_TEMP = 22.0

TEMP_THRESHOLD_PCT = 15

๐Ÿ“ˆ Example Output

AI Asset Protection
Roni Bandini, Oct 2025, Argentina

Museum hours            โ†’ 09:00 โ€“ 18:00
Watch default position  โ†’ X:32 Y:40
Confidence threshold    โ†’ 0.85
Object temp default     โ†’ 22.0ยฐC
Ambient temp default    โ†’ 22.0ยฐC

Stop with CTRL-C

๐Ÿ”’ Why Multimodal Security?

A camera alone can be fooled.

A PIR sensor alone can generate false positives.

A temperature sensor alone lacks context.

By combining:

  • Computer Vision
  • Temperature Monitoring
  • Microwave Detection
  • Motion Detection
  • AI Reasoning

the system can make significantly more informed decisions than any individual sensor.


๐Ÿ“š References

  • Edge Impulse
  • OpenClaw
  • Rubik Pi 3
  • MLX90614
  • RCWL-0516

๐Ÿ“„ License

MIT License

Copyright (c) 2026 Roni Bandini