top of page
Search

50 Physical AI Project Ideas

HACKSTORM 2.0  ·  VIBE CODING TO PHYSICAL AI ·  MAY 22–24, 2026

50 Physical AI Project Ideas

Shippable in 48 hours.

A curated brainstorm for HackStorm 2.0 participants. Every idea uses the Tuya T5AI Board, the AgileX Piper arm, or both — and is scoped for a weekend build with a demo-ready outcome. Inspired by recent hardware hackathons across Shenzhen and the Bay Area, with cross-pollination from software-native ideas that deserve a physical life.

AIOT HARDWARE

50× Tuya T5AI

cam + AMOLED

ROBOTICS HARDWARE

10× AgileX Piper

6-DoF arm

FABRICATION

5× Bambu P2S

3D printer

WEARABLE / GPS

50× Waveshare AMOLED

+ GPS



TRACK 01  ·  AIoT · TUYA T5AI

See the world. Think in real time.

Tuya T5AI is a pocketable AI vision system — camera, AMOLED display, onboard inference. These 20 projects treat it as an “eye” that understands what it sees and acts on it.

20 / 50  ideas


_01   RecycleSense

Mount above a trash bin: the camera classifies whatever you hold up as recycle / compost / landfill, and LED indicators around the lid light up the correct compartment. Ship-ready with a tiny YOLO model.

TUYA T5AI   AI VISION

_02   PlantMD

Point Tuya at a sick leaf: it names the disease (powdery mildew, leaf spot, nitrogen deficit) and prescribes a fix. Kaggle has ready-made datasets — train once, diagnose forever. Your houseplant's new GP.

TUYA T5AI   CLASSIFICATION

_03   CalorieCam

Photograph your meal, get calorie + macro estimates on the AMOLED. Weekend MVP: combine a food classifier with a USDA nutrition dictionary. Bonus: log every meal to a web dashboard.

TUYA T5AI   HEALTH

_04   SignSync

Real-time ASL-to-text translator. Camera watches hand gestures, AMOLED renders the English. Start with the 100 most common signs — still useful, still a demo that lands emotionally.

TUYA T5AI   ACCESSIBILITY

_05   DoseMate

Medication-recognition pill tracker for elderly care. Show a pill to the camera — it identifies by shape & color, confirms correct dose + time, alerts a caregiver dashboard if skipped.

TUYA T5AI   HEALTHCARE

_06   PostureCoach

Desk camera watches your spine angle. Slouch for 30 seconds and it gently escalates — first a glyph on the display, then a chime, finally the AMOLED projects your sad, hunched silhouette.

TUYA T5AI   WELLNESS

_07   PetMood

Mounted near a pet bed: reads your cat or dog's facial/body cues and displays a live "mood" (anxious / content / hangry). Plays a matched soundscape and posts a daily mood report to your phone.

TUYA T5AI   FUN

_08   GymForm

Squat or deadlift in front of Tuya: it overlays a skeleton, flags rounded back or knee valgus in red on the screen, and plays an audio cue. Cheap personal trainer for anyone gym-shy.

TUYA T5AI   POSE ESTIMATION

_09   FacePass

Smart doorbell for shared houses: recognizes roommates, lets them in with a warm greeting on the AMOLED; strangers get "who are you here for?" and their photo relayed to the right person.

TUYA T5AI   FACE REC

_10   FridgeBrain

Mount inside a fridge: identifies what's in there by opening the door, cross-references with recipe APIs, and suggests tonight's dinner based on what's nearest expiry. Finally, no more forgotten cilantro.

TUYA T5AI   SUSTAINABILITY

_11   FocusShield

Study-mode camera watches your desk. Pick up your phone → the Tuya screen bursts into a red "NO" GIF and logs a distraction-event to your Pomodoro timer. Shame-as-a-service, opt-in.

TUYA T5AI   PRODUCTIVITY

_12   WhiteboardSnap

Aim Tuya at your whiteboard, tap the touchscreen. It rectifies perspective, OCRs handwriting, turns diagrams into structured markdown + Mermaid, and posts the note to Notion. Every meeting's new savior.

TUYA T5AI   OCR

_13   EmotiPet

Tuya becomes a desktop AI companion with an animated face on the AMOLED. It watches your expression with the camera and mirrors it, asks "rough day?" when you frown, celebrates when you smile.

TUYA T5AI   EMOTION AI

_14   ReadAlong

Accessibility reader for low-vision users. Hold any book, menu, or prescription up to the camera — Tuya OCRs it and speaks it through the attached speaker. Offline-first, privacy-safe.

TUYA T5AI   ACCESSIBILITY

_15   DreamLog

Bedside Tuya detects eye-open within 60s of waking and prompts you to immediately voice-record your dream — before it evaporates. Transcribes to a private journal, clusters recurring themes weekly.

TUYA T5AI   WELLNESS

_16   ArtMentor

Show a sketch to Tuya, it gives specific Bob-Ross-style feedback: "Lovely value range — try pushing the shadows darker here." Scores composition, proportion, and contrast. Great for art students who crave fast critique.

TUYA T5AI   LLM + VISION

_17   MoodMirror

A small framed object on your desk. Tuya quietly reads your facial affect every few minutes and shifts a full-screen ambient gradient — warm oranges when you're focused-happy, cool blues when you're drained. Your aura, externalized.

TUYA T5AI   AMBIENT

_18   DriverAlert

Dashboard-mounted Tuya watches the driver's eyes. Blink rate + head nod → drowsiness score. Hits threshold, speaker blasts rude wakeup audio and AMOLED flashes. Real impact: falling asleep kills.

TUYA T5AI   SAFETY

_19   TongueTeach

Language-learning tutor: camera watches your mouth shape while you speak a Mandarin or Spanish phrase. Compares to native-speaker mouth positions, highlights where your tongue/lips miss. A speech therapist in a matchbox.

TUYA T5AI   EDTECH

_20   WardrobeAI

Closet-mounted Tuya: stand in front of the mirror, it classifies your outfit and scores color harmony + formality + weather-appropriateness. Pulls today's forecast. Keeps your worst combos off LinkedIn.

TUYA T5AI   LIFESTYLE


TRACK 02  ·  ROBOTICS · AGILEX PIPER

Hands that think.

The Piper is a 6-DoF arm with a gripper and open ROS/Python APIs. These 15 projects turn it into a teammate, a rival, or a performer. Pair it with a webcam or a Tuya board for vision.

15 / 50  ideas


_21   KnightMoves

Piper plays full chess against a human. Overhead camera reads the board state, Stockfish picks the move, arm lifts and places the piece. Classic hackathon showstopper — and surprisingly doable with aruco markers.

PIPER ARM   VISION

_22   BaristaBot

Piper holds a milk pitcher and free-pours latte art. Pre-program a rosetta or a heart trajectory; advanced teams close the loop with vision reading the crema pattern mid-pour. Caffeinated judges will love you.

PIPER ARM   CROWD-PLEASER

_23   JengaMaster

Piper plays Jenga — with vision estimating which blocks are loosest. A force-sensing trick (compliant pull, back off on resistance) makes it feel genuinely thoughtful. Extra points: it trash-talks between turns.

PIPER ARM   PRECISION

_24   PortraitBot

Piper draws your portrait in 90 seconds. Webcam captures → edge-detect + simplify → G-code path → arm holds a pen. Each attendee leaves with a signed robot-drawn portrait. Instant Instagram bait.

PIPER ARM   CREATIVE

_25   OrigamiArm

Piper folds origami — start with a crane or a frog. Uses a table-top suction tool and a folding edge. Hard-coded trajectory is fine for MVP; demo impact is 10/10 when the arm gifts the crane to a judge.

PIPER ARM   DELICATE

_26   MagicCards

Piper performs the "three-card monte" or a pick-a-card trick. Arm shuffles, invites audience member to pick, "magically" finds it (vision sees the card, arm mimes reading minds). Pure theater.

PIPER ARM   PERFORMANCE

_27   CubeCracker

The classic: Piper solves a Rubik's cube. Vision reads all six sides, Kociemba's algorithm computes the solution, arm executes. Sub-minute solve is achievable in a weekend with the right gripper jig.

PIPER ARM   ALGORITHMIC

_28   DanceMirror

Stand in front of a camera and wave: Piper mirrors your arm motion in real-time. Gateway demo for teleoperation, and a mesmerizing way to feel how close Physical AI is to ready. Scales to dance choreography.

PIPER ARM   TELEOP

_29   HugDispenser

Tuya reads your face. Detected sadness → Piper gently hands you a plushie from a stack. Detected rage → Piper offers you a stress ball. Detected joy → confetti popper. Emotion-triggered kindness machine.

PIPER ARM   + TUYA

_30   ConductorArm

Piper becomes an orchestra conductor, its gestures driving a MIDI track tempo + dynamics in real-time. Wave a real baton — the arm mirrors, the music follows. Mesmerizing, and a nice on-ramp to motion capture.

PIPER ARM   MUSIC

_31   BrickSorter

Dump a bucket of Lego on the table — Piper + vision sorts by color and size into compartments. Every parent's dream. Every startup's "industrial pick-and-place" demo, but cuter.

PIPER ARM   PICK & PLACE

_32   DartBot

Piper throws darts. Vision detects the board, PID loop calibrates the throw, bullseye within 5 attempts. Competitive mode: challenge a human. Dangerous mode: put a balloon on the judges' table.

PIPER ARM   DYNAMIC

_33   SushiPlate

Piper plates sushi — picks nigiri from a tray, arranges aesthetically on a serving plate, garnishes with ginger. Vision ensures plating looks good (symmetry, color balance). Demo ends with judges eating the sushi.

PIPER ARM   F&B

_34   ClawKing

Piper becomes the operator of a classic claw machine — but with computer vision to always win. Teach it to lose gracefully X% of the time for ethical arcade physics. Bonus: let attendees challenge it.

PIPER ARM   ARCADE

_35   RockPaperBot

Piper plays rock-paper-scissors against you — but it cheats. Uses the Tuya camera to detect which gesture your hand is forming in the last 50 ms, then "picks" the winning move. Unbeatable, hilarious, great party piece.

PIPER ARM   + TUYA


TRACK 03  ·  HYBRID · TUYA + PIPER

Eyes wired to hands.

The ambitious path: combine Tuya vision with Piper actuation. These 10 projects are closed-loop systems — see, decide, move. Each one is a tiny slice of “Physical AI” as it'll actually look in production.

10 / 50  ideas


_36   AutoUnloader

Tuya watches the Bambu P2S build plate. Print finishes → Piper removes the part, drops it in a bin, clears the plate, and triggers the next print in the queue. Five printers running 24/7 with no human touch. Farm-ready.

PIPER   TUYA   BAMBU

_37   RecycleLine

Tuya classifies each item on a conveyor (plastic / glass / metal / compost / landfill). Piper picks and sorts into five bins. A weekend-scale Amp Robotics demo — which is a billion-dollar company.

PIPER   TUYA   INDUSTRIAL

_38   PipetteAssist

Piper holds a pipette and dispenses reagents. Tuya monitors the reaction tubes and detects color change (litmus / titration endpoint). Auto-halt, auto-log. Garage biolab automation — actually useful for real wet labs.

PIPER   TUYA   BIOTECH

_39   PlateMaster

Tuya watches a plate of food, notices what's missing (needs more green? lacks garnish?). Piper reaches into component bowls and adds the missing element. The hackathon ends with judges eating robot-plated small bites.

PIPER   TUYA   CULINARY

_40   MemoryChallenge

Piper arranges 5 random objects in a sequence, user memorizes, objects are covered. User recites the order; Tuya listens, scores, awards points. A "Simon" game for the physical world. Dementia-screening potential.

PIPER   TUYA   GAME

_41   BlockBuilder

Build any structure out of wooden blocks; Tuya scans it from above + side, builds a 3D map; Piper reconstructs the exact structure from a fresh pile of blocks. Physical "copy-paste." A taste of simulated-to-real.

PIPER   TUYA   3D

_42   AutoWrap

Tuya measures a gift box; Piper wraps it with paper and a ribbon. Yes, really. Corners are the hard part — cheat the design with a one-sheet fold trick. Retail stores and holiday pop-ups want this now.

PIPER   TUYA   RETAIL

_43   DrinkRobo

Speak a drink order. Tuya confirms the right glass is on the station. Piper picks bottles, measures pours, stirs. Full order-to-cocktail loop. Great at parties. Great for investors. Great for TikTok.

PIPER   TUYA   VOICE

_44   FarmHand

Little mock orchard. Tuya checks fruit color — ripe or not? Piper picks only the ripe ones, places in a basket. Micro-scale version of the $20B agri-robotics thesis (Tevel, Abundant Robotics).

PIPER   TUYA   AGTECH

_45   PitchDoctor

Practice your startup pitch in front of Tuya. It tracks filler words, eye contact, confidence via voice tone. After your rehearsal, Piper hands you a card — green (you're ready) or red (do it again). Self-coaching.

PIPER   TUYA   META


TRACK 04  ·  PLAYFUL / SOCIAL

Make the room feel it.

The last 5 are spectacle and social-layer ideas — pieces that turn the whole hackathon venue into the demo. Perfect for teams who want their project to live in the lobby, not at a judging table.

5 / 50  ideas


_46   BadgeNet

Tuya worn as a smart name-badge. Face-to-face with another attendee → it reads their badge, shows a conversation starter from their LinkedIn headline on your AMOLED. Networking, de-awkwardened.

TUYA T5AI   WEARABLE

_47   ARBooth

Tuya at the lobby: live camera feed with AR overlays — cat ears, sunglasses, 3D dragon on your shoulder. Snap a photo with touch gesture, auto-posts to hackathon LinkedIn channel. Social-media marketing machine.

TUYA T5AI   CROWD

_48   VoteStation

During pitch finals, every audience member holds up a thumbs-up, thumbs-down, or fist. Distributed Tuyas around the room aggregate live-vote counts to a giant projected bar chart. Democratized judging.

TUYA T5AI   LIVE EVENT

_49   BlinkArt

A framed "painting" in the venue. Tuya camera behind a pinhole. When a visitor approaches → the painted face on the AMOLED opens its eyes and tracks them. Slow smile when they wave. Creepy-good installation art.

TUYA T5AI   INSTALLATION

_50   VibeCheck

A giant dashboard on the main screen, fed by 10 Tuyas distributed around the venue. Aggregates facial affect into a live "Room Energy" meter — excited, focused, flagging. Opens and closes the event, reminds organizers when participants need coffee.

TUYA T5AI   DISTRIBUTED


> HACKSTORM 2.0  ·  PHYSICAL OPENCLAW

50 ideas  ·  4 tracks  ·  1 weekend

May 22–24, 2026  ·  Frontier Tower, San Francisco


 
 
 

Recent Posts

See All
[Beginners Guide] HTTP Client POST

Going through this doc, you will learn how to connect Wifi, add LVGL components and handle HTTP request and response. This document provides detailed instructions on how to run the http_client_postpro

 
 
 
1.9 HackStorm All-In-One

What to build Any thing as long as you use Tuya Dev Board What to submit A slide deck Introduction of your project (For the 5-min pitch) A video 3-minute demonstration video Git repo A link to your gi

 
 
 

Comments


Sponsorship & Support

HackStorm

team@HackStorm.ai

© 2025 by HackStorm.ai

 

bottom of page