50 Physical AI Project Ideas
- liangzn
- 3 days ago
- 9 min read
HACKSTORM 2.0 · VIBE CODING TO PHYSICAL AI · MAY 22–24, 2026
50 Physical AI Project Ideas
Shippable in 48 hours.
A curated brainstorm for HackStorm 2.0 participants. Every idea uses the Tuya T5AI Board, the AgileX Piper arm, or both — and is scoped for a weekend build with a demo-ready outcome. Inspired by recent hardware hackathons across Shenzhen and the Bay Area, with cross-pollination from software-native ideas that deserve a physical life.
AIOT HARDWARE 50× Tuya T5AI cam + AMOLED | ROBOTICS HARDWARE 10× AgileX Piper 6-DoF arm | FABRICATION 5× Bambu P2S 3D printer | WEARABLE / GPS 50× Waveshare AMOLED + GPS |
TRACK 01 · AIoT · TUYA T5AI See the world. Think in real time. Tuya T5AI is a pocketable AI vision system — camera, AMOLED display, onboard inference. These 20 projects treat it as an “eye” that understands what it sees and acts on it. | 20 / 50 ideas |
_01 RecycleSense Mount above a trash bin: the camera classifies whatever you hold up as recycle / compost / landfill, and LED indicators around the lid light up the correct compartment. Ship-ready with a tiny YOLO model. TUYA T5AI AI VISION |
_02 PlantMD Point Tuya at a sick leaf: it names the disease (powdery mildew, leaf spot, nitrogen deficit) and prescribes a fix. Kaggle has ready-made datasets — train once, diagnose forever. Your houseplant's new GP. TUYA T5AI CLASSIFICATION |
_03 CalorieCam Photograph your meal, get calorie + macro estimates on the AMOLED. Weekend MVP: combine a food classifier with a USDA nutrition dictionary. Bonus: log every meal to a web dashboard. TUYA T5AI HEALTH |
_04 SignSync Real-time ASL-to-text translator. Camera watches hand gestures, AMOLED renders the English. Start with the 100 most common signs — still useful, still a demo that lands emotionally. TUYA T5AI ACCESSIBILITY |
_05 DoseMate Medication-recognition pill tracker for elderly care. Show a pill to the camera — it identifies by shape & color, confirms correct dose + time, alerts a caregiver dashboard if skipped. TUYA T5AI HEALTHCARE |
_06 PostureCoach Desk camera watches your spine angle. Slouch for 30 seconds and it gently escalates — first a glyph on the display, then a chime, finally the AMOLED projects your sad, hunched silhouette. TUYA T5AI WELLNESS |
_07 PetMood Mounted near a pet bed: reads your cat or dog's facial/body cues and displays a live "mood" (anxious / content / hangry). Plays a matched soundscape and posts a daily mood report to your phone. TUYA T5AI FUN |
_08 GymForm Squat or deadlift in front of Tuya: it overlays a skeleton, flags rounded back or knee valgus in red on the screen, and plays an audio cue. Cheap personal trainer for anyone gym-shy. TUYA T5AI POSE ESTIMATION |
_09 FacePass Smart doorbell for shared houses: recognizes roommates, lets them in with a warm greeting on the AMOLED; strangers get "who are you here for?" and their photo relayed to the right person. TUYA T5AI FACE REC |
_10 FridgeBrain Mount inside a fridge: identifies what's in there by opening the door, cross-references with recipe APIs, and suggests tonight's dinner based on what's nearest expiry. Finally, no more forgotten cilantro. TUYA T5AI SUSTAINABILITY |
_11 FocusShield Study-mode camera watches your desk. Pick up your phone → the Tuya screen bursts into a red "NO" GIF and logs a distraction-event to your Pomodoro timer. Shame-as-a-service, opt-in. TUYA T5AI PRODUCTIVITY |
_12 WhiteboardSnap Aim Tuya at your whiteboard, tap the touchscreen. It rectifies perspective, OCRs handwriting, turns diagrams into structured markdown + Mermaid, and posts the note to Notion. Every meeting's new savior. TUYA T5AI OCR |
_13 EmotiPet Tuya becomes a desktop AI companion with an animated face on the AMOLED. It watches your expression with the camera and mirrors it, asks "rough day?" when you frown, celebrates when you smile. TUYA T5AI EMOTION AI |
_14 ReadAlong Accessibility reader for low-vision users. Hold any book, menu, or prescription up to the camera — Tuya OCRs it and speaks it through the attached speaker. Offline-first, privacy-safe. TUYA T5AI ACCESSIBILITY |
_15 DreamLog Bedside Tuya detects eye-open within 60s of waking and prompts you to immediately voice-record your dream — before it evaporates. Transcribes to a private journal, clusters recurring themes weekly. TUYA T5AI WELLNESS |
_16 ArtMentor Show a sketch to Tuya, it gives specific Bob-Ross-style feedback: "Lovely value range — try pushing the shadows darker here." Scores composition, proportion, and contrast. Great for art students who crave fast critique. TUYA T5AI LLM + VISION |
_17 MoodMirror A small framed object on your desk. Tuya quietly reads your facial affect every few minutes and shifts a full-screen ambient gradient — warm oranges when you're focused-happy, cool blues when you're drained. Your aura, externalized. TUYA T5AI AMBIENT |
_18 DriverAlert Dashboard-mounted Tuya watches the driver's eyes. Blink rate + head nod → drowsiness score. Hits threshold, speaker blasts rude wakeup audio and AMOLED flashes. Real impact: falling asleep kills. TUYA T5AI SAFETY |
_19 TongueTeach Language-learning tutor: camera watches your mouth shape while you speak a Mandarin or Spanish phrase. Compares to native-speaker mouth positions, highlights where your tongue/lips miss. A speech therapist in a matchbox. TUYA T5AI EDTECH |
_20 WardrobeAI Closet-mounted Tuya: stand in front of the mirror, it classifies your outfit and scores color harmony + formality + weather-appropriateness. Pulls today's forecast. Keeps your worst combos off LinkedIn. TUYA T5AI LIFESTYLE |
TRACK 02 · ROBOTICS · AGILEX PIPER Hands that think. The Piper is a 6-DoF arm with a gripper and open ROS/Python APIs. These 15 projects turn it into a teammate, a rival, or a performer. Pair it with a webcam or a Tuya board for vision. | 15 / 50 ideas |
_21 KnightMoves Piper plays full chess against a human. Overhead camera reads the board state, Stockfish picks the move, arm lifts and places the piece. Classic hackathon showstopper — and surprisingly doable with aruco markers. PIPER ARM VISION |
_22 BaristaBot Piper holds a milk pitcher and free-pours latte art. Pre-program a rosetta or a heart trajectory; advanced teams close the loop with vision reading the crema pattern mid-pour. Caffeinated judges will love you. PIPER ARM CROWD-PLEASER |
_23 JengaMaster Piper plays Jenga — with vision estimating which blocks are loosest. A force-sensing trick (compliant pull, back off on resistance) makes it feel genuinely thoughtful. Extra points: it trash-talks between turns. PIPER ARM PRECISION |
_24 PortraitBot Piper draws your portrait in 90 seconds. Webcam captures → edge-detect + simplify → G-code path → arm holds a pen. Each attendee leaves with a signed robot-drawn portrait. Instant Instagram bait. PIPER ARM CREATIVE |
_25 OrigamiArm Piper folds origami — start with a crane or a frog. Uses a table-top suction tool and a folding edge. Hard-coded trajectory is fine for MVP; demo impact is 10/10 when the arm gifts the crane to a judge. PIPER ARM DELICATE |
_26 MagicCards Piper performs the "three-card monte" or a pick-a-card trick. Arm shuffles, invites audience member to pick, "magically" finds it (vision sees the card, arm mimes reading minds). Pure theater. PIPER ARM PERFORMANCE |
_27 CubeCracker The classic: Piper solves a Rubik's cube. Vision reads all six sides, Kociemba's algorithm computes the solution, arm executes. Sub-minute solve is achievable in a weekend with the right gripper jig. PIPER ARM ALGORITHMIC |
_28 DanceMirror Stand in front of a camera and wave: Piper mirrors your arm motion in real-time. Gateway demo for teleoperation, and a mesmerizing way to feel how close Physical AI is to ready. Scales to dance choreography. PIPER ARM TELEOP |
_29 HugDispenser Tuya reads your face. Detected sadness → Piper gently hands you a plushie from a stack. Detected rage → Piper offers you a stress ball. Detected joy → confetti popper. Emotion-triggered kindness machine. PIPER ARM + TUYA |
_30 ConductorArm Piper becomes an orchestra conductor, its gestures driving a MIDI track tempo + dynamics in real-time. Wave a real baton — the arm mirrors, the music follows. Mesmerizing, and a nice on-ramp to motion capture. PIPER ARM MUSIC |
_31 BrickSorter Dump a bucket of Lego on the table — Piper + vision sorts by color and size into compartments. Every parent's dream. Every startup's "industrial pick-and-place" demo, but cuter. PIPER ARM PICK & PLACE |
_32 DartBot Piper throws darts. Vision detects the board, PID loop calibrates the throw, bullseye within 5 attempts. Competitive mode: challenge a human. Dangerous mode: put a balloon on the judges' table. PIPER ARM DYNAMIC |
_33 SushiPlate Piper plates sushi — picks nigiri from a tray, arranges aesthetically on a serving plate, garnishes with ginger. Vision ensures plating looks good (symmetry, color balance). Demo ends with judges eating the sushi. PIPER ARM F&B |
_34 ClawKing Piper becomes the operator of a classic claw machine — but with computer vision to always win. Teach it to lose gracefully X% of the time for ethical arcade physics. Bonus: let attendees challenge it. PIPER ARM ARCADE |
_35 RockPaperBot Piper plays rock-paper-scissors against you — but it cheats. Uses the Tuya camera to detect which gesture your hand is forming in the last 50 ms, then "picks" the winning move. Unbeatable, hilarious, great party piece. PIPER ARM + TUYA |
TRACK 03 · HYBRID · TUYA + PIPER Eyes wired to hands. The ambitious path: combine Tuya vision with Piper actuation. These 10 projects are closed-loop systems — see, decide, move. Each one is a tiny slice of “Physical AI” as it'll actually look in production. | 10 / 50 ideas |
_36 AutoUnloader Tuya watches the Bambu P2S build plate. Print finishes → Piper removes the part, drops it in a bin, clears the plate, and triggers the next print in the queue. Five printers running 24/7 with no human touch. Farm-ready. PIPER TUYA BAMBU |
_37 RecycleLine Tuya classifies each item on a conveyor (plastic / glass / metal / compost / landfill). Piper picks and sorts into five bins. A weekend-scale Amp Robotics demo — which is a billion-dollar company. PIPER TUYA INDUSTRIAL |
_38 PipetteAssist Piper holds a pipette and dispenses reagents. Tuya monitors the reaction tubes and detects color change (litmus / titration endpoint). Auto-halt, auto-log. Garage biolab automation — actually useful for real wet labs. PIPER TUYA BIOTECH |
_39 PlateMaster Tuya watches a plate of food, notices what's missing (needs more green? lacks garnish?). Piper reaches into component bowls and adds the missing element. The hackathon ends with judges eating robot-plated small bites. PIPER TUYA CULINARY |
_40 MemoryChallenge Piper arranges 5 random objects in a sequence, user memorizes, objects are covered. User recites the order; Tuya listens, scores, awards points. A "Simon" game for the physical world. Dementia-screening potential. PIPER TUYA GAME |
_41 BlockBuilder Build any structure out of wooden blocks; Tuya scans it from above + side, builds a 3D map; Piper reconstructs the exact structure from a fresh pile of blocks. Physical "copy-paste." A taste of simulated-to-real. PIPER TUYA 3D |
_42 AutoWrap Tuya measures a gift box; Piper wraps it with paper and a ribbon. Yes, really. Corners are the hard part — cheat the design with a one-sheet fold trick. Retail stores and holiday pop-ups want this now. PIPER TUYA RETAIL |
_43 DrinkRobo Speak a drink order. Tuya confirms the right glass is on the station. Piper picks bottles, measures pours, stirs. Full order-to-cocktail loop. Great at parties. Great for investors. Great for TikTok. PIPER TUYA VOICE |
_44 FarmHand Little mock orchard. Tuya checks fruit color — ripe or not? Piper picks only the ripe ones, places in a basket. Micro-scale version of the $20B agri-robotics thesis (Tevel, Abundant Robotics). PIPER TUYA AGTECH |
_45 PitchDoctor Practice your startup pitch in front of Tuya. It tracks filler words, eye contact, confidence via voice tone. After your rehearsal, Piper hands you a card — green (you're ready) or red (do it again). Self-coaching. PIPER TUYA META |
TRACK 04 · PLAYFUL / SOCIAL Make the room feel it. The last 5 are spectacle and social-layer ideas — pieces that turn the whole hackathon venue into the demo. Perfect for teams who want their project to live in the lobby, not at a judging table. | 5 / 50 ideas |
_46 BadgeNet Tuya worn as a smart name-badge. Face-to-face with another attendee → it reads their badge, shows a conversation starter from their LinkedIn headline on your AMOLED. Networking, de-awkwardened. TUYA T5AI WEARABLE |
_47 ARBooth Tuya at the lobby: live camera feed with AR overlays — cat ears, sunglasses, 3D dragon on your shoulder. Snap a photo with touch gesture, auto-posts to hackathon LinkedIn channel. Social-media marketing machine. TUYA T5AI CROWD |
_48 VoteStation During pitch finals, every audience member holds up a thumbs-up, thumbs-down, or fist. Distributed Tuyas around the room aggregate live-vote counts to a giant projected bar chart. Democratized judging. TUYA T5AI LIVE EVENT |
_49 BlinkArt A framed "painting" in the venue. Tuya camera behind a pinhole. When a visitor approaches → the painted face on the AMOLED opens its eyes and tracks them. Slow smile when they wave. Creepy-good installation art. TUYA T5AI INSTALLATION |
_50 VibeCheck A giant dashboard on the main screen, fed by 10 Tuyas distributed around the venue. Aggregates facial affect into a live "Room Energy" meter — excited, focused, flagging. Opens and closes the event, reminds organizers when participants need coffee. TUYA T5AI DISTRIBUTED |
> HACKSTORM 2.0 · PHYSICAL OPENCLAW
50 ideas · 4 tracks · 1 weekend
May 22–24, 2026 · Frontier Tower, San Francisco
Comments