KOUNTER

Booting Hexagon NPU · 0 cloud calls

iQOO Hackathon 2026

KOUNTER

हर माल गिना हुआ · every item, counted

The iQOO 15 that counts every delivery, blocks expired sales, commands the freezer and answers in Hindi, also in Airplane Mode.

  • <300msdelivery audit
  • 0cloud calls
  • 12iQOO 15 hardware parts used
  • 14features, one counter
Scroll · the phone follows

01 · The problem

63M small businesses.
Five leaks. Every day.

Up to ₹0 lost per store, per month*
  1. 01
    Short deliveries

    Bill says 24 Maggi, 20 get unloaded. Nobody counts at 9 AM.

    ₹8–15k
  2. 02
    Stock that expires unseen

    Old packets get buried; the 30-day return window is missed.

    ₹5–10k
  3. 03
    Cold-chain spoilage

    Freezer setting drops, ice-cream melts, paneer turns.

    ₹3–6k
  4. 04
    Expired sale to a customer

    One bad packet undoes ten years of neighbourhood trust.

    Trust
  5. 05
    Apps that need typing

    English menus, barcodes, internet. Useless with 5 customers shouting.

    Time

It is not just corner shops. The same five leaks hit factory raw-material stores, godowns, wholesalers and pharmacies: short supplier deliveries, stock expiring on a shelf, and ledgers nobody has time to type.

*Monthly ranges from our shopkeeper research (see master.md §2). Estimates, not audited figures.

02 · Why only an iQOO 15

A shop audit needs sensors, not servers.

Kounter is not an app that happens to run on a phone. Every step of the workflow is anchored to a specific piece of iQOO 15 hardware, most of which ordinary phones, iPhones and laptops simply do not have.

  • 1
    50MP Ultra-wide · 119°

    1/2.76" sensor. The whole 1.5 m counter in one frame, 30 packets, no stitching.

  • 2
    50MP 3× Periscope telemacro

    Sony IMX882, 1/1.95". Reads faint dot-matrix expiry dates from 25 cm, without the phone's shadow.

  • 3
    50MP Sony IMX921 main

    1/1.56" sensor with iQOO's own OIS for sharp bill and challan photos in dim shop light.

  • 4
    Color Spectrum sensor + triple ambient light sensors

    Detects 50 Hz tube-light flicker and glare on foil packs before the shot.

Snapdragon 8 Elite Gen 5Supercomputing Chip Q3IR blasterNavIC7000 mAhFloating camera module

09:00 The distributor arrives

Tap. Stamp. Count.

Rajesh from the Nestlé distributor walks in with cartons. Ramesh doesn't type anything.

  1. NFC
    1-tap check-in

    Rajesh taps his ID card on the phone and the vendor ledger opens in <100 ms.

  2. NavIC
    Proof-of-delivery stamp

    India's own satellite system geo-tags the delivery; a SHA-256 hash makes it tamper-proof.

  3. Spectrum
    Kill the flicker

    Color Spectrum sensor locks 50 Hz anti-banding so foil packets don't blind the camera.

  4. UW 119°
    One wide photo

    Ultra-wide captures the entire counter in a single frame.

  5. YOLO11n
    Counted on the NPU

    INT8 detector on the Hexagon NPU counts 20 packets in ~22 ms.

09:01 The catch

Bill says 24.
Camera saw 20.

Bill quantity24PaddleOCR on-device
vs
Camera count20YOLO11n · 22 ms
Money to deduct on the spot ₹0 4 short × ₹14 = ₹56 · matched with Jaro-Winkler > 0.82

A sharp double-knock on the haptic motor tells Ramesh before the delivery boy leaves. Across 15 vendors a month, that is the ₹8–15k leak closed.

11:30 Ice-cream arrives

The phone talks to the freezer.

When dairy or ice-cream is logged, the iQOO 15's top-frame IR blaster fires a 38 kHz remote command and pushes the old deep-freezer into super-freeze. No smart plug, no Wi-Fi, the phone is the remote.

-12°C Voltas deep freezer
Waiting for IR…
// ConsumerIrManager · NEC 38 kHz
irManager.transmit(38000, SUPER_FREEZE)

16:00 Rush hour

Stop. That packet expired.

A customer picks an old packet from the back of the shelf. When it's scanned, the batch check fails and the phone physically rumbles for 500 ms on its dual-axis (X + Z) vibration motor while the screen turns red. In an 80 dB bazaar, a vibration in the hand beats a beep nobody hears.

Dual-axis X+Z motor3× telemacro date readSQLite batch registry
Zero loss: the app also reminds Ramesh to return near-expiry stock to the distributor inside the 30-day window for full credit.

19:30 Flour on his hands

Just ask. In Hindi.

Ramesh“Rajesh vendor ne kitna kam maal diya hai?”
Phone · loud“Rajesh vendor se 4 packet Maggi kam aaye the, kul ₹56 kaatne baaki hain.”

Whisper speech-to-text and the Laya intent model run on the NPU, turn the question into a fixed SQL query, and the answer is read out on the stereo speakers, a built-in shop soundbox. The language model only phrases facts from the database; it never invents numbers.

Beamforming micsStereo speakersWhisper STTLaya intent

All day Built for a real counter

Dusty hands. Power cuts. 12 hours.

3D UltrasonicMargins behind a fingerprint

Works through flour, oil and water, optical sensors don't.

7000 mAhSurvives outages

Full-day counter duty with a large vapour chamber keeping it cool.

IP68 / IP69Spill-proof

Milk, water and cleaning are part of the job.

SQLiteYour data stays in the shop

Every batch, vendor and rupee lives on the phone.

21:30 Green light phase

Phone meets laptop, iQOO Office Kit.

During the day the phone works alone. At closing, Office Kit mirrors a clean customer bill to a second screen (cost prices stay private on the phone) and pushes a reconciled Excel sheet to the laptop in one click.

Kounter_Audit_27Sep.xlsx
VendorItemBillGotDeduct
Rajesh (Nestlé)Maggi 70g2420−₹56
Rajesh (Nestlé)KitKat1212₹0
Sharma DairyAmul Paneer109−₹90
Parle AgencyParle-G 100g3636₹0
NavIC PoD ✓ · SHA-256 7f8a…21efSaved today ₹1,840

10 · Hardware synergy map

12 parts of the iQOO 15.
Each one has a job.

11 · Zero-cloud architecture

Pull the plug.
Nothing changes.

Five models share the Snapdragon 8 Elite Gen 5 NPU. No OpenAI, no AWS, no Firebase. Flip the switch.

CamerasUW 119° · 3× tele
NFC + NavICbadge · geostamp
MicsHindi / Hinglish
Light sensors50 Hz · CCT
Hexagon NPU Snapdragon 8 Elite Gen 5 + Supercomputing Chip Q3 for the 144 Hz HUD
Cloud API · 0 bytes sent
SQLite ledgerbatches · vendors
Haptics · IR · Speakersact in the shop
Office Kitlaptop · Excel
JobModelSizeRuntime
Packet countingYOLO11n~3 MB INT8Qualcomm QNN
Bill & date OCRPaddleOCR Mobile v4~8 MB INT8LiteRT
Hindi speech → textWhisper small/base~75 MB INT8Sherpa-ONNX
Intent & slotsLaya multilingual~150 MB INT8ONNX Runtime
Hindi reply phrasingBlueLM-1.5B class SLM~750 MB INT4llama.cpp

12 · Mapped to the finale criteria

Built for how the finale is judged.

Weights are our estimate from the published format (phone-first Red Light phase, Office Kit Green Light phase, live demo).

Phone-first execution & sensor depth~30%

12 hardware parts, each tied to one workflow step. Full demo runs in Airplane Mode on the phone alone.

On-device AI integration~25%

Five local models on the Hexagon NPU; the SLM phrases SQL facts, so no hallucinated rupees.

Office Kit cross-device~15%

Customer-facing bill mirror + private cashier HUD, 1-click Excel sync at closing.

Real-world relevance~15%

63M small businesses: shops, factory stores and godowns. Rupee-denominated savings, Hindi-first, designed for a 52-year-old shopkeeper.

Pitch & live demo~15%

Physical props: 20 real Maggi, a bill that says 24, an expired Parle-G, an NFC card and an IR LED that lights up on stage.

0:15Airplane Mode ON
0:40₹56 short caught
1:00IR LED lights up
1:25Phone rumbles, sale blocked
1:45Hindi answer, out loud
2:00Excel on the laptop

13 · Live prototype

Your turn. Tap the phone.

The screen on the right is the real Kounter prototype, not a video. Tap through it, or jump straight to a moment. Drag the phone's frame to turn it around.

Open prototype full screen ↗