for partners and developers

Tech docs & status

What StrayWatch is built from, what works today, what doesn't yet, and what comes next. Source code: github.com/meenakshisatpathy20-del/straywatch. Demo video: watch it here.

Architecture

every input becomes one case; every agent works from one ledger
Inputs
πŸ“± StrayWatch app (installable PWA)
πŸ’¬ WhatsApp add-on
πŸŽ₯ Camera agent (YOLOv8 at the edge)
🩺 Vet consults
Agent Room (FastAPI)
Channel adapters β†’ one event format
πŸ” Triage🐾 IdentifyπŸ“£ Dispatch⏱️ WatchπŸŽ₯ CameraπŸ“ˆ Hotspot
βš–οΈ Urgency rules (unit-tested code)
πŸ—‚οΈ Case ledger Β· Postgres (SQLite locally)
🧠 Model gateway · BharatCode API: qwen3.5-397b (vision), gemma-4-31b-it
Outputs
🚨 Responder alerts (in their language)
πŸ”— Reporter tracking link
πŸ™οΈ City dashboard + hotspots
πŸͺ§ Signboard feed

What works today

honest status, Nov 2026
FeatureStatusNotes
Citizen reporting (photo, words or a typed landmark)WorkingNo sign-up; GPS blocked β†’ landmark confirmed on the map; offline queue; photos shrunk on the phone
6 languages end to endWorkingEnglish, Hindi, Bengali, Tamil, Telugu, Marathi: app labels, chat, rules (words in each script), tracking page, posters; pre-translated fixed messages
Triage + Identify agentsWorkingVision LLM, strict JSON validated field by field; caretaker first at 95%+
Urgency rules: URGENT / NEEDS CARE / NO CASEWorkingHurt on the road = URGENT; healthy animals are never dispatched; unit-tested
Right-team routingWorkingCaretaker β†’ rescue NGO β†’ vet β†’ municipal team (cows, dead animals) β†’ police on busy roads β†’ volunteers (sample teams)
Watch agent + duty coordinatorWorking3 min (HIGH) / 10 min (CHECK) per hop; reporter updated each hop
Photo-proof closingWorkingAI checks the proof photo shows the animal safe; reporter sees it
Case ledger, Agent Room, tracking linkWorkingEvery hand-off recorded and replayable
Camera agent β†’ casesWorking on recorded videoYOLOv8n + ByteTrack: alerts only for an animal lying in a lane; healthy animals ignored
Hotspot agent + signboard feedWorkingWhere animals keep getting hurt, by road and hour; driver warnings while an injured animal is on the road
Lost & FoundWorkingSearches past and future sightings nearby
WhatsApp add-onBuiltTested with simulated webhooks; waiting on Meta verification
Vet Care: online verified vetsWorkingAI pre-check + reviewed care card, emergencies to 1962/clinic, live translated chat, video link, vet's note, follow-up; vet sign-up + verification
Rescuer toolsWorkingPrivate reporter–rescuer chat, open cases near me, transport requests, animal hospitals near the spot; new helpers approved by a coordinator
Vet appointmentsWorkingVideo or clinic slots for the week, no double-booking, vet notified in chat, booking page with video link, owner can cancel
Food & nutrition shopPilotServer-priced catalogue, cart, pay on delivery, street-dog feeding packs to volunteer feeders; confirmed by phone (no online payment yet)
Phone notificationsWorkingWeb Push to responders and reporters with the app closed
Map viewWorkingCases, injury hotspots, cameras; locations rounded to ~1 km
SMS / IVR, TelegramPlannedSame channel adapter
Payments for paid pet consultsPlannedFree during the pilot; UPI later
Redis event bus, PostGISPlanned for scaleToday: in-process events, bounding box + haversine distance

Measured

~2–3 sTriage agent reads a photo + message
11/11animals re-identified among look-alikes, ~1.2 s each (edited copies of photos)
~10 sreport β†’ caretaker alerted, on the free live server
35 msCamera agent per frame on a 4-core CPU
0wrong-city or beyond-8 km alerts in a 1,238-report, two-city load test
78automated tests, run in GitHub Actions

Limitations

what we're careful not to claim

What comes next

  1. 1Real partners

    An NGO, the municipal team and 3–5 vets in two Ranchi wards; vet cards reviewed by a partner vet.

  2. 2Ranchi pilot

    3 months, with hotspot cameras via the Smart City ICCC. Measure time to help and repeat injuries.

  3. 3More channels

    WhatsApp live (Meta verification), then SMS / missed-call for feature phones.

  4. 4Scale

    A new city is configuration: responders, vets, ward boundaries, languages.

API

EndpointWhat it does
POST /api/chatOne chat turn (text, button, photo or location). The app and website demo use it.
POST /api/agents/camera/eventsEdge Camera agent event (X-Agent-Key). Opens or merges a case.
GET /api/roomAgent Room board: recent cases and agent activity.
GET /api/signboardsDriver warnings for display boards near cameras.
GET /api/mapMap layers (rounded to ~1 km).
POST /vet/join Β· /admin/vetsVet sign-up, and registration checks (admin key).
GET /api/vet/slots Β· POST /vet/bookFree 30-minute slots for a vet and day; book one (a taken slot returns 409).
POST /api/shop/order Β· /admin/ordersPlace a food order (priced on the server); orders and bookings to confirm by phone (admin key).
POST /webhook/whatsappWhatsApp Cloud API webhook (signature checked).
GET /track/SW-n?k=…The reporter's private tracking page.
pip install -r requirements.txt
export ADAPTION_API_KEY=...          # BharatCode model API
uvicorn app.main:app --reload        # http://localhost:8000
python -m pytest -q tests            # offline tests with a stand-in AI