gitwtfhub

wtf is locallysells-voice-search?

rohitmujumdar/locallysells-voice-search — explained in plain English

Analysis updated 2026-05-18

0PythonAudience · developerComplexity · 4/5Setup · hard

TL;DR

A voice agent that lets callers order tobacco and nicotine products from LocallySells by describing what they want in natural, everyday language.

Mindmap

mindmap
  root((locallysells-voice-search))
    What it does
      Voice search by meaning
      Voice ordering
      Refuses underage callers
    Tech stack
      Vapi voice layer
      Nebius LLM and embeddings
      Insforge edge function
    Use cases
      Phone in product search
      Place delivery order
      Learn voice agent design
    Audience
      Developers
      Hackathon builders
    Quality
      Automated eval suites
      Simulated caller personas

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Let customers call in and describe a product vaguely, then get matched to the closest real item in the catalog.

REASON 2

Place a phone order for tobacco or nicotine products and hear the order number and delivery estimate read back.

REASON 3

Study a working example of combining a voice platform, an LLM brain, and a serverless search backend.

What's in the stack?

PythonVapiNebiusInsforge

How it stacks up

rohitmujumdar/locallysells-voice-search0xallam/my-recipe0xhassaan/nn-from-scratch
Stars00
LanguagePythonPythonPython
Last pushed2022-11-22
MaintenanceDormant
Setup difficultyhardmoderatemoderate
Complexity4/52/54/5
Audiencedevelopergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1h+

Needs separate accounts and API keys for Vapi, Nebius, and Insforge before a call can be tested.

Wtf does this do

This project is a voice search and voice ordering assistant built for LocallySells, an online marketplace that delivers tobacco and nicotine products locally. It was created during a hackathon called the Multimodal Midsummer Hackathon, and it lets a caller phone in, describe what they want in plain conversational language, and have the system find matching products and place an order. The core idea is understanding meaning rather than exact keywords. If someone says they want something minty and refreshing, the system can match that description to a specific product like a mint flavored vape, even if the caller never says the brand name. It does this using semantic search: each product in a 198 item catalog has been converted into a numerical representation ahead of time, and when a caller speaks, their words are converted the same way so the system can compare and rank the closest matches. A keyword check is layered on top so that when someone names an exact brand, that brand still comes out on top. Three separate services work together to make a phone call happen: one handles the live voice conversation, turning speech into text and back into speech, a second acts as the reasoning brain that decides whether the caller wants to search for a product or place an order, and a third hosts the actual search and ordering logic as a small serverless function, along with the product catalog and its embeddings. The system includes safety rules: it will not serve anyone who indicates they are under 21, it will not invent products or prices that are not in the catalog, and it avoids giving medical advice. The project also includes automated test suites that simulate callers with different speaking styles, checking that the assistant handles vague requests, misremembered product names, and multi step orders correctly, rather than relying on manual spot checks. The repository includes Python scripts for building and deploying the function, precomputing embeddings, and setting up the voice assistant, along with documentation describing how a call flows through the system. There is no license mentioned in the README.

Yoink these prompts

Prompt 1
Walk me through how the search_products tool ranks products by meaning instead of exact keywords.
Prompt 2
Explain how this repo wires together Vapi, Nebius, and Insforge to handle a single phone call.
Prompt 3
Show me how the 21 and over age check is enforced in this codebase.
Prompt 4
Help me adapt this voice ordering setup to a different product catalog.

Frequently asked questions

wtf is locallysells-voice-search?

A voice agent that lets callers order tobacco and nicotine products from LocallySells by describing what they want in natural, everyday language.

What language is locallysells-voice-search written in?

Mainly Python. The stack also includes Python, Vapi, Nebius.

How hard is locallysells-voice-search to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is locallysells-voice-search for?

Mainly developer.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.