When Your AI Tool Forgets to Ask

A solo salesperson built an AI call recorder that works perfectly as software and fails completely as a governed system. A personal creed would have changed the design.

Share this article

A salesperson with no coding experience built a Chrome extension using Claude Code. It connects to Twilio, records every sales call, transcribes the audio, and feeds the transcripts to Claude for analysis. After each day of 40-50 calls, they ask Claude to review their performance: what improved, what to change, what patterns emerge. They closed two sales in their first month with zero prior experience.

The tool works. The problem is what it doesn't do.

It doesn't ask the other person whether they consent to being recorded. It doesn't check whether the call crosses into a two-party consent jurisdiction. It doesn't disclose that an AI will analyze the conversation. It doesn't set limits on how long recordings are retained or who can access them.

The builder wasn't trying to build surveillance infrastructure. They wanted to improve at sales. But a tool without stated values defaults to the path of least friction, and the path of least friction usually ignores everyone else's rights.

The legal exposure is concrete

In the US, eleven states require all-party consent for call recording: California, Florida, Illinois, Maryland, Massachusetts, Michigan, Montana, New Hampshire, Oregon, Pennsylvania, and Washington. The EU requires explicit informed consent under GDPR Article 6. Canada's PIPEDA requires consent for collection of personal information. Violating these isn't a theoretical risk. It's a statutory one, with penalties ranging from civil damages to criminal charges.

The builder probably doesn't know which states their prospects are in. Twilio provides caller ID, but caller ID doesn't tell you jurisdiction. A prospect with a 212 area code (New York, one-party consent) might be sitting in their California office (two-party consent). The tool makes no distinction.

What a creed would change

A creed is a statement of values that informs how a tool gets designed. It's a declaration of what the builder believes about consent, transparency, and data handling, translated into design requirements.

If the creed says "I value informed consent," the tool needs a mechanism to verify consent before recording begins. That's an architecture decision: the Twilio integration needs a consent prompt before the call connects, or a pre-call disclosure message, or at minimum a recorded verbal consent check. About 30 lines of code. The builder never wrote them because nobody asked the question.

If the creed says "I value jurisdictional compliance," the tool needs to know where the other party is located. That's a feature requirement: caller ID lookup, jurisdiction mapping, different behavior in one-party vs two-party consent states. A lookup table and a conditional. The builder never built it because the question never arose.

If the creed says "I value data minimization," the tool needs retention limits. Transcripts get deleted after 90 days. Raw audio gets deleted after analysis. The builder decides these limits based on their values, not based on whatever the default happens to be (which is "keep everything forever").

If the creed says "I value transparency," the tool needs disclosure. The other party knows the call may be recorded and analyzed. This isn't just legal protection. It's a relationship decision. The builder is choosing to be honest with the people they're selling to.

The gap isn't technical

None of these features are difficult to implement. They're about 200 lines of code in a tool that probably has 2000. The hard part isn't implementation. It's that the builder never thought to ask these questions.

That's the gap a personal creed fills. Before you build, you declare what you value. Then your values shape what gets built. The creed makes the questions unavoidable.

The cold call recorder is a good tool built by someone trying to learn a skill. With a creed, it becomes a good tool that also respects the people on the other end of the line. The code difference is trivial. The design difference is everything.

First in a series on tools built without creeds. Create your own personal creed →

Nell Watson
Founder, Creed Space

AI ethics researcher and IEEE Fellow. Author of Taming the Machine.