Joseph Leporati

Engineering notes

Writing: privacy

Notes on building and running production systems: payments and ledgers, multi-tenant architecture, reliability and performance, and applied AI. By Joseph Leporati, software engineer and technical program manager in Monroe, Louisiana.

· 7 min read · ai

On-Device vs Cloud AI: Where Small Businesses Should Keep Customer Data

Keep customer records, scheduling data and stored chat transcripts in systems you control. Run identifier redaction and intent routing on a local model, and send only redacted, minimal context to a cloud LLM for the open-ended conversation. Do that under a contract that bars training on your data and sets retention limits. Running the model locally does not move liability: under FTC guidance and Louisiana breach law, protecting your customers' data is still your job.

Read the article