Hi, I built https://thriftyllm.com - I am a 20+ years Enterprise sales / MarTech guy that started using Replit seriously. I also completed my BSI ISO/IEC 42001 Lead Implementer cert - which means I can put together the plan for responsible AIMS for regulated enterprises. In the meantime, I also built the above - this uses both Deterministic and Semantic caching to reduce Token costs and I have also built this as a model-agnostic middleware. Will be monetizing this and am looking for Beta users - if you are feeling the pinch of high API costs, reach out to me! Happy building!
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| TokenPro: LLM Token Reseller Calculator with Profit Margin Analysis | 0 | 30 | January 18, 2025 | |
| View Usage easily in context while working on an app | 12 | 103 | October 10, 2025 | |
| TokenTracker - See your Replit project costs at a glance | 31 | 512 | March 3, 2026 | |
| Who is going to pay $5 or more per prompt!? | 75 | 1011 | September 28, 2025 | |
| Agent 3-va (variable autonomy): Add your feedback | 24 | 163 | September 23, 2025 |