@anandsunny08992
Sunny AnandFounder▲7
CEO, founder@nexus-gateway.org
Oct 20 · AI Engineering, Infra, Introductions · Bhagalpur

Building Nexus Gateway: High-Performance AI Middleware in Go

Hey everyone, Sunny here!
I'm the founder of Nexus Gateway (nexus-gateway.org). I just built an open-source, high-concurrency AI middleware in Go that handles hybrid semantic caching (Redis + Pinecone with W5H2 intent extraction) and edge PII data governance.

Looking to connect with other infra and backend builders here. Would love to exchange notes on scaling LLM proxies and handling low-latency inference!

GoInfrastructureCachingLLM

Comments1

  • @ryanallis
    Ryan Allis
    Founder of AI Lounge and SaasRise, helping founders reach $100M+ exits
    Oct 20

    At iContact, bigger customers often cared less about features and more about how safely we handled their contacts' personal data. That makes the PII protection in Nexus Gateway look like the part a bank or health company would actually pay for, even if the open-source speed and caching is what gets builders to try it first.

Log in to join the thread.