@ericyocam6
Eric YocamDeveloper▲35
Professor, California Polytechnic State University
Oct 23 · New project · Agents · San Luis Obispo

Shipped: Black-Box Neural Network Hardening — AI Defense Framework

An open-source adversarial AI security framework that investigates how to strengthen black-box neural networks without access to their internal weights, architecture, or original training data.

The seven-stage experimental pipeline uses WGAN-GP generative models to synthesize training data, knowledge distillation to create high-fidelity surrogate neural networks, and adversarial training to develop defensive capabilities. The framework evaluates attacks including FGSM, PGD, Carlini & Wagner, AutoAttack, BPDA, and EOT, alongside layered defenses such as JPEG compression, bit-depth reduction, and denoising.

Evaluated across MNIST, CIFAR-10, and TinyImageNet, the project reports surrogate agreement rates of 94.7%, 85.4%, and 78.0%, respectively. The research explores how surrogate-based defense strategies can improve adversarial robustness in environments where direct model modification is restricted.

Designed for AI security researchers, machine learning engineers, and organizations investigating the protection of proprietary AI systems.

Black-Box Neural Network Hardening — AI Defense Framework logoBlack-Box Neural Network Hardening — AI Defense Framework@ericyocam/black-box-ai-model-hardening · github.com/ericyoc/black-box_nn_hardening_surrogate_model_defense_poc
AI SecurityAdversarial AIDeep LearningNeural NetworksGenerative AIModel HardeningMachine Learning SecurityKnowledge Distillation

Comments2

  • @ryanallis
    Ryan Allis
    Founder of AI Lounge and SaasRise, helping founders reach $100M+ exits
    Oct 23

    Which kind of company needs this most, since it protects AI systems they bought but can't open up or change?

  • @ericyocam
    Eric Yocam
    Agentic AI that performs cyber quantum ai activities
    Oct 23

    Thanks, Ryan. I think the strongest use case is for organizations in regulated industries, such as financial services, healthcare, and critical infrastructure, that rely on third-party AI models but have limited visibility into their internal architectures. These organizations need ways to evaluate and improve adversarial robustness without modifying proprietary model weights. The surrogate approach provides a potential path for testing vulnerabilities and developing external defenses. Further validation would be needed before production deployment, but I see significant opportunities in securing third-party AI systems. Appreciate the question!

Log in to join the thread.