3 Steps to Red Team Your LLMs on Databricks (Using Tools You Didn't Know You Had)

You added guardrails, PII filters, and safety controls. Then someone Base64-encodes a prompt injection and your model hands over data like it was asked nicely.This session is a live walkthrough of how to red team your LLMs on Databricks using BlackIce, Databricks' own open-source containerised toolkit. 14 security tools. One Docker image. Five minutes to deploy.In 3 steps we will spin up a model serving endpoint with AI Gateway guardrails, launch BlackIce on a single-node cluster with NVIDIA's Garak, Microsoft's PyRIT, Meta's CyberSecEval and 11 more tools ready to go, then point Garak at the endpoint and run attack probes, encoding attacks, jailbreaks, prompt injection, and system prompt extraction — to get an Attack Success Rate in minutes.You'll leave fully understanding how to use BlackIce to secure your LLMs, whilst feeling slightly more paranoid about just how easy they are to break. Better you find out here than in production.