AI Security
Vendor Checklist for Small Companies Before Adopting a Managed AI Agent Platform
TL;DR: Before you sign up for a managed AI agent platform, verify the vendor’s security posture with a checklist that covers data handling, model isolation, access controls, auditability, and incident response. If any item is unclear, ask for documentation or walk‑throughs; a small team can’t afford hidden risks.
What security policies and certifications does the vendor provide?
Small companies often rely on the vendor’s compliance claims. Ask for:
- Evidence of ISO/IEC 27001, SOC 2, or comparable certifications.
- Public security policies that describe how the provider protects data in transit and at rest.
- Reference to the OWASP GenAI Security Project guidelines that the service follows.
How does the platform handle data ingestion, storage, and deletion?
Managed AI agents usually receive prompts, uploaded files, or API‑fetched data. Verify:
- Whether data is retained after a session ends, and for how long.
- Encryption details for data at rest (e.g., AES‑256) and in transit (TLS 1.2+).
- If the vendor offers configurable retention windows or an explicit “forget” API.
- Compliance with NIST Trustworthy AI data‑privacy principles.
What access‑control model does the service use?
Agents often need to call external APIs or invoke internal services. The vendor should expose a granular permission model that lets you:
- Scope API keys or service tokens to specific actions (read‑only, write‑only, or no‑exec).
- Restrict which downstream resources the agent can reach (e.g., only a designated CRM endpoint).
- Audit every permission change with immutable logs.
Both Claude Managed Agents and OpenAI Agents provide role‑based access controls that you can compare.
How does the vendor mitigate prompt‑injection and model‑poisoning risks?
Prompt injection can cause the agent to leak data or execute unintended commands. Look for:
- Built‑in prompt sanitization or sandboxing of user inputs.
- Runtime monitoring that detects anomalous token patterns.
- Documentation of how the model is fine‑tuned and whether the provider reviews training data for malicious content.
What audit and logging capabilities are available?
For compliance and troubleshooting you need visibility into:
- All inbound prompts, outbound responses, and API calls.
- Metadata such as timestamps, user identifiers, and session IDs.
- Exportable logs in a standard format (e.g., JSON‑L) that can be ingested into your SIEM.
Confirm that logs are immutable and retained for a period that matches your regulatory obligations.
What incident‑response support does the vendor promise?
In the event of a breach or a misbehaving agent, you should know:
- The SLA for initial response (e.g., 1‑hour critical incident).
- Whether the provider will assist in forensic analysis and data purge.
- If there is a dedicated security contact or “bug‑bounty” program.
Sample Checklist for Small Teams
# Vendor Security Checklist
## Governance
- [ ] ISO/IEC 27001 or SOC 2 report provided
- [ ] Public security policy links
## Data Handling
- [ ] Encryption at rest (AES‑256) confirmed
- [ ] TLS 1.2+ for all transport
- [ ] Configurable data‑retention window
- [ ] “Forget” API or manual deletion process
## Access Controls
- [ ] Role‑based API key scoping
- [ ] Least‑privilege permissions for external calls
- [ ] Immutable permission‑change logs
## Model Safety
- [ ] Prompt sanitization documented
- [ ] Anomaly detection on token streams
- [ ] Training data review process
## Observability
- [ ] Full request/response logging
- [ ] Exportable JSON‑L logs
- [ ] Retention period aligned with compliance
## Incident Response
- [ ] SLA for critical incident response
- [ ] Dedicated security liaison
- [ ] Forensic assistance clause
Use this list as a baseline. If the vendor cannot answer any item, consider alternative platforms or request a custom contract amendment.
When you’ve completed the checklist and the vendor meets your criteria, AISecAll can help you integrate the chosen platform securely into your existing workflow, handling token‑scoping and audit‑log wiring so you stay focused on delivering value.
Need a practical AI security review?
AISecAll reviews prompts, tool permissions, document flows, and agent behavior so small teams can use AI without guessing where the risk sits.