Connect EvalOps to the stack you already trust
EvalOps meets you where your evaluations live. Stream telemetry from apps, CI, or the free Grimoire agent, then connect providers, workflows, and governance tools so every stakeholder operates from the same source of truth.
Swap providers without rewriting evaluation workflows
EvalOps keeps prompts, responses, and cost telemetry aligned across every LLM connector so quality and governance stay consistent.
OpenAI
Models, batch endpoints, and usage telemetry with token-level analytics.
Anthropic
Claude family access with safety classifiers and guardrail scoring.
Azure OpenAI
Regional deployments, customer-managed keys, and private networking.
AWS Bedrock
Invoke Bedrock-hosted models with latency and cost insights in EvalOps.
Vertex AI
Google-hosted models with project-level routing and quota tracking.
Groq
Low-latency inferencing with EvalOps scenario monitoring and cost guardrails.
Cohere
Enterprise generation and embeddings with contract-aware scoring.
Custom HTTP
Bring any internal or third-party model via declarative connector specs.
Bring EvalOps into your delivery pipelines
Connect CI/CD, observability, and collaboration tools so evaluation outcomes trigger the right workflows automatically.
CI/CD pipelines
GitHub Actions, GitLab, CircleCI, and Jenkins runners push traces for pre-release scorecards.
Observability
Datadog, New Relic, PagerDuty, and custom webhooks close the loop when monitors fire.
Experiment tracking
Weights & Biases and MLflow metadata align experiments with EvalOps scorecards.
Knowledge bases
Vector stores such as Pinecone, Weaviate, and pgvector keep retrieval telemetry traceable.
Wire EvalOps into your risk posture
Align identity, residency, and compliance automation with EvalOps so platform and security teams stay in lockstep.
Identity & access
Okta, Azure AD, Google Workspace, and SAML/SCIM keep workspaces aligned with corporate IAM.
Data residency
Regional data planes in the US, EU, APAC, and customer-managed clouds.
Compliance automation
Built-in mappings for SOC2, HIPAA, GDPR, PCI, and custom policy attestations.
Security tooling
Integrations with AWS KMS, HashiCorp Vault, and customer SIEM pipelines.
We scope custom connectors and governance programs together
EvalOps engagements regularly include proprietary provider connectors, data residency controls, and compliance reviews. Tell us what success looks like and we’ll design the rollout side by side.