deepeval
confident-ai/deepevalPlugin
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
Why this score
Popularity score: 94/100 from public GitHub signals only. It shows how widely used and maintained this is, not how well it works. Not included yet: the fake-star check. The security scan is shown separately and doesn't change the score. How we rank
Security
Scanned Oct 22, 2026 at commit da9b2c969f8a, first 300 source files (it's a large repo), with Cisco's open-source skill-scanner.
What its code does:
- Reads environment variables and sends network requests with them API clients do this to send your key to the service. Check which service it talks to.c.py and 2 more
- Runs shell commands Common for dev tools. Read the commands it runs.deepeval/utils.py:692 and 1 more
- Runs code it builds while running (eval or exec) Harder to read ahead of time, since the code is assembled while it runs.deepeval/models/_summac_model.py:143
- Makes network requests.scripts/changelog/generate.py:426, deepeval/__init__.py:120, deepeval/cli/auth/flow.py:306 and 7 more
- Reads environment variables, where API keys usually livedeepeval/config/settings.py:1771
- Includes scripts in hidden folders Folders starting with a dot are easy to miss when you read a repo..scripts/changelog/generate.py, .scripts/release.py and 2 more
Web addresses in its code:
- api.confident-ai.comdeepeval/confident/api.py:23
- app.confident-ai.comdeepeval/cli/utils.py:46
- confident-ai.comdeepeval/cli/utils.py:47
- eu.api.confident-ai.comdeepeval/confident/api.py:24
- otel.confident-ai.comdeepeval/config/settings.py:981
- api.vapi.aivapi_capture.py:28
- arxiv.orgdeepeval/metrics/g_eval/g_eval.py:1
- docs.allennlp.orgdeepeval/models/_summac_model.py:123
- quac.aideepeval/utils.py:516
- s3.amazonaws.comdeepeval/utils.py:517
- storage.googleapis.comdeepeval/models/_summac_model.py:126
- us.i.posthog.comdeepeval/telemetry/client.py:26
These are the sites named in the code, so it's where your data could go. It isn't a complete list: code can build addresses while it runs, and a few of these may be links rather than calls. Whatever you send also goes to the AI model you use.
A scan lists patterns in the code. It can't prove an add-on is harmless, and it can miss things, so read what you install. How we scan
Alternatives
Nothing from another maker does quite the same job yet.