Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
184 changes: 184 additions & 0 deletions docs/organizations/ai-risk-hub.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,184 @@
---
description: The organization's AI Risk Hub dashboard provides an overview of all the AI issues detected in the repositories applied to the organization's AI Policy standard and your organization's risk level based on your AI practices.
---

# AI Risk Hub

The **AI Risk Hub** gives you visibility into the AI usage, dependencies, and risks across your organization's repositories. It brings together AI policy compliance, risk assessment, and a detailed inventory of AI resources found in your codebase.
It also provides an overview of all the AI issues detected in the repositories applied to the organization's AI Policy standard and your organization's risk level based on your AI practices. Here, you can navigate through the issues detected in your repositories and filter them by severity and category. You can also filter the issues by selecting specific repositories or using [the segments that you have set up](segments.md).

!!! important
This dashboard is a Business tier feature, generally available until May 18.

Check warning on line 11 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Microsoft.Adverbs] Consider removing 'generally'. Raw Output: {"message": "[Microsoft.Adverbs] Consider removing 'generally'.", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 11, "column": 48}}}, "severity": "WARNING"}

To access the AI Risk Hub, select an organization from the top navigation bar and click on **AI Risk** on the left navigation sidebar.

Inside this hub, you can find the following pages to help you monitor the AI risk of your organization:

- [Overview](#overview)
- [AI Inventory](#ai-inventory)

---

## Overview

The **Overview** tab is the main dashboard for monitoring AI risk across your organization. It includes:

- [AI Policy Compliance](#ai-policy-compliance)
- [Risk Level](#risk-level)
- [AI Risk Checklist](#ai-risk-checklist)
- [Repositories with most AI issues](#repositories-with-most-ai-issues)
- [AI Inventory summary](#ai-inventory-summary)

![AI Risk Hub overview](images/ai-risk-hub.png)

### AI Policy Compliance

This section shows whether your organization has an AI Policy enabled and how your repositories are performing against it.

The AI Policy is a curated set of rules designed to detect AI-related risks in your code. When enabled, Codacy applies AI-specific patterns to your repositories and enforces them on pull request checks. You can enable the policy directly from this section.

Once enabled, the section displays a breakdown of AI issues by **severity** and **category**.

If you already have the AI Policy enabled, an **Edit** button lets you manage which repositories have the policy applied.

The AI Policy covers four categories of AI-specific risks:

#### Unapproved model calls

Detects usage of disallowed or non-compliant AI models in your codebase, giving you visibility into potential compliance violations.

#### AI Safety

Flags missing or incorrect safety practices when using AI-generated or AI-integrated code.

#### Hardcoded secrets

Detects hardcoded API keys, credentials, and secrets related to AI services.

Check failure on line 56 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Terms] Use 'Hardcoded' instead of 'hardcoded'. Raw Output: {"message": "[Vale.Terms] Use 'Hardcoded' instead of 'hardcoded'.", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 56, "column": 9}}}, "severity": "ERROR"}

#### Vulnerabilities (insecure dependencies / SCA)

Identifies vulnerable AI-related dependencies and packages through software composition analysis.

![AI Policy Compliance](images/ai-risk-policy-compliance.png)

---

### Risk Level

This panel shows your organization's overall **AI Risk Level**: **High**, **Medium**, or **Low**.

The risk level is calculated based on whether essential AI safeguards have been enabled in Codacy. These safeguards are listed in the [AI Risk Checklist](#ai-risk-checklist).

![Risk Level](images/ai-risk-level.png)

---

### AI Risk Checklist

The AI Risk Checklist outlines the source code controls that Codacy recommends enabling across your organization:

- **AI Policy enabled:** Enable the AI Policy inside the AI Risk Hub tab.
- **Coverage enabled:** Set up code coverage for your repositories.
- **Enforced gates:** Add quality gates to your repositories and apply gate policies across your organization.
- **Protected pull requests:** Protect pull requests by enforcing quality gates in your Git workflow.
- **Daily vulnerability scans:** Enable Proactive SCA to protect your repositories from dependency vulnerabilities.
- **Applications scanned:** Enable App scanning to scan web applications and APIs for security vulnerabilities.

Check failure on line 85 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'APIs'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'APIs'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 85, "column": 78}}}, "severity": "ERROR"}

The more controls you have enabled, the lower your organization's AI risk level.

![AI Risk Checklist](images/ai-risk-checklist.png)

---

### Repositories with most AI issues

This panel shows your repositories ranked by number of open AI issues, in descending order.

You can filter the list by:

- **AI category** (unapproved model calls, AI safety, hardcoded secrets, vulnerabilities)

Check failure on line 99 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Terms] Use 'Hardcoded' instead of 'hardcoded'. Raw Output: {"message": "[Vale.Terms] Use 'Hardcoded' instead of 'hardcoded'.", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 99, "column": 55}}}, "severity": "ERROR"}
- **Severity** (critical, high, medium, low, info)
- **Checklist status**
- **Repository** or **segment**

Each entry shows how the repository's AI issue count has changed compared to the previous month.

![Repositories with most AI issues](images/ai-risk-repositories.png)

---

### AI Inventory summary

This section shows a high-level view of the AI resources discovered across your repositories, broken down by provider. For each provider, you can see the number of resources and repositories involved, as well as a breakdown by resource type.

The section surfaces the top AI providers detected in your organization. You can click through to the full [AI Inventory](#ai-inventory) for a detailed view.

![AI Inventory summary](images/ai-risk-inventory-overview.png)

---

## AI Inventory

The **AI Inventory** tab gives you a detailed, searchable view of all AI resources discovered across your organization's repositories. Resources are detected through static analysis and represent actual AI usage found in the code — not just configuration.

Check failure on line 122 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Microsoft.Dashes] Remove the spaces around ' — '. Raw Output: {"message": "[Microsoft.Dashes] Remove the spaces around ' — '.", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 122, "column": 230}}}, "severity": "ERROR"}

![AI Inventory](images/ai-risk-inventory.png)

### Resource types

Codacy detects four types of AI resources:

| Type | Pattern ID | Description |
|------|------------|-------------|
| Model usage | `ai_model_usage` | Direct calls to AI model APIs |

Check failure on line 132 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'APIs'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'APIs'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 132, "column": 61}}}, "severity": "ERROR"}
| Dependency | `ai_dependency` | AI SDKs and packages included as dependencies |

Check failure on line 133 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'SDKs'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'SDKs'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 133, "column": 37}}}, "severity": "ERROR"}
| API key | `ai_key` | AI service API keys and credentials found in code |
| Endpoint / env variable | `ai_env_endpoint` | Environment variables and endpoint references for AI services |

Check failure on line 135 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'env'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'env'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 135, "column": 14}}}, "severity": "ERROR"}

### Supported providers

Codacy detects resources from the following AI providers:

- OpenAI
- Anthropic
- Google
- Microsoft
- Amazon
- Mistral
- Cohere
- Groq

Check failure on line 148 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'Groq'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'Groq'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 148, "column": 3}}}, "severity": "ERROR"}
- Together AI
- Replicate
- DeepSeek
- Pinecone

Check failure on line 152 in docs/organizations/ai-risk-hub.md

View workflow job for this annotation

GitHub Actions / vale

[vale] reported by reviewdog 🐶 [Vale.Spelling] Did you really mean 'Pinecone'? Raw Output: {"message": "[Vale.Spelling] Did you really mean 'Pinecone'?", "location": {"path": "docs/organizations/ai-risk-hub.md", "range": {"start": {"line": 152, "column": 3}}}, "severity": "ERROR"}
- Community models

### How it works

The inventory is built from static analysis of your repositories' source code. For each AI resource found, Codacy records:

- Which **provider** the resource belongs to (e.g. OpenAI, Anthropic)
- What **type** of resource it is (model usage, dependency, API key, endpoint)
- The **marker** that identifies it (e.g. model name, package name)
- How many **repositories** contain it
- How many total **references** to it exist

### Navigating the inventory

Resources are listed as expandable entries. You can drill into each one to see:

1. **Repositories** — which repositories contain the resource, with file counts and reference counts per repository
2. **Files** — within each repository, the specific files where the resource appears
3. **Lines** — within each file, the exact lines where the resource is referenced, with direct links to the file in your Git provider

![AI resource detail](images/ai-risk-resource.png)

### Filtering

You can filter the inventory using the sidebar on the left:

- **Providers** — filter by one or more AI vendors
- **Resource types** — filter by resource type (model usage, dependency, API key, endpoint)
- **Repositories** — filter by specific repository names
- **Segments** — filter by repository segments if segmentation is enabled for your organization

You can reset all filters at once using the **Reset filters** button.
Binary file added docs/organizations/images/ai-risk-checklist.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/organizations/images/ai-risk-hub.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/organizations/images/ai-risk-level.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/organizations/images/ai-risk-resource.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
76 changes: 0 additions & 76 deletions docs/organizations/reporting/ai-risk-hub.md

This file was deleted.

Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file removed docs/organizations/reporting/images/risk-level.png
Binary file not shown.
3 changes: 1 addition & 2 deletions docs/organizations/reporting/organization-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ description: The Organization overview summarizes repositories in your Git provi

# Organization overview

Codacy provides high-level visibility into your organization's code quality, security posture, AI risk, usage, and configuration metrics. The **Organization overview** consolidates these signals in a single view.
Codacy provides high-level visibility into your organization's code quality, security posture, usage, and configuration metrics. The **Organization overview** consolidates these signals in a single view.

The **Organization overview** summarizes repositories in your Git provider organization that you [follow on Codacy](../managing-repositories.md). Use it to compare repository status and identify areas that require action.

Expand All @@ -21,7 +21,6 @@ The Organization overview includes the following tabs:
- [Duplication](#duplication)
- [Coverage](#coverage)
- [Codacy usage](./codacy-usage.md)
- [AI Risk Hub](./ai-risk-hub.md)

<div id="overview-filters">Use the filters at the top of the page to scope all dashboard data by repositories or segments. For example, filter by repositories owned by specific teams, repositories using specific languages, or exclude legacy repositories that are no longer maintained. Filter selections are stored in your browser and persist across visits.</div>

Expand Down
4 changes: 2 additions & 2 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -459,7 +459,7 @@ plugins:
"repositories-configure/integrations/jira-integration.md": "organizations/integrations/jira-integration.md"
"repositories-configure/integrations/slack-integration.md": "organizations/integrations/slack-integration.md"
# Moved pages
"organizations/ai-risk-hub.md": "organizations/reporting/ai-risk-hub.md"
"organizations/reporting/ai-risk-hub.md": "organizations/ai-risk-hub.md"
"organizations/codacy-usage.md": "organizations/reporting/codacy-usage.md"
"organizations/issue-metrics.md": "organizations/reporting/issues-metrics.md"
"organizations/issues-metrics.md": "organizations/reporting/issues-metrics.md"
Expand Down Expand Up @@ -618,9 +618,9 @@ nav:
- organizations/reporting/organization-overview.md
- organizations/reporting/issues-metrics.md
- organizations/reporting/codacy-usage.md
- organizations/reporting/ai-risk-hub.md
- organizations/using-gate-policies.md
- organizations/using-coding-standards.md
- organizations/ai-risk-hub.md
- Managing integrations:
- organizations/integrations/default-git-provider-integration-settings.md
- Slack integration for Security issues: organizations/integrations/slack-integration.md
Expand Down
Loading