Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
8 changes: 1 addition & 7 deletions .github/workflows/build-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -239,14 +239,8 @@ jobs:
rm -rf build

- name: Docs changed link gate
continue-on-error: true
run: |
# Report-only: the bulk-rename in the new-homepage launch PR
# exposes ~30 latent anchor/link issues that pre-date this
# change. They're being chipped away in follow-up PRs and
# should not block the launch. The full findings still write
# to the report file below for audit.
yarn docs:links:changed --output website-quality-governance/generated/docs-links-report.json
yarn docs:links:changed --fail-on-errors --output website-quality-governance/generated/docs-links-report.json

- name: Docs governance report
if: always()
Expand Down
2 changes: 1 addition & 1 deletion blog/Annoucing.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,16 +41,16 @@

**Apache Doris GitHub:**

[https://github.com/apache/doris](https://github.com/apache/doris)

Check notice on line 44 in blog/Annoucing.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//github.com/apache/doris. Owner%3A @apache/doris-website-maintainers

**Apache Doris website:**

[http://doris.apache.org](http://doris.apache.org)

Check notice on line 48 in blog/Annoucing.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A http%3A//doris.apache.org. Owner%3A @apache/doris-website-maintainers

**Please contact us via:**

[dev@doris.apache.org.](dev@doris.apache.org.)
[dev@doris.apache.org](mailto:dev@doris.apache.org)

**See How to subscribe:**

[https://doris.apache.org/community/subscribe-mail-list](https://doris.apache.org/community/subscribe-mail-list/)

Check notice on line 56 in blog/Annoucing.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/community/subscribe-mail-list/. Owner%3A @apache/doris-website-maintainers
2 changes: 1 addition & 1 deletion blog/release-note-1.1.0.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,13 +31,13 @@

In order to ensure the maintainability of the code structure and reduce the additional learning and development costs caused by redundant historical codes, we have decided to no longer support the Segment v1 storage format from the next version. It is expected that this part of the code will be deleted in the Apache Doris 1.2 version, and all users who are still using the Segment V1 storage format must complete the data format conversion in version 1.1. Please refer to the following link for the operation manual:

[https://doris.apache.org/zh-CN/docs/1.0/administrator-guide/segment-v2-usage](https://doris.apache.org/zh-CN/docs/1.0/administrator-guide/segment-v2-usage)

Check notice on line 34 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/zh-CN/docs/1.0/administrator-guide/segment-v2-usage. Owner%3A @apache/doris-website-maintainers

### Normal Upgrade

For normal upgrade operations, you can perform rolling upgrades according to the cluster upgrade documentation on the official website.

[https://doris.apache.org/zh-CN/docs/admin-manual/cluster-management/upgrade](https://doris.apache.org/zh-CN/docs/admin-manual/cluster-management/upgrade)

Check notice on line 40 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/zh-CN/docs/admin-manual/cluster-management/upgrade. Owner%3A @apache/doris-website-maintainers

## Features

Expand Down Expand Up @@ -87,9 +87,9 @@

**Performance test report**

[https://doris.apache.org/zh-CN/docs/benchmark/ssb](https://doris.apache.org/zh-CN/docs/benchmark/ssb)

Check notice on line 90 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/zh-CN/docs/benchmark/ssb. Owner%3A @apache/doris-website-maintainers

[https://doris.apache.org/zh-CN/docs/benchmark/tpch](https://doris.apache.org/zh-CN/docs/benchmark/tpch)

Check notice on line 92 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/zh-CN/docs/benchmark/tpch. Owner%3A @apache/doris-website-maintainers

### Compaction logic optimization and real-time guarantee

Expand Down Expand Up @@ -169,15 +169,15 @@

### Download Link

[hhttps://doris.apache.org/download](https://doris.apache.org/download)

Check notice on line 172 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//doris.apache.org/download. Owner%3A @apache/doris-website-maintainers

### Feedback

If you encounter any problems with use, please feel free to contact us through GitHub discussion forum or Dev e-mail group anytime.

GitHub Forum: [https://github.com/apache/doris/discussions](https://github.com/apache/doris/discussions)

Check notice on line 178 in blog/release-note-1.1.0.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//github.com/apache/doris/discussions. Owner%3A @apache/doris-website-maintainers

Mailing list: [dev@doris.apache.org](dev@doris.apache.org)
Mailing list: [dev@doris.apache.org](mailto:dev@doris.apache.org)

## Thanks

Expand Down
2 changes: 1 addition & 1 deletion blog/release-note-2.1.6.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@

## Behavior changes

- Removed the `delete_if_exists` option from create repository. [#38192](https://github.com/apache/doris/pull/38192)

Check notice on line 39 in blog/release-note-2.1.6.md

View workflow job for this annotation

GitHub Actions / Build Check

link-external-report-only

External link is report-only and was not fetched%3A https%3A//github.com/apache/doris/pull/38192. Owner%3A @apache/doris-website-maintainers

- Added the `enable_prepared_stmt_audit_log` session variable to control whether JDBC prepared statements record audit logs, with the default being no recording. [#38624](https://github.com/apache/doris/pull/38624) [#39009](https://github.com/apache/doris/pull/39009)

Expand Down Expand Up @@ -525,4 +525,4 @@

For example, if you are upgrading from version 0.15.x to 2.0.x, it is recommended to first upgrade to the latest version of 1.1, then upgrade to the latest version of 1.2, and finally upgrade to the latest version of 2.0.

For more upgrade information, see the documentation: [Cluster Upgrade](../../admin-manual/cluster-management/upgrade)
For more upgrade information, see the documentation: [Cluster Upgrade](../versioned_docs/version-2.1/admin-manual/cluster-management/upgrade.md)
2 changes: 1 addition & 1 deletion blog/ssb.md
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ Here we use Apache Doris 1.2.0-rc01, Apache Doris 1.1.3 and Apache Doris 0.15.0

## 6. Environment Preparation

Please first refer to the [official documentation](../install/deploy-manually/storage-compute-decoupled-deploy-manually) to install and deploy Apache Doris first to obtain a Doris cluster which is working well(including at least 1 FE 1 BE, 1 FE 3 BEs is recommended).
Please first refer to the [official documentation](../docs/install/deploy-manually/separating-storage-compute-deploy-manually.md) to install and deploy Apache Doris first to obtain a Doris cluster which is working well(including at least 1 FE 1 BE, 1 FE 3 BEs is recommended).

The scripts mentioned in the following documents are stored in the Apache Doris codebase: [ssb-tools](https://github.com/apache/doris/tree/master/tools/ssb-tools)

Expand Down
2 changes: 1 addition & 1 deletion docs/admin-manual/auth/integrations/aws-iam-role.md
Original file line number Diff line number Diff line change
Expand Up @@ -156,4 +156,4 @@ Key parameters:
| `s3.external_id` | No | The externalId value configured in the Trust Relationships Policies |
| `timeout` | No | Operation timeout, in seconds |

For detailed usage of SQL statements for more features, see [AWS Authentication and Authorization](../../../admin-manual/auth/integrations/aws-authentication-and-authorization#assumed-role-authentication).
For detailed usage of SQL statements for more features, see [AWS Authentication and Authorization](../../../admin-manual/auth/integrations/aws-authentication-and-authorization#assumed-role-authentication-and-authorization).
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ The memory statistics of historical queries can be viewed in `peakMemoryBytes` o

## Use Query Profile to analyze query memory usage

Find query information including SQL in `fe/log/fe.audit.log` based on QueryID, get the query plan by `explain SQL`, and get the query profile by executing SQL after `set enable_profile=true`. For a detailed introduction to Query Profile, refer to the document [Query Profile](../../../../query-acceleration/performance-tuning-overview/analysis-tools#doris-profile). Here we only introduce the memory-related content in Query Profile, and locate the Operator and data structure that use a lot of memory based on it.
Find query information including SQL in `fe/log/fe.audit.log` based on QueryID, get the query plan by `explain SQL`, and get the query profile by executing SQL after `set enable_profile=true`. For a detailed introduction to Query Profile, refer to the document [Query Profile](../../../../query-acceleration/performance-tuning-overview/analysis-tools#doris-profile-analyzing-execution-layer-bottlenecks). Here we only introduce the memory-related content in Query Profile, and locate the Operator and data structure that use a lot of memory based on it.

1. Locate Operators or memory data structures that use a lot of memory

Expand Down
2 changes: 1 addition & 1 deletion docs/ai/ai-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ The following table lists common AI scenarios and the corresponding capabilities
| Let AI Agents query business data in real time | [Agent Facing Analytics](#agent-facing-analytics) | MPP architecture, millisecond-level queries, MCP Server |
| Run keyword search, vector search, and aggregation on the same data | [Hybrid search and analytics](#hybrid-search-and-analytics-processing) | Inverted index + vector index + SQL |
| Accelerate AI training data preparation and feature engineering | [Lakehouse for AI](#lakehouse-for-ai) | Lakehouse architecture, open table formats, fast SQL |
| Build enterprise knowledge bases and intelligent customer service | [RAG applications](#ragretrieval-augmented-generation) | High-concurrency vector retrieval, hybrid search |
| Build enterprise knowledge bases and intelligent customer service | [RAG applications](#rag-retrieval-augmented-generation) | High-concurrency vector retrieval, hybrid search |
| Monitor model training and inference services | [AI Observability](#ai-observability) | High-throughput ingestion, inverted index, low storage cost |
| Make search understand user intent | [Semantic search](#semantic-search) | HNSW/IVF, quantization, multimodal extensions |

Expand Down
2 changes: 1 addition & 1 deletion docs/compute-storage-decoupled/file-cache/file-cache.md
Original file line number Diff line number Diff line change
Expand Up @@ -305,7 +305,7 @@ Cache-related metrics in the SQL Profile are located under the `SegmentIterator`
| `RemoteIOUseTimer` | Time spent reading from remote storage |
| `WriteCacheIOUseTimer` | Time spent writing into the file cache |

You can view the complete query performance report through [Query Performance Analysis](../../query-acceleration/performance-tuning-overview/analysis-tools#doris-profile).
You can view the complete query performance report through [Query Performance Analysis](../../query-acceleration/performance-tuning-overview/analysis-tools#doris-profile-analyzing-execution-layer-bottlenecks).

## TTL Cache Policy

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -819,7 +819,7 @@ After the Flink cluster is started, you can run the corresponding command accord
| sink.label-prefix | -- | Y | The label prefix used for Stream Load imports. In 2pc scenarios, it must be globally unique to guarantee the EOS semantics of Flink. |
| sink.properties.* | -- | N | Stream Load import parameters. For example: `'sink.properties.column_separator' = ', '` defines the column separator; `'sink.properties.escape_delimiters' = 'true'` indicates that special characters are used as separators, and `\x01` will be converted to the binary `0x01`; for JSON-format imports: `'sink.properties.format' = 'json'`, `'sink.properties.read_json_by_line' = 'true'`. For detailed parameters, see [Stream Load](../../data-operate/import/import-way/stream-load-manual.md#import-configuration-parameters). Group Commit mode: `'sink.properties.group_commit' = 'sync_mode'` sets group commit to synchronous mode. Flink Connector supports configuring group commit for imports starting from 1.6.2. For detailed usage and limitations, see [Group Commit](../../data-operate/import/load-best-practices/group-commit-manual.md). Since 26.1.0, gz compression is enabled by default for Stream Load; it can be disabled by setting `'sink.properties.compress_type' = ''`. |
| sink.enable-delete | TRUE | N | Whether to enable deletion. This option requires the Doris table to have batch deletion enabled (enabled by default in Doris 0.15+) and only supports the Unique model. |
| sink.enable-2pc | TRUE | N | Whether to enable two-phase commit (2pc). The default is true, which guarantees Exactly-Once semantics. For information on two-phase commit, see [Stream Load 2PC](../../data-operate/transaction.md#streamload-2pc). |
| sink.enable-2pc | TRUE | N | Whether to enable two-phase commit (2pc). The default is true, which guarantees Exactly-Once semantics. For information on two-phase commit, see [Stream Load 2PC](../../data-operate/transaction.md#stream-load-2pc). |
| sink.buffer-size | 1MB | N | Buffer size for the write data cache, in bytes. Modifying this is not recommended; the default configuration is sufficient. |
| sink.buffer-count | 3 | N | Number of write data cache buffers. Modifying this is not recommended; the default configuration is sufficient. |
| sink.max-retries | 3 | N | The maximum number of retries after a Commit failure. The default is 3. |
Expand Down
4 changes: 2 additions & 2 deletions docs/data-operate/import/data-source/amazon-s3.md
Original file line number Diff line number Diff line change
Expand Up @@ -223,7 +223,7 @@ mysql> select * from test_s3load;

<!-- Knowledge type: Configuration / Authentication -->

In addition to using Access Key / Secret Key, Doris also supports authenticating S3 Load and TVF via `AWS Assume Role`. This is suitable for enterprises with restrictions on distributing credentials. For detailed configuration, see [AWS Integration - Assumed Role Authentication](../../../admin-manual/auth/integrations/aws-authentication-and-authorization.md#assumed-role-authentication).
In addition to using Access Key / Secret Key, Doris also supports authenticating S3 Load and TVF via `AWS Assume Role`. This is suitable for enterprises with restrictions on distributing credentials. For detailed configuration, see [AWS Integration - Assumed Role Authentication](../../../admin-manual/auth/integrations/aws-authentication-and-authorization.md#assumed-role-authentication-and-authorization).

## FAQ

Expand Down Expand Up @@ -263,4 +263,4 @@ Increase `timeout` in `PROPERTIES` (in seconds) appropriately. The example uses
## Related documents

- [Broker Load Manual](../import-way/broker-load-manual.md)
- [AWS Integration - Assumed Role Authentication](../../../admin-manual/auth/integrations/aws-authentication-and-authorization.md#assumed-role-authentication)
- [AWS Integration - Assumed Role Authentication](../../../admin-manual/auth/integrations/aws-authentication-and-authorization.md#assumed-role-authentication-and-authorization)
2 changes: 1 addition & 1 deletion docs/data-operate/import/data-source/bigquery.md
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,7 @@ Reason: column_name[country], the length of input is too long than schema. first
Reason: column_name[country], the length of input is too long than schema. first 32 bytes of input str: [Australia] schema length: 1; actual length: 9; . src line [];
```

For data quality errors, if skipping some erroneous rows is acceptable, set the error tolerance ratio in the S3 Load `PROPERTIES`. For details on the parameters, see [Load configuration parameters](../../import/import-way/broker-load-manual.md#related-configurations).
For data quality errors, if skipping some erroneous rows is acceptable, set the error tolerance ratio in the S3 Load `PROPERTIES`. For details on the parameters, see [Load configuration parameters](../../import/import-way/broker-load-manual.md#advanced-configuration).

#### 3.4 Import data from multiple files

Expand Down
4 changes: 2 additions & 2 deletions docs/data-operate/import/data-source/snowflake.md
Original file line number Diff line number Diff line change
Expand Up @@ -250,7 +250,7 @@ Reason: column_name[country], the length of input is too long than schema. first
Reason: column_name[country], the length of input is too long than schema. first 32 bytes of input str: [Australia] schema length: 1; actual length: 9; . src line [];
```

For data quality errors, if some erroneous data is allowed to be skipped, you can set the error tolerance ratio in the `PROPERTIES` of the S3 Load job. For details, see [Import Configuration Parameters](../../import/import-way/broker-load-manual.md#related-configurations).
For data quality errors, if some erroneous data is allowed to be skipped, you can set the error tolerance ratio in the `PROPERTIES` of the S3 Load job. For details, see [Import Configuration Parameters](../../import/import-way/broker-load-manual.md#advanced-configuration).

#### 3.4 Batch Import Multiple Partitions

Expand Down Expand Up @@ -303,4 +303,4 @@ Doris does not have a type that fully corresponds to Snowflake's `TIME`. Therefo
- [Azure Load](./azure-storage.md)
- [TVF Load](./amazon-s3.md#method-2-load-with-tvf-synchronous)
- [Load Best Practices](../load-best-practices/load-best-practices.md)
- [Import Configuration Parameters](../../import/import-way/broker-load-manual.md#related-configurations)
- [Import Configuration Parameters](../../import/import-way/broker-load-manual.md#advanced-configuration)
Loading
Loading