doc: Tensor and DLPack

[junrushao]

No description provided.

[gemini-code-assist]

Summary of Changes

Hello @junrushao, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces extensive documentation for TVM-FFI's tensor handling, centralizing around the DLPack standard. It aims to provide clear guidance on tensor types, ownership, memory layouts, and ABI conversions, along with practical API usage and integration strategies for various developer roles, ensuring a consistent and robust approach to tensor management within the TVM-FFI ecosystem.

Highlights

• New Tensor Documentation: A comprehensive guide docs/concepts/tensor.rst has been added, detailing how TVM-FFI handles tensors, with a strong focus on DLPack integration.
• Tensor Types and Ownership: The documentation clarifies different tensor types (DLPack's DLTensor, DLManagedTensorVersioned, and TVM-FFI's TensorView, TensorObj, Tensor) and their ownership semantics (non-owning views vs. managed objects).
• ABI Layout and Conversion: It explains the memory layout of these tensor types and how conversions occur across TVM-FFI's stable C ABI, emphasizing lifetime management.
• API Usage and Allocation: The guide covers important C++ and Python APIs for tensor manipulation, recommended allocation patterns (e.g., FromEnvAlloc), and what TVM-FFI's tensor system does not provide (e.g., kernels, advanced indexing).
• Integration Guidance: Specific tips are provided for kernel library developers, graph compilers, and runtimes on how to effectively integrate with TVM-FFI's tensor system, including stream context for GPU.
• Documentation Structure Update: The main documentation index (docs/index.rst) has been updated to include the new tensor concept document.
• Minor Code Comment: A small comment was added in include/tvm/ffi/reflection/overload.h for clarity regarding a super class alias.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	/gemini review	Performs a code review for the current pull request in its current state.
Pull Request Summary	/gemini summary	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	/gemini help	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

[gemini-code-assist]

Code Review

This pull request introduces comprehensive documentation for Tensor and DLPack in TVM-FFI, which is a great addition for developers. The changes also include a minor documentation update in overload.h and adding the new documentation page to the main index. My review primarily focuses on improving the clarity and grammatical correctness of the new tensor.rst documentation file, with several suggestions to fix typos and rephrase sentences for better readability.

[junrushao]

/gemini review

[gemini-code-assist]

Code Review

This pull request adds extensive documentation for Tensors and their interaction with DLPack within TVM-FFI. The new documentation page docs/concepts/tensor.rst is well-structured and covers the essential concepts, from tensor classes and memory layouts to ABI conversions and API usage. My review focuses on improving the clarity and correctness of this new documentation. I've pointed out several typos, grammatical errors, and a couple of bugs in the code examples to ensure the documentation is as accurate and easy to understand as possible. Overall, this is a great addition to the documentation.

[junrushao]

/gemini Review

[gemini-code-assist]

Code Review

This pull request introduces comprehensive documentation for Tensors and DLPack, which is a valuable addition. It also includes numerous wording improvements across other documentation files, enhancing clarity and readability. I've found one minor typo in a code example within the new documentation that should be corrected.