feat: create llms.txt generator

[araujogui]

Description

Creates a llms.txt generator

Validation

npx api-docs-tooling generate  -i doc/api/*.md -t llms-txt -o out/

Related Issues

Fixes #226

Check List

• I have read the Contributing Guidelines and made commit messages that follow the guideline.
• I've covered new added functionality with unit tests if necessary.

[AugustinMauroy]

Could you add some test this is not a legacy thing.

[AugustinMauroy]

LGMT ! that's cool

[araujogui]

I'm not sure using the first paragraph node as the description is a good idea. Here's the actual llms.txt—some of the descriptions seem incorrect: https://pastebin.com/edEGgFLy

Maybe we could add another yaml property like llm-description to api docs

[ovflowd]

Minor nits but LGTM!

[ovflowd]

Final review pass! (There's 2 open threads, feel free to resolve them when you're ready and merge the PR)

[xiongemi]

what is the exact link generated by this? i tried https://nodejs.org/docs/llms-full.txt, i got directory not found error 'Directory not found'.

[AugustinMauroy]

We implement the generator but the tools ins't used yet on node core.

[ovflowd]

To phrase it a bit clearly, doc-kit is not used upstream yet by nodejs.org/docs

[uncomplexity]

is there a planned date for availability of https://nodejs.org/llms.txt?

there's https://nodejs.org/docs/latest/api/all.html but its markdown version could be helpful?

[AugustinMauroy]

this feat is only for docs. it's will come in a closer future. But you can already have a preview there https://beta.docs.nodejs.org

[araujogui]

is there a planned date for availability of https://nodejs.org/llms.txt?

there's https://nodejs.org/docs/latest/api/all.html but its markdown version could be helpful?

It's a WIP, see:
nodejs/node#62027
nodejs/node#59264

[avivkeller]

Thanks @araujogui! That was a healthy reminder, I'll run CI and try to get your LLM PR merged in the near future