Apply fixes for UP ruff rule

[emdneto]

Description

• Replaced deprecated typing.X generics (Dict, List, Set, Tuple, Type, Deque) with their built-in equivalents
• Replaced typing.Union[X, Y] annotations with X | Y syntax (UP007)
• Replaced typing.Optional[X] annotations with X | None syntax (UP045)
• Removed redundant pages from docs (https://opentelemetry-python.readthedocs.io/en/latest/api/context.context.html, https://opentelemetry-python.readthedocs.io/en/latest/api/trace.status.html and https://opentelemetry-python.readthedocs.io/en/latest/api/trace.span.html) since it was causing docs CI to fail e.g.,

opentelemetry._logs._internal.LogRecord:1:more than one target located for cross-referencing 'Context': opentelemetry.context.Context, opentelemetry.context.context.Context

90% of the changes were made by ruff with ruff check --fix. The agent removed the unused imports and fixed minor issues.

Fixes #4227

Assisted-by: Copilot

[DylanRussell]

nice. couple failed CI checks but otherwise LGTM

[emdneto]

Note for manual changes i've done in 6051e44 and 874317d to make CI pass

[MikeGoldsmith]

Looks good. Some linter checks failed that will need to be cleaned up.

[DylanRussell]

If you have time I think we could do the same thing in the contrib repo: https://github.com/open-telemetry/opentelemetry-python-contrib/blob/main/pyproject.toml#L162

[emdneto]

If you have time I think we could do the same thing in the contrib repo: https://github.com/open-telemetry/opentelemetry-python-contrib/blob/main/pyproject.toml#L162

That's the plan after getting this merged