KNOX-3249: Integrate new yarn scheduler-ui into KNOX homepage

[Hean-Chhinling]

(It is very important that you created an Apache Knox JIRA for this change and that the PR title/commit message includes the Apache Knox JIRA ID!)

KNOX-3249 - Integrate new scheduler-ui into YARN

What changes were proposed in this pull request?

Adding the new YARN Scheduler-UI at Knox Homepage. So that it stays behind knox proxy when navigate to Scheduler-UI via Knox homepage.

https://{knox-gateway}:8443/gateway/cdp-proxy/yarn-scheduler-ui/

How was this patch tested?

Manual testing verified that the Scheduler-UI works as expected behind Knox-proxy by adding/deleting queues.

Integration Tests

(Please add or update integration tests .github/workflows/tests for the feature you are adding. If no unit test is added, please explain why. Check out .github/workflows/tests/README.md for instructions)

UI changes

New YARN Scheduler UI will appear at the KNOX Homepage:

[Hean-Chhinling]

Will change the Service Name from "YARNSUI" into "YARN-SCHEDULER-UI"

[K0K0V0K]

Can we please add comments to the route, rule and filter entries? What is the purpose of them?

[Hean-Chhinling]

Can we please add comments to the route, rule and filter entries? What is the purpose of them?

Sure, I will add some comments for non-trivial rules

[github-actions]

Test Results

7 tests   7 ✅  1s ⏱️
1 suites  0 💤
1 files    0 ❌

Results for commit 2f8871e.

♻️ This comment has been updated with latest results.

[moresandeep]

@Hean-Chhinling the rules look great, there are a few changes that I suggest you do and this should be ready to go.
Thank you for your contribution to Knox.

[Hean-Chhinling]

@Hean-Chhinling the rules look great, there are a few changes that I suggest you do and this should be ready to go. Thank you for your contribution to Knox.

Thanks @moresandeep for the review!
Regarding the dispatch class. I have created another class gateway-service-rm/src/main/java/org/apache/knox/gateway/rm/dispatch/RMSchedulerUIHaDispatch.java to handle YARN HA for SchedulerUI as follows the RMUI2HaDispatch.java and use org.apache.knox.gateway.dispatch.ConfigurableDispatch.

Please kindly review on give your thoughts.

I am in the process of spinning up a cluster and test in YARN HA.

[Hean-Chhinling]

I tested in YARN HA environment with:

• Stopping one ResourceManager(RM) active and let the standby RM become active
• Add/delete queues in Scheduler-UI

They work as expected without any problems and in the cdp-proxy.xml it has two hosts same as YARN UI2:

<service>
        <role>YARN-SCHEDULER-UI</role>
        <url>https://{node2}:8090</url>
        <url>https://{node1}:8090</url>
    </service>

When you get time, may I ask for your review again @moresandeep?

[moresandeep]

Looks good, thank you for your contribution @Hean-Chhinling! Let's wait for all the checks to pass before committing.

[Hean-Chhinling]

Looks good, thank you for your contribution @Hean-Chhinling! Let's wait for all the checks to pass before committing.

Thanks!
FYI, look like all the checks have passed