Skip to content

Commit

Permalink
remove robinhood (#1828)
Browse files Browse the repository at this point in the history
  • Loading branch information
xpillons authored Feb 9, 2024
1 parent 78a65c4 commit 738e3b4
Show file tree
Hide file tree
Showing 15 changed files with 3 additions and 30 deletions.
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@ Azure HPC On-Demand Platform (az-hop), provides the end-to-end deployment mechan
- Dynamic resources provisioning and autoscaling is done by [Azure CycleCloud](https://docs.microsoft.com/en-us/azure/cyclecloud/?view=cyclecloud-8) pre-configured job queues and integrated health-checks to quickly avoid non-optimal nodes,
- A Jumpbox to provide admin access,
- A common shared file system for home directory and applications is delivered by [Azure Netapp Files](https://azure.microsoft.com/en-us/services/netapp/),
- A Lustre parallel filesystem using local NVME for high performance that automatically archives to [Azure Blob Storage](https://azure.microsoft.com/en-gb/services/storage/blobs/) using the [Robinhood Policy Engine](https://github.com/cea-hpc/robinhood) and [Azure Storage data mover](https://github.com/wastore/lemur),
- [Grafana](https://grafana.com/) dashboards to monitor your cluster,
- Remote Visualization with [noVNC](https://novnc.com/info.html) and GPU acceleration with [VirtualGL](https://www.virtualgl.org/).

Expand Down
2 changes: 1 addition & 1 deletion bicep/azhop.bicep
Original file line number Diff line number Diff line change
Expand Up @@ -402,7 +402,7 @@ var config = {
} : {}
)

asg_names: union([ 'asg-ssh', 'asg-rdp', 'asg-jumpbox', 'asg-ad', 'asg-ad-client', 'asg-pbs', 'asg-pbs-client', 'asg-cyclecloud', 'asg-cyclecloud-client', 'asg-nfs-client', 'asg-telegraf', 'asg-robinhood', 'asg-ondemand', 'asg-deployer', 'asg-mariadb-client' ],
asg_names: union([ 'asg-ssh', 'asg-rdp', 'asg-jumpbox', 'asg-ad', 'asg-ad-client', 'asg-pbs', 'asg-pbs-client', 'asg-cyclecloud', 'asg-cyclecloud-client', 'asg-nfs-client', 'asg-telegraf', 'asg-ondemand', 'asg-deployer', 'asg-mariadb-client' ],
deployLustre ? [ 'asg-lustre-client' ] : [],
deployGrafana ? [ 'asg-grafana' ] : []
)
Expand Down
1 change: 0 additions & 1 deletion config.schema.json
Original file line number Diff line number Diff line change
Expand Up @@ -883,7 +883,6 @@
"asg-nfs-client": { "type": "string" },
"asg-telegraf": { "type": "string" },
"asg-grafana": { "type": "string" },
"asg-robinhood": { "type": "string" },
"asg-ondemand": { "type": "string" },
"asg-deployer": { "type": "string" },
"asg-mariadb-client": { "type": "string" }
Expand Down
1 change: 0 additions & 1 deletion config.tpl.yml
Original file line number Diff line number Diff line change
Expand Up @@ -160,7 +160,6 @@ network:
# asg-nfs-client: asg-nfs-client
# asg-telegraf: asg-telegraf
# asg-grafana: asg-grafana
# asg-robinhood: asg-robinhood
# asg-ondemand: asg-ondemand
# asg-deployer: asg-deployer
# asg-mariadb-client: asg-mariadb-client
Expand Down
1 change: 0 additions & 1 deletion docs/apps/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,6 @@ There are actually 9 application folder under the ood-applications ansible role
- [bc_vmd](#visual-molecular-dynamics) : A Visual Molecular Dynamics launcher running as a Linux Remote Desktop session
- cyclecloud : A python passenger application to launch the Cycle Cloud Web UI
- grafana : A python passenger application to launch the Grafana Web UI
- robinhood : A python passenger application to launch the Robinhood Web UI
The specific bc_* pattern comes from Open OnDemand and means that the Batch Connect feature is used. This provides form design, job scheduler integration, remote desktop integration, session management and more.
To add a new Interactive Application named `foo` follow these steps :
Expand Down
1 change: 0 additions & 1 deletion docs/deploy/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -790,7 +790,6 @@ network:
```
### Pre-requisities for using an existing VNET
- There is a need of a minimum of 5 IP addresses for the infrastructure VMs
- Allow enough IP addresses for the Lustre cluster, default being 4 : Robinhood + Lustre + 2*OSS
- Delegate a subnet to Azure NetApp Files like documented [here](https://docs.microsoft.com/en-us/azure/azure-netapp-files/azure-netapp-files-delegate-subnet)
- Look at the `tf/network_security_group.tf` and `tf/variables_local.tf` to get the list of all ports and rules define between subnets

Expand Down
1 change: 0 additions & 1 deletion docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,6 @@ Azure HPC OnDemand Platform or **azhop**, delivers an end-2-end deployment mecha
- [Azure Cycle Cloud](https://docs.microsoft.com/en-us/azure/cyclecloud/?view=cyclecloud-8) to handle autoscaling of nodes thru job scheduler integration,
- A Jumpbox to provide admin access,
- Azure Netapp Files for home directory and data storage,
- A Lustre cluster for the scratch storage with HSM capbilities to Azure Blobs thru a [RobinHood](https://github.com/cea-hpc/robinhood) integration,
- [Grafana](https://grafana.com/) dashboards to monitor your cluster

<img src="./images/azhop_architecture.png" width="75%">
Expand Down
2 changes: 1 addition & 1 deletion docs/tutorials/Implementing_Azure_HPC_OnDemand_Platform.md
Original file line number Diff line number Diff line change
Expand Up @@ -467,7 +467,7 @@ In this exercise, you'll install and configure software components that form the
1. In the **Monitoring** menu, select **Azure CycleCloud**.
1. When presented with the page titled **App has not been initialized or does not exist**, select **Initialize App**.

> Note: This prompt reflects the OnDemand component architecture, which the Azure HPC OnDemand Platform solution relies on to implement its portal. The shared frontend creates Per User NGINX (PUN) processes to provide connectivity to such components as **Azure CycleCloud**, **Grafana**, or **Robinhood Dashboard**.
> Note: This prompt reflects the OnDemand component architecture, which the Azure HPC OnDemand Platform solution relies on to implement its portal. The shared frontend creates Per User NGINX (PUN) processes to provide connectivity to such components as **Azure CycleCloud** or **Grafana**.

1. On the **Azure CycleCloud for Azure HPC On-Demand Platform** page, note the presence of a configuration of a cluster named **pbs1**.
1. On the **pbs1** page, select the **Arrays** tab, and note that it contains six entries representing queue definitions you reviewed earlier in the **config.yml** file.
Expand Down
1 change: 0 additions & 1 deletion docs/tutorials/marketplace_deployment.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,6 @@ This tutorial with create the following resources.
- [Azure CycleCloud](https://learn.microsoft.com/en-us/azure/cyclecloud/?view=cyclecloud-8&WT.mc_id=Portal-Microsoft_Azure_Marketplace) to handle autoscaling of nodes thru job scheduler integration,
- A Jumpbox to provide admin access,
- Azure Netapp Files for home directory and data storage,
- A Lustre cluster for the scratch storage with HSM capabilities to Azure Blobs thru a [Robinhood](https://github.com/cea-hpc/robinhood) integration,
- [Grafana](https://grafana.com/) dashboards to monitor your cluster.

# Deployment steps
Expand Down
1 change: 0 additions & 1 deletion docs/user_guide/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,3 @@
- Monitoring
- [CycleCloud](cycle_cloud.md)
- [Grafana Dashboards](grafana.md)
- [Lustre HSM monitoring](robinhood.md)
5 changes: 0 additions & 5 deletions docs/user_guide/robinhood.md

This file was deleted.

12 changes: 1 addition & 11 deletions playbooks/roles/grafana/templates/azhop_infra_servers.json.j2
Original file line number Diff line number Diff line change
Expand Up @@ -4079,23 +4079,13 @@
"text": "{{ccportal_name}}",
"value": "{{ccportal_name}}"
},
{
"selected": false,
"text": "robinhood",
"value": "robinhood"
},
{
"selected": false,
"text": "{{grafana_name}}",
"value": "{{grafana_name}}"
},
{
"selected": false,
"text": "guacamole",
"value": "guacamole"
}
],
"query": "{{scheduler_name}}, {{ondemand_name}}, {{ccportal_name}}, robinhood, {{grafana_name}}",
"query": "{{scheduler_name}}, {{ondemand_name}}, {{ccportal_name}}, {{grafana_name}}",
"queryValue": "",
"skipUrlSync": false,
"type": "custom"
Expand Down
1 change: 0 additions & 1 deletion tests/configs/config_full.yml
Original file line number Diff line number Diff line change
Expand Up @@ -130,7 +130,6 @@ network:
asg-nfs-client: asg-nfs-client
asg-telegraf: asg-telegraf
asg-grafana: asg-grafana
asg-robinhood: asg-robinhood
asg-ondemand: asg-ondemand
asg-deployer: asg-deployer
asg-mariadb-client: asg-mariadb-client
Expand Down
2 changes: 0 additions & 2 deletions tf/variables_local.tf
Original file line number Diff line number Diff line change
Expand Up @@ -304,7 +304,6 @@ locals {
asg-nfs-client = "asg-nfs-client"
asg-telegraf = "asg-telegraf"
asg-grafana = "asg-grafana"
asg-robinhood = "asg-robinhood"
asg-ondemand = "asg-ondemand"
asg-deployer = "asg-deployer"
asg-mariadb-client = "asg-mariadb-client"
Expand All @@ -323,7 +322,6 @@ locals {
grafana = ["asg-ssh", "asg-grafana", "asg-ad-client", "asg-telegraf", "asg-nfs-client"]
jumpbox = ["asg-ssh", "asg-jumpbox", "asg-ad-client", "asg-telegraf", "asg-nfs-client"]
ondemand = ["asg-ssh", "asg-ondemand", "asg-ad-client", "asg-nfs-client", "asg-pbs-client", "asg-lustre-client", "asg-telegraf", "asg-cyclecloud-client", "asg-mariadb-client"]
robinhood = ["asg-ssh", "asg-robinhood", "asg-lustre-client", "asg-telegraf"]
scheduler = ["asg-ssh", "asg-pbs", "asg-ad-client", "asg-cyclecloud-client", "asg-nfs-client", "asg-telegraf", "asg-mariadb-client"]
}

Expand Down
1 change: 0 additions & 1 deletion tutorials/quickstart/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,6 @@ _nsg_rules:
AllowLustreIn : ['409', 'Inbound', 'Allow', 'Tcp', 'Lustre', 'asg/asg-lustre', 'asg/asg-lustre-client']
AllowLustreClientIn : ['410', 'Inbound', 'Allow', 'Tcp', 'Lustre', 'asg/asg-lustre-client', 'asg/asg-lustre']
AllowLustreClientComputeIn : ['420', 'Inbound', 'Allow', 'Tcp', 'Lustre', 'subnet/compute', 'asg/asg-lustre']
AllowRobinhoodIn : ['430', 'Inbound', 'Allow', 'Tcp', 'Web', 'asg/asg-ondemand', 'asg/asg-robinhood']

# CycleCloud
AllowCycleWebIn : ['440', 'Inbound', 'Allow', 'Tcp', 'Web', 'asg/asg-ondemand', 'asg/asg-cyclecloud']
Expand Down

0 comments on commit 738e3b4

Please sign in to comment.