Skip to content

Commit

Permalink
Merge pull request #222 from cecilehannay/main
Browse files Browse the repository at this point in the history
HPC section
  • Loading branch information
cecilehannay authored Jul 19, 2024
2 parents 8c1d1ad + 9d210a9 commit 5aa767c
Show file tree
Hide file tree
Showing 6 changed files with 973 additions and 163 deletions.
1 change: 1 addition & 0 deletions _toc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,7 @@ chapters:
sections:
- file: notebooks/resources/ncar_hpc
sections:
- file: notebooks/resources/ncar_hpc_module
- file: notebooks/resources/profile
- file: notebooks/resources/terminals
- file: notebooks/resources/unix
Expand Down
4 changes: 2 additions & 2 deletions notebooks/diagnostics/additional/uxarray.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"id": "f406f992-92bd-4b17-9bd3-b99c5c8abaf3",
"metadata": {},
"source": [
"# Large Ensembles"
"# uxarray"
]
},
{
Expand Down Expand Up @@ -69,7 +69,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.12"
"version": "3.10.13"
}
},
"nbformat": 4,
Expand Down
163 changes: 2 additions & 161 deletions notebooks/resources/ncar_hpc.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"id": "b631e7d7-f1d7-4253-b1b4-d01984037d37",
"metadata": {},
"source": [
"# NCAR Supercomputer\n",
"# NCAR Supercomputer\n",
"\n",
"Once you have an account and the necessary software, you can log in and run jobs on the NCAR supercomputer. The NCAR supercomputer is also referenced to the NCAR High Performance Computing (HPC). "
]
Expand All @@ -16,7 +16,7 @@
"metadata": {},
"source": [
"___\n",
"## Logging in on an NCAR system"
"## Logging in on an NCAR system"
]
},
{
Expand Down Expand Up @@ -179,165 +179,6 @@
" \n",
"</div>"
]
},
{
"cell_type": "markdown",
"id": "144caca2-989b-40a5-b6c0-c8a0b7a470da",
"metadata": {},
"source": [
"___\n",
"## Modules on NCAR HPC"
]
},
{
"cell_type": "markdown",
"id": "52805170-9397-48b3-8bdf-a2c76fb45583",
"metadata": {},
"source": [
"NCAR maintains a number of different programs on the HPC systems that can be added to your user environment by executing the ``module load`` command. "
]
},
{
"cell_type": "markdown",
"id": "a551ace3-3b1a-4130-8084-3034842e0259",
"metadata": {},
"source": [
"We will use a few modules throughout this tutorial to visualize data, so you need to be able to check which modules you have loaded and to load necessary modules."
]
},
{
"cell_type": "markdown",
"id": "f6edec76-66ba-42f0-b3b2-00a4d90f15fd",
"metadata": {},
"source": [
"We provide basic instructions below on how to check and load Modules, but to learn more about Modules on NCAR HPC, please follow the link below."
]
},
{
"cell_type": "markdown",
"id": "b2aef333-82a9-4f3d-8afa-2f5c3df4ef4c",
"metadata": {},
"source": [
"<div class=\"alert alert-info\" style=\"text-align: center;\">\n",
"\n",
"[CISL documentation on modules](https://arc.ucar.edu/knowledge_base/72581272)\n",
"\n",
"</div>"
]
},
{
"cell_type": "markdown",
"id": "33d4014c-bc0f-4ab0-aaf3-cf6cf7572f22",
"metadata": {},
"source": [
"### Checking what modules are loaded in your environment\n",
"\n",
"To check what modules you have loaded in your environment, use the following at the command line:"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "3fe867e0-f0df-4d87-a9d6-169294ec222c",
"metadata": {},
"outputs": [],
"source": [
"module list"
]
},
{
"cell_type": "markdown",
"id": "2a5ec941-4f4a-4a99-a3a0-6e514c448805",
"metadata": {},
"source": [
"### Checking what modules are available\n",
"\n",
"You can see which modules are available on the HPC resources by using the following at the command line:"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "b974222c-a270-4075-b9b9-7be7b4550942",
"metadata": {},
"outputs": [],
"source": [
"module avail"
]
},
{
"cell_type": "markdown",
"id": "0d2cfc8e-2085-4b72-b917-9e98a1586e13",
"metadata": {},
"source": [
"The command returns a list to the terminal window of the modules available to load to your environment."
]
},
{
"cell_type": "markdown",
"id": "ec74810f-c422-468d-b30e-ddb9c41d878f",
"metadata": {},
"source": [
"![Modules](../../images/prereqs/modules.png)\n",
"\n",
"*<p style=\"text-align: center;\"> Figure: Some modules available on NCAR HPC resources. D: Default Module. L: Module is loaded. </p>*"
]
},
{
"cell_type": "markdown",
"id": "c523021e-9328-4e0b-8c40-15bcf2ebab75",
"metadata": {},
"source": [
"The modules highlighted in blue are text editors discussed further in the [text editors section](https://ncar.github.io/CESM-Tutorial/notebooks/resources/text_editors.html).\n",
"\n",
"The modules highlighted in red are netCDF tools that will be discussed further in the [netCDF section](https://ncar.github.io/CESM-Tutorial/notebooks/resources/netcdf.html).\n",
"\n",
"Note that there are many other analysis software tools available to load into your NCAR HPC environment. These include: idl, julia, matlab, R, python, ncl, etc. While some of these tools are discussed in the [analysis tools section](https://ncar.github.io/CESM-Tutorial/notebooks/diagnostics/additional/analysis_tools.html), we do not highlight them all here and encourage you to further explore your environment and needs."
]
},
{
"cell_type": "markdown",
"id": "65848ac8-1cad-47bf-b680-8b129ce4e25d",
"metadata": {},
"source": [
"### Loading a new module to your environment\n",
"\n",
"You can load one of the available modules (here we show loading ncview) using the following at the command line: "
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "ad9db6c8-91a9-4c3e-84b4-6e6fb65de213",
"metadata": {},
"outputs": [],
"source": [
"module load ncview"
]
},
{
"cell_type": "markdown",
"id": "a1e13c85-65d1-4904-a07b-6cba1249ddfd",
"metadata": {},
"source": [
"<div class=\"alert alert-warning\">\n",
"<strong>NOTE: We will provide a file that will load necessary modules for those attending the in person tutorial. </strong>\n",
"</div>"
]
},
{
"cell_type": "markdown",
"id": "3c9cc169-489e-427a-865a-539468cb060d",
"metadata": {},
"source": []
},
{
"cell_type": "code",
"execution_count": null,
"id": "7a1cb820-6efd-4eda-9581-a7067ff4f27d",
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
Expand Down
Loading

0 comments on commit 5aa767c

Please sign in to comment.